Sheldon Brown, UCSD, Site Director Milton Halem, UMBC DirectorYelena Yesha, UMBC Site DirectorTom Conte, Georgia Tech Site Director

Fundamental Research ProjectCollaborative Research: An Interactive Situational Awareness Simulation – A View from the Clouds.

Summary. We will create a virtual world simulation, distributed across a heterogeneous compute infrastructure, to facilitate dynamic analysis of complex situations. The virtual world will be built from a variety of data sources; including high fidelity, well correlated data sources to data mining of internet feeds and many-user updates with commodity devices such as cell phones and digital cameras.

Integrating heterogeneous computing resources to enable applications that can provide robust representations of dynamic situations, including those with tragic human and environmental impact, with data derived from a multitude of sources in a timely manner for decision makers and for citizens at large.

The virtual world simulation has five interrelated operations:

1) It provides the scheme to correlate the various pieces of data

2) A collaborative tool in which data elements are improved and verified

3) An experiential tool to enable understanding of how the different

components of a complicated scenario unfold

4) Facilitates short term planning activities at the real site

5) A platform to simulate scenario forecasting for purposes such as long-

term planning or future incident mitigation.

Distributed computationUser participation,

extensibility and coherency Distributed Multi-Media Data Base Management

Network Analysis

Asset Analysis, Integration and Computation

Mobile Devices

Currently undertaking:Quarter 1: Establish an Ad Hoc CHMPR member industry planning and evaluation team. Quarter 1: Implement a Distributed Heterogeneous Cloud Computing system based on the open

Apache provided Hadoop system consisting of their File system, H base system for large image data base querrying and the MapReduce algorithm for content search and query.

Quarter 1 Milestone: Import large volumes of Haiti earthquake data for storage in the H base systemQuarter 2 – 3: Extend the virtual scalable city world with real world data. Quarter 2 Milestone: Visualize Haitian data static data from distributed cloud

Next steps:Quarter 3 Milestone: Distribute visualization to simultaneous multiple users.Quarter 4: Demonstration scenario with advanced GPS equipped multi-media mobile devices Quarter 4 Milestone: Test quality control features on human acquired event data. Quarter 4: Test uploading of streaming data from variety of devicesQuarter 4: Implement user data refinement annotations within virtual worldQuarter 4 Milestone: Compare user refined and unrefined models through external analysis. Quarter 4:

Run simulation extraction scenarios for initial demonstration of proof of concept. Road re-devlopment as initial test case.

6

Geo-located media

• Initial example of using location based media from the web, with little or no post processing, into the interactive virtual environment

7

Haiti

8

Spill data integration

• Spilled oil location data mined by UMBC integrated into virtual enviroment

9

10

Spill data integration

 GNOME: General NOAA Oil Modeling Environment

Improved Elevation Data

• NOAA Global Land One-km Elevation Project– 1 km sample resolution and meter height resolution– Big improvement over ArcGIS

• No longer confined to image based data– Not limited to 0 – 255 grayscale range– Height data in actual meters– Negative numbers for water below sea level– No need to stitch image tiles together– No compression artifacts

11

12

• Link to movie:• http://xnor.ucsd.edu/frp/SitA_gulf_down_in_the_oil_hiRes.wmv

• This movie is a capture of someone interacting with the virtual world in which these elements are combined – geo located and temporally.

• This shows just a few of the multiple models that are being integrated into the virtual world, with the capabilities of users to annotate, improve and upload new data to improve the model.

Disaster in Japan

• Streamlined process for importing world elevation data• Markers for locations of interest

13

Disaster in Japan

• Media streams from youtube, etc.

14

15

• Link to movie:• http://xnor.ucsd.edu/frp/SitAClient%202011-05-10%2016-47-10-47_japan.wmv

Scalable City Virtual World Engine

• Massively multiplayer continuous world

• Hundreds of thousands of interactive objects in dynamics systems• Data fusion of assets from variety of sources

• High fidelity models, sensor data, social media, algorithmic simulations

16

Demonstration of Scalable City Virtual World System

17

• Links to movies:

• http://xnor.ucsd.edu/IBMvideo_v17_lq_720.wmv

• http://crca.ucsd.edu/sheldon/downloads/intel_trailer2.wmv

FRP: Future Work for virtual environment

• Incorporate wind & water current data mined by UMBC

• Dynamic landscape geometry resolution– Controlled by areas of interest

• Highly detailed landscape in locations with a lot of data streams

• Low detail in areas with little to no data streams• Multi-user interaction• Downloadable client

19