Ellsworth LeDrew (UIC)Gary Foley (UIC)

Jay Pearlman (UIC and ADC)Hans-Peter Plag (UIC and ADC)

Rudolf Husar (UIC and ADC)David McCabe (ADC)

Concept (LeDrew)

Past AQ at User and the GEOSS Architecture Workshop Series:

ESIP_Jan06: First public web service chaining demo

IGARSS06 Denver: Demo of web service chaining; GMU, JPL, WashU

IGARSS07 Barcelona: Sahara Dust; WashU with 12 NAM & EU data partners

Outcome: Successful Tech Demos but ‘SoS’ constructs fragile & uncontained

Application of OGC WCS Data Access Protocol

Regardless of the data location, data type and format,

• the parameter-space-time query is the same

• the return is in user selectable format from the offerings

Coverage=THEEDDS.T& BBOX=-126,24,-65,52,0,0 &TIME=2002-07-07/2002-07-07&FORMAT=NetCDFCoverage=SEAW.Refl& BBOX=-126,24,-65,52,0,0 &TIME=2002-07-07/2002-07-07&FORMAT=GeoTIFFCoverage=SURF.Bext& BBOX=-126,24,-65,52,0,0 &TIME=2002-07-07/2002-07-07&FORMAT=NetCDF-table

Grid Image Station Data

Parameter Bounding Box Time Range Out Format

Current SOA Air Quality Applications:

Analysis Consoles

OGC WCS Data Access Protocol

GEOSS Provides SOA for Coupling for Autonomous Nodes Facilitates Publishing, Finding and Accessing Data

Emerging Air Quality Data Flow Network

Concept (con’t)

• Each role – identifies what data is required at that level– Determines how data should be packaged by GEO– Determines what is the customer base, what is the ‘chain of information’

• Includes data type, format, unit conversion, time resolution, quality control process, required fields, optional fields (Hans-Peter Plag: GEOSS User Needs and Performance Utility: Functional Spec and Database Structure)

Value-Adding Processes SBA Info Flow

Stages of AQ Data Flow and Value-Adding Processes

Domain ProcessingData Sharing

Std

. In

terf

ace

Gen. Processing

Std

. In

terf

ace

Data

Control

Reports

Reporting

Obs. & Models Decision Support System

Analyzing

Filter/IntegrateAggregate/FuseCustom Analysis

Organizing

DocumentStructure/FormatInterfacing

Characterizing

Display/BrowseCompare/Fuse Characterize

Valu

e-A

dd

ing

P

rocesses

Reporting

Inclusiveness Iterative/Agile Dynamic Report

Data

Control

Requesting Information

Providing Information

Sensors Acquisition processing

User Agencie

s

User Progra

ms

NAAQS SIPs Forecast GEOSS …

Info SystemNegotiating Space

Generic Decision Support for Air Quality Decisions

Global Earth Observing System of Systems

GEOSS

Architecture Framework

Knowledge into the Minds of

Regulatory Analysts

Knowledge into the Minds of

Technical Analysts

Observations

Reports:Model Forecasts,

Obs. Evidence

Models

DecisionsKnowledge

into the Minds of

Decision- making managers

Decision Support System

GEOSS Framework

Policy Dec.

Management

Personal Dec

Policy Dec.

Management

Personal Dec

Policy Dec.

Management

Personal Dec

GEOSS Framework

User

Application

Erquirements

System of SystemsGlobal Earth Observing System of Systems - GEOSS

Characteristics of System of Systems (SoS)

• Autonomous constituents managed/operated independently• Independent evolution of each constituent• SoS displays emergent behavior

Must recognize, manage, exploit the characteristics:

• No stakeholder has complete SoS insight• Central control is limited; distributed control is essential• Users, must be involved throughout the life of a SoS

System of Systems Issues:

From User Engagement to Stakeholder Engagement?

From: Air Fore SoS Document

GEOSS

Eco-informatics

Accountability/indicatorsSIPs, nat.rules

designations

PHASE

PM research

Risk/exposureassessments

AQ forecastingPrograms

NAAQS setting

EPANOAA

NASA

NPS

USDA

DOE

PrivateSector

States/TribesRPO’s/Interstate

Academia

NARSTO

NAS, CAAACCASAC, OMB

Enviros

Organizations

CDC

Supersites

IMPROVE, NCorePM monit, PAMS

CASTNET

Lidarsystems

NADP Satellite data

Intensive studies

PM centers

Other networks:SEARCH, IADN..

Data sources

CMAQGEOS-CHEM

EmissionsMeteorology

Health/mort.records

The Scheffe Challenge: Organizations - Programs – Data: A Mess

Info System Challenges:

What’s the overall dependency

Information Flow

Forces and Controls on Data Flow

Cooperation, Competition, Co-Opetition

Relationship Between

Organizations - Programs – DataVersion 0.1

Goals $$Info needs, $$

Data need, $$

Judge, Decide, ActAnalyze, Report

Actionable Knowledge

Decision, Action

Public

Measure, Organize

Organized Data

Flow of InformationData systems organize the measurements and models and provide them to programs.

Programs analyze the data and provide actionable knowledge to organizations.

Organizations evaluate multiple information sources, make decisions and act.

Flow of ControlPublic and special interest groups set up organizations and provides them with funding

Organizations develop programs, define their scope, governance and funding

Programs satisfy their information needs by monitoring or by using other’s data

Data sources acquire the data for their parent programs and also expose them for reuse

GEOSS Research:

• System of Systems Science• Network Science• Informatics Science

Science and understanding is poor in each areaGEOSS requires convergence of these sciences Leave science and convergence to serendipity?

Concept (con’t)• Team works through possible decision process to determine

whether, if GEO provided the information, the system will work as required.

• Product will be entries in tables and a narrative of processes• A product would be a list of best practices, one or more

of which will be entered into the GEO Best Practice Wiki (wiki.ieee-earth.org) .

GEO Best Practice Wiki (wiki.ieee-earth.org)

To be modified by the group at the workshop?

Practice Example

Structure by

Template

The Information Interoperability Stack

Web 2.0

EE Analysis Community Workspace

Community Data Sharing - ‘DataSpaces’

Catalog - Find Dataset

Describe Dataset

Discuss Dataset

Earth Science Information Partners (ESIP)

• Semantic Wiki: Structured (RDF and Unstructured Content

• Open, Standard Matadata - RDF

• Ready for Export/Harvesting by Registries, Catalogs

Communal Event Analysis Southern California Fire Smoke

Approach (Blogs, Flickr, YOuTube):

Use app to perform coarse filtering Controlled tagging in del.icio.usRSS feed from del.icio.us

Community Workspaces

• The Web is being transformed: It is becoming more participatory

– See the explosive growth of wikies, picture-sharing, blogs, Facebook – This architectural, technological and cultural change is Web 2.0

• Web 2.O is good for Earth Science community since it allows

– Better harvesting of current knowledge– However, many cultural, legal and other berries remain

• Workspaces may connect info providers, analysts, decision makers

• The challenge is to learn how to apply these tools GEOSS

Concept (LeDrew)

Architecture Data Committee/User Engagement Committee

Interaction in the GEOSS

Architecture Implementation – User Engagement Pilot

AIP Process improvement ideas

Comments on AIP Process Process Improvement

Functionality defined by developers not users

UIC/ADC collab., Workshops;

Operational SBA functionality

AIP Process is closed Make development iterative; Anyone can join at anytime

Process focused on demonstrations

More operational persistence; Deliver AR-07-01 Operations

Too structured: milestones, deliverables

Retain structure within phase; More iterative, open approach

Adopted from Percivall, Feb 2008 by R. Husar

Contact with UIC; Toronto, Workshop;

Open Invitations, ESIP, CoP wiki

Expand AQ Data Netw; Seek link to AR-07-01

One phase at a time; Feedback, feedback

Air Quality CoP Approach

Core GEOSS Architecture

GEOSSComponent,

Service registry

Standards,Special

ArrangementsRegistries

references

GEO Web Portal and other Clients

searches

Offerors

contribute to register

GEOSSClearinghouse

Catalogues

Services

User

accesses

list ofcatalogues

accesses

searches invokes

reference

From Percivall, Feb 2008

GEOSS Architecture for the Air Quality Community (March 2008)

GEOSS Comp.Registry

CommunityAQ Portal

extracts

ServiceOfferor

registers

GEOSSClearinghouse

Catalog list Searches, harvests

bind,invoke

references

publishprovides

Standards;SIF Registry

Adopted from Percivall, Feb 2008 by R. Husar, March 2008

CommunityAQ Catalog

CatalogUser

Services

find, select

links to

GEOSS Community Service Offerors, Users

GEOSS Architecture for the Air Quality Community (March 2008)

GEOSS Comp.Registry

CommunityAQ Portal

extracts

ServiceOfferor

registers

GEOSSClearinghouse

Catalog list Searches, harvests

invokes

referencespublishes

provides

Standards;SIF Registry

Adopted from Percivall, Feb 2008 by R. Husar, March 2008

CommunityAQ Catalog

CatalogUser

Service Workflow

composes DataAnalyst

visualizes

Reportsto

DecisionMaker

PolicyAnalyst

Informs

Services

find

GEOSS Community Service Offerors, Users

GEOSS Architecture for the Air Quality Community (March 2008)

GEOSS Comp.Registry

CommunityAQ Portal(s)

extracts

ServiceOfferor

registers

GEOSSClearinghouse

Catalog list Searches, harvests

invokes

referencespublishes

provides

Standards;SIF Registry

Adopted from Percivall, Feb 2008 by R. Husar, March 2008

CommunityAQ Catalog(s)

CatalogUser

Service Workflow

composes DataAnalyst

visualizes

Reportsto

DecisionMaker

PolicyAnalyst

Informs

Services

find

CommunityOf Practice

GEOSS CommunityService Offerors, Users, Community of Practice

links to

Public Public InformationInformation

Health/Exp. Assessment

Emissions Planning

AQ Trends and Accountability

Science Support

NAAQS

National Air Quality Information Integration

AQ Data Pool

Re-examination of Data Access and processing Systems

Questions on Global Viewpoint

Product Value (Chain)

Global

Regional

National

Theme

Adopted from FedEO

Local

Right Level of Networking?

Collaboration, Are We Ready?

Given

?