ellsworth ledrew (uic) gary foley (uic) jay pearlman (uic and adc) hans-peter plag (uic and adc)...

of 31 /31
Ellsworth LeDrew (UIC) Gary Foley (UIC) Jay Pearlman (UIC and ADC) Hans-Peter Plag (UIC and ADC) Rudolf Husar (UIC and ADC) David McCabe (ADC)

Author: loraine-rich

Post on 18-Jan-2016

236 views

Category:

Documents


0 download

Embed Size (px)

TRANSCRIPT

  • Ellsworth LeDrew (UIC)Gary Foley (UIC)Jay Pearlman (UIC and ADC)Hans-Peter Plag (UIC and ADC)Rudolf Husar (UIC and ADC)David McCabe (ADC)

  • Concept (LeDrew)Past AQ at User and the GEOSS Architecture Workshop Series:ESIP_Jan06: First public web service chaining demo IGARSS06 Denver: Demo of web service chaining; GMU, JPL, WashUIGARSS07 Barcelona: Sahara Dust; WashU with 12 NAM & EU data partnersOutcome: Successful Tech Demos but SoS constructs fragile & uncontained

  • Application of OGC WCS Data Access ProtocolRegardless of the data location, data type and format, the parameter-space-time query is the same the return is in user selectable format from the offerings

    Coverage=THEEDDS.T& BBOX=-126,24,-65,52,0,0 &TIME=2002-07-07/2002-07-07&FORMAT=NetCDFCoverage=SEAW.Refl& BBOX=-126,24,-65,52,0,0 &TIME=2002-07-07/2002-07-07&FORMAT=GeoTIFFCoverage=SURF.Bext& BBOX=-126,24,-65,52,0,0 &TIME=2002-07-07/2002-07-07&FORMAT=NetCDF-tableGridImageStation DataParameterBounding BoxTime RangeOut Format

  • Current SOA Air Quality Applications: Analysis Consoles

  • Emerging Air Quality Data Flow NetworkOGC WCS Data Access ProtocolGEOSS Provides SOA for Coupling for Autonomous Nodes Facilitates Publishing, Finding and Accessing Data

  • Concept (cont)Each role identifies what data is required at that levelDetermines how data should be packaged by GEODetermines what is the customer base, what is the chain of informationIncludes data type, format, unit conversion, time resolution, quality control process, required fields, optional fields (Hans-Peter Plag: GEOSS User Needs and Performance Utility: Functional Spec and Database Structure)Value-Adding ProcessesSBA Info Flow

  • Stages of AQ Data Flow and Value-Adding Processes Domain ProcessingData SharingStd. InterfaceGen. ProcessingStd. InterfaceDataControlReportsReportingObs. & ModelsDecision Support SystemAnalyzingFilter/Integrate Aggregate/Fuse Custom AnalysisOrganizingDocument Structure/Format InterfacingCharacterizingDisplay/Browse Compare/Fuse CharacterizeValue-Adding ProcessesReportingInclusiveness Iterative/Agile Dynamic ReportDataControlRequesting InformationProviding InformationSensorsAcquisition processingUser ProgramsNAAQS SIPs Forecast GEOSS Info System Negotiating Space

  • Generic Decision Support for Air Quality DecisionsGlobal Earth Observing System of Systems GEOSSArchitecture FrameworkKnowledge into the Minds of Regulatory AnalystsKnowledge into the Minds of Technical Analysts ObservationsReports: Model Forecasts, Obs. EvidenceModelsDecisionsKnowledge into the Minds of Decision- making managersDecision Support System

  • GEOSS FrameworkPolicy Dec.ManagementPersonal DecPolicy Dec.ManagementPersonal DecPolicy Dec.ManagementPersonal Dec

  • GEOSS FrameworkUserApplicationErquirements

  • System of SystemsGlobal Earth Observing System of Systems - GEOSSCharacteristics of System of Systems (SoS)

    Autonomous constituents managed/operated independentlyIndependent evolution of each constituentSoS displays emergent behaviorMust recognize, manage, exploit the characteristics:

    No stakeholder has complete SoS insightCentral control is limited; distributed control is essentialUsers, must be involved throughout the life of a SoS

  • System of Systems Issues:

    From User Engagement to Stakeholder Engagement? From: Air Fore SoS Document

  • The Scheffe Challenge: Organizations - Programs Data: A MessInfo System Challenges:

    Whats the overall dependencyInformation FlowForces and Controls on Data FlowCooperation, Competition, Co-Opetition

  • Relationship BetweenOrganizations - Programs DataVersion 0.1Goals $$Info needs, $$Data need, $$Judge, Decide, ActAnalyze, ReportActionable KnowledgeDecision, ActionPublic Measure, OrganizeOrganized DataFlow of InformationData systems organize the measurements and models and provide them to programs. Programs analyze the data and provide actionable knowledge to organizations.Organizations evaluate multiple information sources, make decisions and act. Flow of ControlPublic and special interest groups set up organizations and provides them with funding Organizations develop programs, define their scope, governance and fundingPrograms satisfy their information needs by monitoring or by using others dataData sources acquire the data for their parent programs and also expose them for reuse

  • GEOSS Research:System of Systems ScienceNetwork ScienceInformatics Science

    Science and understanding is poor in each areaGEOSS requires convergence of these sciences Leave science and convergence to serendipity?

  • Concept (cont)Team works through possible decision process to determine whether, if GEO provided the information, the system will work as required.Product will be entries in tables and a narrative of processesA product would be a list of best practices, one or more of which will be entered into the GEO Best Practice Wiki (wiki.ieee-earth.org) .

  • GEO Best Practice Wiki (wiki.ieee-earth.org)To be modified by the group at the workshop?Practice ExampleStructure byTemplate

  • The Information Interoperability StackWeb 2.0

  • EE Analysis Community Workspace

  • Community Data Sharing - DataSpacesCatalog - Find DatasetDescribe DatasetDiscuss DatasetEarth Science Information Partners (ESIP) Semantic Wiki: Structured (RDF and Unstructured Content Open, Standard Matadata - RDF Ready for Export/Harvesting by Registries, Catalogs

  • Communal Event Analysis Southern California Fire SmokeApproach (Blogs, Flickr, YOuTube):

    Use app to perform coarse filtering Controlled tagging in del.icio.usRSS feed from del.icio.us

  • Community WorkspacesThe Web is being transformed: It is becoming more participatory

    See the explosive growth of wikies, picture-sharing, blogs, Facebook This architectural, technological and cultural change is Web 2.0

    Web 2.O is good for Earth Science community since it allows

    Better harvesting of current knowledgeHowever, many cultural, legal and other berries remain

    Workspaces may connect info providers, analysts, decision makers

    The challenge is to learn how to apply these tools GEOSS

  • Concept (LeDrew)Architecture Data Committee/User Engagement CommitteeInteraction in the GEOSSArchitecture Implementation User Engagement Pilot

  • AIP Process improvement ideasComments on AIP ProcessProcess ImprovementFunctionality defined by developers not usersUIC/ADC collab., Workshops; Operational SBA functionality AIP Process is closedMake development iterative; Anyone can join at anytimeProcess focused on demonstrationsMore operational persistence; Deliver AR-07-01 OperationsToo structured: milestones, deliverablesRetain structure within phase; More iterative, open approachAdopted from Percivall, Feb 2008 by R. HusarContact with UIC; Toronto, Workshop;Open Invitations, ESIP, CoP wikiExpand AQ Data Netw; Seek link to AR-07-01One phase at a time; Feedback, feedbackAir Quality CoP Approach

  • Core GEOSS ArchitectureGEOSSComponent, Service registryStandards,Special ArrangementsRegistriesreferencesGEO Web Portal and other ClientssearchesOfferorscontribute to registerGEOSSClearinghouseUser accesseslist ofcataloguesaccessessearchesinvokesreferenceFrom Percivall, Feb 2008

  • GEOSS Architecture for the Air Quality Community (March 2008)GEOSS Comp.RegistryCommunityAQ PortalextractsServiceOfferorregistersGEOSSClearinghouseCatalog listSearches, harvestsbind,invokereferencespublishprovidesStandards;SIF RegistryAdopted from Percivall, Feb 2008 by R. Husar, March 2008CommunityAQ CatalogCatalogUserfind, selectlinks toGEOSSCommunityService Offerors, Users

  • GEOSS Architecture for the Air Quality Community (March 2008)GEOSS Comp.RegistryCommunityAQ PortalextractsServiceOfferorregistersGEOSSClearinghouseCatalog listSearches, harvestsinvokesreferencespublishesprovidesStandards;SIF RegistryAdopted from Percivall, Feb 2008 by R. Husar, March 2008CommunityAQ CatalogCatalogUserService WorkflowcomposesDataAnalystvisualizesReportstoDecisionMakerPolicyAnalystInformsfindGEOSSCommunityService Offerors, Users

  • GEOSS Architecture for the Air Quality Community (March 2008)GEOSS Comp.RegistryCommunityAQ Portal(s)extractsServiceOfferorregistersGEOSSClearinghouseCatalog listSearches, harvestsinvokesreferencespublishesprovidesStandards;SIF RegistryAdopted from Percivall, Feb 2008 by R. Husar, March 2008CommunityAQ Catalog(s)CatalogUserService WorkflowcomposesDataAnalystvisualizesReportstoDecisionMakerPolicyAnalystInformsfindGEOSSCommunityService Offerors, Users, Community of Practicelinks to

  • Questions on Global ViewpointRight Level of Networking?

  • Collaboration, Are We Ready?Given?

    HTAP network is open for participation by any HTAP server and since HTAP is an open participatory process, anyone is invited. The initial HTAP data network has four nodes connected: The Juelich server maintains and provides the results of the HTAP ozone model runs (Martin Schultz) The NASA Giovanni server is a gateway to satellite data, such as the OMI, MODIS, PICASSO datasets (Greg Leptoukh)The NEISGEI server delivers an array of emission data and a set of processing services (Stefan Falke)DataFed serves air quality data and manages the execution of data access and processing chains (Rudy Husar).

    The data communication in the network is through international standard interfaces. This allows the collective building of shared tools from reusable data processing components in accordance with the concept of GEOSS.

    HTAP network is open for participation by any HTAP server and since HTAP is an open participatory process, anyone is invited. The initial HTAP data network has four nodes connected: The Juelich server maintains and provides the results of the HTAP ozone model runs (Martin Schultz) The NASA Giovanni server is a gateway to satellite data, such as the OMI, MODIS, PICASSO datasets (Greg Leptoukh)The NEISGEI server delivers an array of emission data and a set of processing services (Stefan Falke)DataFed serves air quality data and manages the execution of data access and processing chains (Rudy Husar).

    The data communication in the network is through international standard interfaces. This allows the collective building of shared tools from reusable data processing components in accordance with the concept of GEOSS.

    There are value-adding processes in each step of the information flow system.

    Observational and model data are first organized and exposed to standard interfaces.

    The next step is the general characterization of the pollutant by displaying, comparing and fusing different datasets

    Subsequent custom analysis provides specific information needed for the particular decision process.

    Reporting summarizes the analyses for the decision makers.

    Beyond qualitative information, air quality managers need more quantitative data and analyses to justify their decisions and actions. Such support is provided by the decision support system.

    A typical air quality decision support system consists of several active participants: The models and the observations are interpreted by experienced Technical Analysts who summarize their findings in 'just in time reports. Often these reports are also evaluated and augmented by Regulatory Analysts who then inform the decision-making managers. With actionable knowledge in hand, decision makers act in response to the pollution situation.

    While the arrows indicate unidirectional flow of information, each interaction generally involves considerable iteration. For example, analysts explore and choose from numerous candidate datasets. Also most reports are finalized after considerable feedback.

    Note that the key users of formal information systems are the technical analysts. Hence, the system needs to be tailored primarily to the analysts needs.

    Beyond qualitative information, air quality managers need more quantitative data and analyses to justify their decisions and actions. Such support is provided by the decision support system.

    A typical air quality decision support system consists of several active participants: The models and the observations are interpreted by experienced Technical Analysts who summarize their findings in 'just in time reports. Often these reports are also evaluated and augmented by Regulatory Analysts who then inform the decision-making managers. With actionable knowledge in hand, decision makers act in response to the pollution situation.

    While the arrows indicate unidirectional flow of information, each interaction generally involves considerable iteration. For example, analysts explore and choose from numerous candidate datasets. Also most reports are finalized after considerable feedback.

    Note that the key users of formal information systems are the technical analysts. Hence, the system needs to be tailored primarily to the analysts needs.

    Beyond qualitative information, air quality managers need more quantitative data and analyses to justify their decisions and actions. Such support is provided by the decision support system.

    A typical air quality decision support system consists of several active participants: The models and the observations are interpreted by experienced Technical Analysts who summarize their findings in 'just in time reports. Often these reports are also evaluated and augmented by Regulatory Analysts who then inform the decision-making managers. With actionable knowledge in hand, decision makers act in response to the pollution situation.

    While the arrows indicate unidirectional flow of information, each interaction generally involves considerable iteration. For example, analysts explore and choose from numerous candidate datasets. Also most reports are finalized after considerable feedback.

    Note that the key users of formal information systems are the technical analysts. Hence, the system needs to be tailored primarily to the analysts needs.

    This explains the relationship of registries and Clearinghouse. From George Percivalls slides, Feb. 2008GEOSS Architecture for Air Quality data system. Value-adding chain in Decision-Support System. GEOSS Architecture for Air Quality data system. Value-adding chain in Decision-Support System. GEOSS Architecture for Air Quality data system. Value-adding chain in Decision-Support System.