m. messerotti codata, 24 october 2006, beijing virtual observatories and virtual grids: the...

Download M. Messerotti CODATA, 24 October 2006, Beijing Virtual Observatories and Virtual Grids: The Interplay in Fully Exploiting Solar-Terrestrial Data Mauro

Post on 02-Jan-2016

219 views

Category:

Documents

4 download

Embed Size (px)

TRANSCRIPT

  • Virtual Observatories and Virtual Grids: The Interplay in Fully ExploitingSolar-Terrestrial DataMauro MesserottiINAF-Astronomical Observatory of TriesteandDepartment of Physics, University of Trieste

  • Outline of the TalkHistorical evolution in S-T-Phys. data handling

    Requirements for S-T Physics & Space Weather

    The role of VOs & VGrids

    Knowledge Embedding via Cmaps

    Visions about an ideal VO

    Conclusions

  • HISTORICAL EVOLUTION INS-T PHYSICS DATA HANDLINGREQUIREMENTS FORS-T PHYSICS ANDSPACE WEATHER

  • Solar and Geophysical Databases

    Solar and Geophysical Databases: The Tilesof a Planetary Meta-ArchiveM. Messerotti

    Trieste Astronomical Observatory

  • Data Organization

    Matter of FactHuge amount of space and g-b data

    Data OrganizationDatabases, Archives, Meta-Archives

    Data IndexingTables, Catalogs managed by RDBMS

    Data AccessFTP, TELNET, WWW via GUI

    Data SearchLocal, Distributed over the net

    Data AnalysisLocal

  • Scientific Requirements

    Physical modellingMULTIWAVELENGTH DATA SEARCHMULTIWAVELENGTH DATA DISPLAYMULTIWAVELENGTH DATA ANALYSIS via a common unified, user-friendly interface

    Space WeatherSOLAR, SPACE, EARTH DATASETSMULTI-EVENT MODELLINGLARGEST COVERAGE POSSIBLE

    Event PredictionCROSS-SEARCH OVER ARCHIVESSTATISTICAL ANALYSESREAL-TIME DATA AVAILABILITY

  • Scientific Motivations

    Some major Solar-Terrestrial Data Portals exist

    Mainly Resource Indexing is available

    Few resources partially allow complex, distributed data searching over limited subsets of databases

    Very few resources partially allow data analysis on inhomogeneous datasets

    A PLANETARY META-ARCHIVE IS NEEDED TO EXPLOIT THEFULL SCIENTIFIC POTENTIALITIES OF MULTIWAVELENGTHMODELLING IN SOLAR-TERRESTRIAL PHYSICS

  • Solar-Terrestrial Physics PortalsCDS AstroWebhttp://cdsweb.u-strasbg.fr/astroweb.htmlNASA Space Physics Data System (SPDS)http://spds.nasa.gov/NASA Space Physics Data Facility (SPDF)http://nssdc.gsfc.nasa.gov/spdf/Magnetospheric Yellow Pageshttp://nssdc.gsfc.nasa.gov/spdf/yellow-pages/data-by-type.htmlNASA National Space Science Data Center (NSSDC)http://nssdc.gsfc.nasa.gov/Canadian Astronomy Data Centerhttp://cadcwww.dao.nrc.ca/

  • CDS AstroWeb - Astronomy on the Internethttp://cdsweb.u-strasbg.fr/astroweb/solar.html (A)Big Bear Solar Observatory (BBSO)Boulder, Colorado Dept. Astrophys. and Planet. SciencesBirmingham Solar Oscillations Network (BiSON)Catania Astrophysical Observatory (OAC)Centre de Prevision de l'activite solaire et geomagnetiqueCluster II, ESA's spacefleet to the magnetosphereCracow - Solar radio emission in dm wavelengthDepartement d'Astronomie Solaire (DASOP, Observatoire de Paris)ETH Institute of Astronomy (ETH Zurich)Estacin de Observacin Solar / Solar Observational Station (EOS)European Incoherent SCATtterGALLEXARTHEMISBAse Solaire Sol 2000 (BASS2000)Global Oscillation Network Group (GONG)Haleakala Observatories (Hawaii)High Altitude Observatory (HAO)High Energy Solar Spectroscopic Imager (HESSI)Hiraiso Solar Terrestrial Research Center/CRLIPS Radio & Space ServicesImager for Magnetopause-to-Aurora Global ExplorationInstitut d'Astrophysique Spatiale (IAS)Instituto de Astronomia y Fisica del Espacio (IAFE)International Solar-Terrestrial Physics (ISTP)Joint Organization for Solar Observations (JOSO)Kharkov multi-wave station of solar monitoring (KHASSM)Kiepenheuer-Institut fr Sonnenphysik (KIS)Laboratory for Atmospheric and Space Physics (LASP)LASCO/SOHOMEDOC (Multi-Experiment Data Operations Center for SOHO)MSU Solar Physics Group (Montana)Mees Solar Observatory (MSO, Hawaii)Metsahovi Radio Research StationMount Wilson ObservatoryNRL Solar Physics BranchNational Astron. Obs. of Japan - Solar Phys. DivisionGDCGDCGSOGSNSRISOOSECSROSSESRISRISOOGINGPEGSNSOOSOOSSESECSECESESPISPISTNISOSRISROSRISSESDCSRISOOSROSOOSRISRI

  • CDS AstroWeb - Astronomy on the Internethttp://cdsweb.u-strasbg.fr/astroweb/solar.html (B)Naval Research Laboratory Space Science Division (NRL SSD)Service d'AeronomieObservatoire Midi-Pyrenees (OMP)Soft X-Ray Telescope onboard Yohkoh Satellite, ISAS, JapanSolar Data Analysis Center (SDAC)Solar Extreme-ultraviolet Rocket Telescope and SpectrographSolar Flare Theory (NASA/Goddard Space Flight Center)Solar Group of RATAN-600Solar Physics Division - American Astronomical SocietySolar Physics at Stanford UniversitySolar Terrestrial Activity ReportSolar Terrestrial Dispatch (STD)National Solar Observatory (NSO)NSO Sacramento Peak, Sunspot, NM (NSO/SP)Solar UV Atlas from HRTS (HRTS data)Solar and Heliospheric Observatory (SOHO)Solar, Auroral, Ionospheric, ... Information (Lethbridge, Canada)Solar-Terrestrial Physics Home Page (STP)Space Environment CenterStanford SOLAR CenterSternberg Astronomical Institute (Heliophys. and Seismology)THEMISThe INTER-SOL Sun Observation Programme (ISP)Transition Region And Coronal Explorer (TRACE)Universitat de les Illes Balears - Solar Phys. at Dept. of Phys.Wilcox Solar Observatory (WSO)Yohkoh Public Outreach Project (YPOP)Zurich Solar Radio Spectrometer64 EntriesSOOSOOSPISOOEDCSSESECSRISSESRONSOSRISECSECSDCSSESECSECSECSECSRISOIGSNSSESRISSESOOSRO

  • Goals Index observational resources in ST Physics

    Index theoretical resources in ST Physics

    Allow

    User-transparent data access to distributed datasets all over the world

    Complex data searching, retrieval and analysis via a simplified common GUI

    PRESENT DATA ARCHIVING TECHNOLOGIES ALLOW THEACHIEVEMENT OF SUCH GOALS PROVIDED THAT A GLOBALCOORDINATION AND COLLABORATION IS ESTABLISHEDAS WELL AS THE ALLOCATION OF PROPER FINANCIALRESOURCES BY THE PARTICIPATING ORGANIZATIONS

  • An Advanced System for Data Handling in SPW Title of contribution STEVM (Solar-Terrestrial Environment Virtual Monitor)

    Proposer M. Messerotti (& al.)

    Relevant MoU objectives Data standardization and accessibility

    Relevant parts of MoU sci. programme Aims of WG4

    Deliverables Resources survey & architecture (& ?)

    Timetable 3-5 years according to final goals

    Required Manpower To be defined according to final goals

    Resources availability Existing Data Archives community

    Expected collaborations With main VO projects (e.g. EGSO)

    Previous experience in the field SOLAR, SOLRA, SOLARNET, EGSO

  • Space Weather as Driver of Data Homogeneization

    Inhomogeneous and fragmented character of available observationsCAUSESDifficulties in carrying out a posteriori modelling of complex phenomena

    These limitations are intrinsic to data acquisition modeHENCEEven advanced data search by Grid architectures cannot overcome

  • DRAWBACKS OF DATA INADEQUACYThe outcomes are:

    Inadequate modelling

    Limited to a subset of phenomenological and physical aspects

    Often neglects the complex interplays among different processes

  • Scheme of SpW Data RequirementsSPACEWEATHEREffectsPrecursorsDriversNRTOBSERVATIONNRTPUBLICATIONNRTINGESTIONNRTModellingPredictionPost-EventModellingInterpretationCompletenessHomogeneityNRTAvailabilityImprovedInterpretationImprovedModellingImprovedPredictionStandardizationTimeSpaceWavelengthSpW DataRequirements

  • The Role of Observing Requirements for SpWObserving requirements for SpW and SpW drivers observation in monitoring and nowcasting can play a primary role in providing:

    homogeneization in observationsnear real-time data ingestion in archivesunified data access via web through a user friendly GUI

    capable to facilitate:

    data availability in near real-timefull exploitation of the data information content by pointing out interrelationships in different datasetsself-consistent modelling

  • THE ROLE OF VOs AND V-GRIDS

  • http://solarnet.to.astro.it:8080/portal/

  • DATA GRID ArchitectureSOLARNETSOLARDISCOSOLRASOLARNET is a Data GRIDwhich links multiple data collectionsby managing data entitiesacross distributed repositories

  • http://www.egso.org/

  • VIRTUAL DATA GRID ArchitectureA consistent modelling requires a multi-instrument multi-wavelength approachDATA ANALYSIS must be provided in addition to SEARCH and RETRIEVALVirtualData GRIDData CollectionDerivedData ProductsData Collection management+GRID protocols to process dataEGSO European Grid of Solar Observations

  • INTELLIGENT VIRTUAL DATA GRID ArchitectureDATA ASSOCIATION AND GUIDED PROCEDURES are EMBEDDEDIntelligentVirtualData GRIDData CollectionDerivedData ProductsData Collection management+GRID protocols to process data+EMBEDDED KNOWLEDGEKNOWLEDGE DISCOVERY IN DATABASES (KDD)

  • ADVANCED GOALPointing out the physical associations in multi-wavelength datasets is the basis of interpretative scientific research

    Concept association is the kernel of knowledge

    Automated storage and search of knowledge in databases is possible through advanced techniques and is called

    Knowledge Discovery in Databases (KDD)

    Advanced techniques are based on Artificial Intelligence (AI) and Expert Systems (ES) embedding

    THE EMBEDDING OF AI-ES TECHNIQUES IN THE GRIDARCHITECTURE REPRESENTS THE NEXT GENERATIONIN DATA SEARCH, RETRIEVAL, PROCESSING AND ANALYZING

  • KNOWLEDGE EMBEDDINGVIA CONCEPT MAPS

  • A Foundation OntologyforSpace MeteorologyFor a Structured Organizationof the Knowledge on the Subject

  • A Semantic Model for KnowledgeKNOWLEDGEConceptsandRelationshipsPropositionsCONCEPTPattern ofRegularitiesin ObjectsDescriptiveKnowledgeElementRELATIONSHIPLogicalActionLink InferencingKnowledgeElement