overview of amrc goals of amrc and efforts to improve efficiency of data distribution new amrc...

28
AMRC Meteorological Data Distribution System Part II: Data Services Antarctic Meteorological Research Center (AMRC), Space Science and Engineering Center (SSEC), University of Wisconsin-Madison, Madison, WI Zach Uttech, Matthew Lazzara, K. Elena Willmot and Linda M Keller

Post on 19-Dec-2015

219 views

Category:

Documents


0 download

TRANSCRIPT

  • Slide 1
  • Slide 2
  • Overview of AMRC Goals of AMRC and efforts to improve efficiency of data distribution New AMRC Website Improved organization User friendly Current Data Services Future Data Services Summary
  • Slide 3
  • AMRC aims to provide real-time and archived data and observations to the public Multiple data sources Observational data NWP data Old methods of data distribution FTP (File Transfer Protocol) site Old website A new method of data distribution Developing a new website portal Improved organization Increased efficiency And more
  • Slide 4
  • Commonly used information AWS Network tab Data & Imagery tab Recent news posted
  • Slide 5
  • Dynamic (click-able) AWS Map AMRC project distributes data for ~63 AWS stations Serves as an accessible central location for archived AWS data Sidebar Contains supporting AWS information
  • Slide 6
  • Dynamic (click-able) AWS Map How to select an individual AWS Beneficial feature Simultaneous access to data of selected AWS and the dynamic map Zooming and panning capabilities
  • Slide 7
  • AWS Ferrell Station Selection Example General layout Metdata data loads next to picture Additional data will be organized into tables Compress region and station lists into pull- down tabs
  • Slide 8
  • Sidebar What makes up an AWS? AWS diagram AWS Maps Data Books/Field Reports
  • Slide 9
  • AMRCs Archived Data (FTP site and more)
  • Slide 10
  • Satellite Imagery and Composite Thumbnail Constructed from geostationary and polar orbiting satellites Examples IR, WV, pseudo color, hourly animations Data & Imagery Tab IR WV
  • Slide 11
  • Data & Imagery Tab Models and Forecasts Thumbnail Computer model data (ECMWF and GFS) overlayed with IR and WV composites (new!) Mid-level data heights, RH, and VV Surface data isobars, isotherms, streamlines 500mb Heights MSLP
  • Slide 12
  • Data Fusion Thumbnail Composite Animations Satellite derived motion vectors Ice concentrations Control speed, zoom, and refresh image Additional composites SST with IR Aqua and Terra motion vectors Satellite Derived Motion Vectors Ice Concentrations
  • Slide 13
  • Antarctic Surface Observations Current and archived data Upper-Air Observations Recent and archived Radiosonde data, Skew-t diagrams, and hodographs Aircraft Observations Current meteorological aircraft reports Satellite Navigations American and international polar orbiting satellite tracks USAP Stations Historical surface observation database South Pole, McMurdo, and Palmer AMRCs Archived Data Ftp site and more
  • Slide 14
  • Current Data Services 5 Data Services FTP server Stores archival data with minimal real-time datasets Wont be eliminated Rsync Service Updates requested data automatically; saves user timer Antarctic-IDD (Internet Data Distribution) Local Data Manager Data sharing network based on Unidatas LDM software Focus on real-time data Abstract Data Distribution Environment (ADDE) Contains both real-time and archived data E-mail distribution Everything we have can be distributed via email Goal provide self-serviceable data to reduce the effort to fill data requests!
  • Slide 15
  • Slide 16
  • AMRC.SSEC.WISC.EDUAWS.SSEC.WISC.EDU ADDE Group AWS All Real-time datasets Examples Hourly composites AWS Model output Satellite winds More ADDE Group ARCHIVE All ADDE ready archive data ADDE Group AMRC All Real-time datasets Examples Three hourly composites AWS Model output More Becoming obsolete ADDE Group ARCHIVE Will be discontinued
  • Slide 17
  • Future Data Services RAMADDA (Repository for Archiving, Managing and Accessing Diverse Data) Hierarchical collection of folders and entries (accessed by public via URL) Primary advantages Store any data type Make data easily accessible to users Built by NSF funded Unidata Program
  • Slide 18
  • Future Data Services RAMADDA (Repository for Archiving, Managing and Accessing Diverse Data) Testing capabilities as an experimental effort Easy to load and manage new/old data entries Long-term goal Most of AMRCs archived data ingested into RAMADDA
  • Slide 19
  • Future Data Services RAMADDA Layout Add descriptions about a data entry and the time range it covers Data type examples xls file Mt Flem and Capte H r file Pegasus txt file FTP McIDAS Area File URLs View Tab Allows for instant visualization of data Animations and McIDAS area files Graph View
  • Slide 20
  • GIS (Geographic Information Systems) software and extensions used for AMRC products ArcGIS PostGIS PostgreSQL ZigGIS QuantumGIS Future Data Services
  • Slide 21
  • Definitions for GIS Software and Extensions GIS computer system capable of capturing, storing, analyzing, and displaying georeferenced information ArcGIS suite of GIS software products produced by the Environmental Systems Research Inst (ESRI) QuantumGIS (QGIS) and ArcGIS interact with PostGIS-enabled databases for data management, visualization, and cartographic mapping ZigGIS provides access specifically to PostGIS databases (extension) ArcGIS ZigGIS PostGIS
  • Slide 22
  • Definitions for GIS Software and Extensions PostgreSQL powerful, open-source, relational database system Accessed by users indirectly through an external application rather than by application programming stored within the database (back-end database) PostGIS spatially enables the PostgreSQL server Open source add-on, gives PostgreSQL the ability to store and manipulate spatial data used in GIS and Mapping
  • Slide 23
  • Applications of the GIS software We use PostgreSQL, PostGIS, and ZigGIS to Add tables which contain data that is not spatially referenced Create a database that updates the AWS network map in real- time
  • Slide 24
  • Applications of the GIS software We use ArcGIS and qGIS in day to day work Beginning to manage information about the ~120 (AMRC + International) active Antarctic AWS using PostGIS Using the zigGIS (extension to ArcGIS) to Generate maps of AWS directly from the database Map any station-related (non-spatial) data through relation joins in the database
  • Slide 25
  • Applications of the GIS software Server applications such as Geoserver and Mapserver can generate web mapping/feature services from the same PostGIS-enabled database Allows us to Build near real-time web mapping interfaces that access the most current data automatically (from the PostGIS database) Develop a PHP 5/Apache web interface to allow group editing/management of data about the AWS network (in the PostGIS database)
  • Slide 26
  • Current data services Antarctic-IDD Continue to expand the number of participants in the network ADDE AMRC group has more capabilities than AWS server AWS group becoming obsolete Future data services New AMRC website Dynamic AWS map Satellite composite and meteorological variable (NWP) overlays (new) Improved organization over old website GIS software/extensions Update AWS network in real-time Allow for group editing
  • Slide 27
  • Thanks to the Office of Polar Programs at the National Science Foundation grant No ANT-0838834 for its support of the AMRC project The authors also wish to thank SSEC and AMRC members for their contributions to the new AMRC website
  • Slide 28
  • Lazzara, MA, G Langbauer, KW Manning, R Redinger, MW Seefeldt, R Vehorn, and T Yoksas, 2006 Antarctic Internet Data Distribution (Antarctic-IDD) System 22 nd International Conference on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology Atlanta, GA American Meteorological Society Seefeldt, MW, T Yoksas, and MA Lazzara, 2009a Real-time and archived Antarctic meteorological data via a synergy of interactive processing tools Antarctic Meteorological Observing Modeling and Forecasting Workshop 14-15 July 2009 Charleston, SC Seefeldt, MW, T Yoksas, and MA Lazzara, 2009b The distribution, retrieval, and visualization of real-time Antarctic numerical weather prediction, satellite and observational data 10 th Conference on Polar Meteorology and Oceanography, May 18-21, 2009 Madison, WI Yoksas, T, J Caron, J McWhirter, M Richards, M Seefeldt, KW Manning, JG Powers, D Steinhoff, and MA Lazzara, 2009 Using Unidatas RAMADDA and THREDDS Services to Support Two Disparate Projects AGU 2009 Joint Assembly The Meeting of the Americas, May 24-27, 2009, Toronto, ON, Canada www.postgis.org www.postgresql.org www.qgis.org www.unidataucar.edu/software/ramadda