open data policy for digital economy innovation...new technologies accelerated the process 4...
TRANSCRIPT
Open Data Policy for Digital Economy Innovation
ZENG Qin, LIU Na, CHEN Donghui, Liu Yiming
National Meteorological Information Center, CMA
1
The Digital Economy incorporates all economic activity reliant on, orsignificantly enhanced by the use of digital inputs, including digital technologies,digital infrastructure, digital services and data. It refers to all producers andconsumers, including government, that are utilizing these digital inputs in theireconomic activities.
—— OECD, Organization for Economic Co-operation & Development
In our economic reforms, we must concentrate on improving the property rights
system and ensuring the market-based allocation of factors of production.
—— statement from Chinese Policy
Data is regarded as a new factor of production
2
Integrated into Smart Power Grid Integrated into harbor management
Met Data has been deeply integrated into digital economyWeather Enterprise Needs Participants of multi-stakeholders
People-to-People weather service is evolving into Machine-to-Machine Data Driven Process3
DigitalTransformation
SensorsObservations
SeamlessMet-Service
ImpactForecastSectors NMHS
2.2 billions package deliveredfrom minutes to 7 Days
High Quality Development of Economy and Society based on New Infrastructure- ChinaDigital Meteorological Infrastructure(Cloud Computing, Earth system data, AI, Algorithms, Network)
New Technologies Accelerated the Process
4
QC/Derived OBS
Raw OBS
Analysis & PredictionAI/Sci-experiment Dataset
Time Series
Service Product
NMHS alone cannot step into the Earth System Era
CMA’s Classification of Earth System Data
Government cannot afford the whole earth system data retrieval
5
All data has a MOIDMeteorological Object Identifier
WIGOS MetaData formats
CF-complianceWIS metadata
OIDIP metadata
Data Aggregation & OpenOne Unified Open Data Policy plus Diverse Business models
Freely Open Data PolicyInternet(Data Feed, API, FTP)
Online data-algorithmsCrowd-sourced Data Entry
Offline Dataset
CMA Online Data Service
(Big Data + Big Computing) for Small Data
Tools & Techniques for Local User Data
Better Services for Local User Data
Collaboration on Dataset Refinement
Public - Private - Academia – Trial + Buy
Exchange
More Data Goes into Open data inventory
Wholesale + Retail for Diverse Needs
Exchange
Exchange
Collaboration
Collaboration
Purchase
Devices Purchased for Wider Range Data Purchase
6
Free & Open (Inventory)
—— the Unified Data Policy: Inventory based Opening
数据分类体系调研
1999
Regulationfor Scientific Data
Management
Regulation forAggregation of Meteorological
Observation data
Regulation for meteorological
information service
National Action plan for promoting the
development of big data
MeteorologicalLaw
Data Security LawOf the People’s
Republic of China
IP protection, Security Concern Inventory based data opening
2015 2015 2017 2019 20201999
Open Data Policy (Domestic/International)
7
Domestic & cross-border circulation of data
AdditionalBasic ObservationBasic AnalysisBasic Forecast
Essential
HigherSpatial
Resolution
HigherTemporal
Resolution
RegionalAnalysis
&Forecast
WMO ResolutionRes40,Res25,Res60
National Policy
GTS/WIS
Customized for industries
Value-added
Impactbased
Products
Review
Update
Review
Update
Through Security/Privacy/IP Review Non-security-involvedNon-secret-involvedNon-security-involved
Meteorological Law guarantees the authoritative voice of weather alert
Review
Update
Free & Unrestricted Open & Licensed with MOID Labeled with MOID
8
Alert (GMAS)……
Higher DensityHigher FrequencyMore variety in OBSMore Detail in product
……
Domestic law & regulationsNon-Redissemination
Intellectual Property
Non-open Observation Commercial sensitivePrivacy sensitiveSecurity sensitive
……
Accelerating Data Circulation Legallyfor Economic and Societal Benefit
New Res 42
Met-data contributes 18% of the increase revenue of our users9
We serve 350,000 users globally, and 29 industries in China
CMA Online Data Cloud Service(free/unrestricted + licensed)
Meteorological17.7% Environment &
Safety13.7%
Aerospace13.4%
Agricultural12.2%
Hydrology11.5%
Transportation6.1%
Earth Science
4.0%
Communication5.5%
Education & Research
3.5%
Forestry3.0%
Medical2.7%
Financial Insurance
1.8%Bioscience
1.7% others0.1%
Distribution of met-data users from 29 industries
>10PB
<1PB
Met Data has been deeply integrated into digital economy
10
Crowdsourcing
Private sector
Sci-experiments
volunteers
Public sector
NMS
Provincial Met-services
Municipal Met-services
County Met-services
Data aggregation
By Met-LAW
Does not mean “free”
Business Models
Crowd sourcing Industries : tourism Weather company Scientific Experiment
Met-LAW Request Met-data Aggregation
Business Model 1Local data for better local service
Join a Big Observation Network, and Enjoy Customized Micro-services
City BrainTourism
Wind Energy
Power Grids
Highway-CompanyLamp Posts
11
Exchange
Business Model 2DCaaS (Big Data + Big Computing) Service for Small Data
User Algorithm1
User Algorithm2
X1
X2
X3
X498
a1
a2
a3
a1024
a1023
.
.
.
.
.
.
498 features(hgt,sst,vort)
1024 cells
Input Layer1
a1
a2
a512
.
.
.
512 cells
a1
a64
.
.
.
256 cells
a1
a2
a1023
.
.
.
64 cells
a2
Layer2 Layer3
Layer4
Output(Typhoon
Frequency)
(x)hθ
Layer5
User Algorithm3
Cloud Provider:Security Certificated, Trusted Cloud, Also as an aggregator
Private Sectors & Other Users
Private Datapermitted
Feed-back
Like Alibaba, Amazon, Microsoft , Google Cloud12
Computational Result
Exchange
Business Model 3Free Data tools & techniques for Local Data
User contributes data, NMS provides analysis tools for free access data
Multi-source data fusion Algorithm 3D Data visualization Toolkit Downscaling algorithm
Cloud based NMHS-Database
contribution Free access via tools
13
Exchange
Reward Points/Bonus
Severe Weather Training and Test Dataset: Open Data for (AI, ML/DL)
Business Model 4Collaboration on Dataset Refinement
Open Data community vs. Opensource community
Limitations:Severe Events(Time/location/Severity)
Private Company
Local Met-Service
Academia
Refined Dataset
14
Not yet
2012-2018 Severe Weather AI Training & Data Set
Collaboration
Business Model 5:Public - Private - Academia – Trial + Buy
Academia
PrivateSectors
Non-Traditional Observation:Nano-Sat,Phased Array Radar
NMSMet
Service
Trial
BuyTrial
15
Collaboration
Business Model 6Wholesale+ Retail for diverse needs
Global Data & Regional Data Requirement
Holistic
National Data Center
Provincial MetSrv1 Provincial MetSrv2 Provincial MetSrv3
Source2 Source3 Source4
The Third Party
Integrated Nationalwide
Large scale monitoringNWP requirementsClimate monitoring
Small scale monitoringLocal government supportLocal (Smart city) service
Avoid duplicate purchaseSource1
16
Purchase
Thousands in provincesImage & Videoper 5 minitue
For non-commercial use and non-privacy-violation
Business Model 7
LOCAL
Global
Devices purchased for more data sharing
Purchase & install low-cost observations, access to wider-range data
17
Purchase/Exchange
Support :Global Data Community?
18
Data InventoryFree& unrestrictedOpen & Licensed
Charged
WMO/Bilateral
Earth ObsOrganizations
ScientificExperiments
PrivateSectors
GovernmentDepartment
Earth system modeling
Life threatening DRR
Climate monitoring
Sustainable development
Climate resource utilization
Before we exchange data, we find and organize them
Meteorological Open Data Inventory
Quality labeling
Discovery Metadata
Data License
Free & unrstricted
Network of Earth system Data Resources
Meta Data
Federated Cloud based Platform
Evaluating the contributions of members in the communityTracking & protecting the intellectual property concerned data
Data with a unified object identifier
19
Support :Blockchain?
Open Cloud Platform
Public Private Researcher Volunteers
Tools…
Model
Data &Product
block1
block2
block n
Blockchain
DecentralizationNo-tampering
Data rightsData securityTraceability
Public Private Researcher Volunteers
Interoperability
20
ConclusionComplex World: Holistic approach, Ecosystem
By 2030, we see a world where all
nations, especially the most
vulnerable, are more resilient to the
socioeconomic consequences of
extreme weather, climate, water and
other environmental events; and
underpin their sustainable
development through the best
possible services, whether over land,
at sea or in the air.
Our Vision
Thanks for your attention!
21