big data for measuring the information society data for measuring the information society...
TRANSCRIPT
![Page 1: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/1.jpg)
Big Data for Measuring the Information SocietyI N T E R N AT I O N A L T E L E C O M M U N I C AT I O N U N I O N
B I G D ATA P R O J E C T - I N N O VAT I V E WAY S TO U T I L I Z E B I G D ATA A S A N E W D ATA S O U R C E F O R I C T I N D I C ATO R S
M A R G U S T I R U . P R O J E C T C O O R D I N ATO R , I T U C O N S U LTA N T
![Page 2: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/2.jpg)
The ObjectiveDemonstrate how Big Data can be used for ICT measurement – to produce new and existing ICT indicators to enhance data availability, benchmarks and methodologies to measure the information society
![Page 3: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/3.jpg)
Big Data IndicatorsReplace existing indicators
Complement existing indicators (granularity, disaggregation)
New indicators
![Page 4: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/4.jpg)
Big Data
In this project we consider Big Data sources from Mobile Network Operators (MNO) and Internet Service Providers (ISP), who possess valuable residual data from the aspect of ICT
![Page 5: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/5.jpg)
6 Pilot CountriesThe Philippines, Georgia, Colombia, Kenya, UAE, Sweden
Broadband Test Data
Claro, Movistar, Tigo Une
Globe, Smart
Magti, Geocell, Beeline, Silknet
Safarikom, Telkom
Etisalat, Du
![Page 6: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/6.jpg)
Local Stakeholders
Telecommunication regulator / ICT Ministry
National Statistical Institutes
Data protection commission/agency
MNOs and ISPs – data providers: ◦ Globe, Smart, Magti, Geocell, Beeline, Silknet, Claro,
Movistar, Tigo Une, Safarikom, Telkom, Etisalat, Du
![Page 7: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/7.jpg)
Pilot Studies’ ChallengesAccess to the data
◦ Legal clearance (regulations)
◦ Administrative aspects
◦ Data protection (DPA)
◦ What source data are collected and available
Processing and analysis of large data sets◦ Location of the processing
◦ Methodology for processing, quality of the data and indicators
What indicators can be calculated?◦ Are the resulting indicators valuable and usable foe policy and investments
decisions?
◦ Is the data comparable nationally, internationally, over the time?
![Page 8: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/8.jpg)
Status
Engagement of the stakeholders, data providers, partners
Getting commitment
Accessing the data (legal, technical)
Processing the data
Analysing and evaluation of the results
Combining and comparing the results with other countries
![Page 9: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/9.jpg)
Country Status overviewLocation of the processing
Expected data scientist's visit
Country report ready
SwedenNeeds resolving contract issues and privacy obfuscation
ITU December January
Philippines Waiting for legal go from data providersData providers
January February
GeorgiaData request from data providers, preparations from data providers to send data, GNCC to process data
GNCC February March
ColombiaProviders committed, but lack of resources and time now, 2017 Q2 expected
Mixed March-April April
KenyaReady, need to resolve some aspects of data processing and administrative questions
Data providers
January February
UAEOfficial request made from TRA, data providers preparing for processing of the data
Data providers
January February
![Page 10: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/10.jpg)
MethodologyMethodology document
◦ Proposed indicators
◦ Data source description
◦ Processing methodology
◦ Disaggregation
◦ The purpose and value of the indicator
Draft document to be complemented and amended during the project
![Page 11: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/11.jpg)
◦ BD01: Percentage of the Land Area Covered by Mobile-Cellular Network, by Technology◦ BD02: Percentage of the Population Covered by a Mobile-Cellular Network, by Technology◦ BD03: Usage of Mobile-Cellular Networks for non-IP Related Activities, by Technology◦ BD04: Usage of Mobile-Cellular Networks for Internet Access, by Technology◦ BD05: Number of Subscriptions with Access to Technology◦ BD06: Active Mobile Voice and Broadband Subscriptions, by Contract Type◦ BD07: Average Number of Active Mobile Subscriptions per Day, by Contract Type◦ BD08: Active Mobile Devices◦ BD09: IMEI Conversion Rate◦ BD10: Fixed Domestic Broadband Traffic, by Speed, Contract Type◦ BD11: Mobile Domestic Broadband Traffic, by Speed, Contract Type, Technology◦ BD12: Mobile International Broadband Traffic, by Contract Type◦ BD13: Inbound Roaming Subscriptions per Foreign Tourist◦ BD14: Fixed Broadband Subscriptions, by Technology◦ BD15: Fixed Broadband Subscriptions, by Speed◦ BD16+: any proposed indicators from the country stakeholders
Proposed Big Data Indicators
Example results of the proposed
indicators
Example results of the proposed
indicators
![Page 12: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/12.jpg)
![Page 13: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/13.jpg)
![Page 14: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/14.jpg)
![Page 15: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/15.jpg)
![Page 16: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/16.jpg)
![Page 17: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/17.jpg)
![Page 18: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/18.jpg)
![Page 19: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/19.jpg)
![Page 20: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/20.jpg)
Only every 12th
subscriber (8%) has accessed 4G
network
![Page 21: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/21.jpg)
![Page 22: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/22.jpg)
![Page 23: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/23.jpg)
![Page 24: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/24.jpg)
![Page 25: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/25.jpg)
![Page 26: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/26.jpg)
![Page 27: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/27.jpg)
BD13: Inbound Roaming Subscriptions per Foreign Tourist. Effect of the Roaming Regulations
![Page 28: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/28.jpg)
![Page 29: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/29.jpg)
![Page 30: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/30.jpg)
![Page 31: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/31.jpg)
![Page 32: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/32.jpg)
BD16+Pilot countries have an option to include additional indicators that are relevant to the country:◦ Kenya: Including indicators on Mobile Money
◦ UAE: Interested in some data mining and machine learning approaches
◦ Colombia: Density of population census block level
◦ Stakeholders in other countries welcome to include indicators that they feel are necessary from the point of view of their country and globally
![Page 33: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/33.jpg)
Internationally comparable indicators
![Page 34: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/34.jpg)
Difference with Current Reporting System◦ Breakdown
◦ Geographical: Local Administrative Units 1-2-3
◦ Urban/Rural breakdown
◦ Contract type: private/commercial; pre-paid/post-paid; voice/data
◦ Socio-demographics: gender, age, language
◦ Mobile technology generation: 2G, 3G, 4G
◦ Fixed technology: cable, DSL, fibre, etc.
◦ Fixed advertised speed
◦ Device based on IMEI/TAC
◦ Event type (call, message, incoming, outgoing, IP)
◦ Data volume
◦ Data providers don’t simply report summarised indicators, but need to calculate and aggregate using Big Data tools
![Page 35: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/35.jpg)
Comments from the Country StakeholdersExcited that this project has started and they are looking for the results and want to commit to the project
Asking if the project will also have influence on the timeliness of the reporting and publication of the ICT indicators locally and globally (via ITU)
Although the pilot project is a starting point and therefore limited by its scope, stakeholders expect more big data related activities initiated locally and on global scale in terms of tools, possibilities of big data, capacity building, and development of the resources:
◦ Data mining, data discovery
◦ Machine learning
◦ Improvements of ICT, SDG, eliminating digital divide, poverty
◦ Capacity building, academic research
![Page 36: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/36.jpg)
Data ScientistTo assist pilot countries to process the data
Combining the data providers’ indicators into country indicators
Analyse the indicators for the countries
Visualisation and country reports
![Page 37: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/37.jpg)
Processing Location: Option 1
![Page 38: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/38.jpg)
Processing Location: Option 2
![Page 39: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/39.jpg)
Possibility of common use of the big data sources for
BIG DATABIG
DATA
ICTICT
DisasterDisaster
SDGSDG
MobilityMobilityPopulationPopulation
TourismTourism
……
Regulator/ICT Ministry
Statistical office
Transportation Authority
Municipalities
Min. Tourism & Tourism
boards
Regional planning, Min.
Envir
![Page 40: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/40.jpg)
Project ResultsThe expected results of the project are:
◦ 6 country reports◦ Concrete ICT indicators database on each pilot country◦ Description of the source data and methodology for processing of the data◦ Possibilities and limitations of the data source and indicators◦ How the indicators can be used for policy and investment decisions◦ Project final report
Based on the pilot studies, further discussion about using such indicators globally will continue, Phase II
Presentation of project:◦ EGH, EGTI meetings October 2016◦ WTIS 2016 - World Telecommunication/ICT Indicators Symposium November
2016◦ Next conferences on ICT and big data
![Page 41: Big Data for Measuring the Information Society Data for Measuring the Information Society INTERNATIONAL TELECOMMUNICATION UNION BIG DATA PROJECT - INNOVATIVE WAYS TO UTILIZE BIG DATA](https://reader031.vdocuments.mx/reader031/viewer/2022030414/5a9fc6207f8b9a67178d4bc8/html5/thumbnails/41.jpg)
Margus Tiru
Consultant to ITU
project coordinator
Esperanza Magpantay
Senior Statistician, ITU ICT Data and Statistics Division
Susan Teltscher
Head of the ICT Data and Statistics Division
ITU Telecommunication Development Bureau