country paper on: access policy and dissemination of micro-data: egypt’s experience prepared by...

30
Country Paper on : Access Policy and Dissemination of Micro- Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Upload: ethelbert-ashley-mccarthy

Post on 27-Dec-2015

219 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Country Paper on:

Access Policy and Dissemination of Micro-Data:

Egypt’s Experience

Prepared by Khaled Hamed El-Deib

Director of decision support systems

Page 2: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Introduction..

Explain the components of electronic Archive table. International Household Survey Network (IHSN) Micro-data Management Toolkit in CAPMAS. Micro-data Access.Data Dissemination.Future of Micro-data Access by the Public. Future of Dissemination.Key Challenges.

Page 3: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Statistical main objective of the implementation of the census is the process of access the product meets the needs of data users at the suitable time and high accuracy.

From this point the cooperation Each of the statistics sector and the IT sector to achieve this goal, according to prior planning.

Was conducted the last census the population in Egypt in 2006, a thirteenth .

Begin preparations for the census before the date of its inception three years.

Page 4: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

The use of electronic archive during the census: it consists of three tables :

In first table each row represents a specific record data.

In the second table each row represents data for a particular image and the content of the barcode.

In the third table each row represents the data and form number and record number and the number of the smallest administrative unit.

Page 5: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

A- Data storage of the image such as the type and number A- Data storage of the image such as the type and number form the smallest administrative unit and the record form the smallest administrative unit and the record number and number of the form and inquire about any number and number of the form and inquire about any of themof them

B-Know the status of each record (Is the work of quality controlB-Know the status of each record (Is the work of quality control of the record or notof the record or not((

C - Know the status of each form (it was the work of ICR or C - Know the status of each form (it was the work of ICR or not)not)

D - Does each form a face and back, No. scanner was D - Does each form a face and back, No. scanner was scanning throughscanning through

E - Type barcode on each formE - Type barcode on each form

Page 6: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

We collect information for statistical purposes and it is never used to identify individuals. -Information released from the site should not be sold to others . Violating this rule is a crime with severe penalties -We recognize the value of your trust and we believe that when you answer our survey we must serve as caretakers of your information -On information dissemination users should indicate that the source of information is CAPMAS

Page 7: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Application of international standards in the use of DDI ,DCMI in EgyptThe beginning of December 2009 started CAPMAS in cooperation with Paris on the 21 training criteria mentioned by 6 surveys.

Training was done "On Job Training" by the staff of CAPMAS five other projects.

Been the work of the session included the other nine projects, and thus the total projects to 20 projects. Is a monthly follow-up action by the President of the CAPMAS on the progress made in the documentation process, and this work offers a monthly position

International HouseholdSurvey Network (IHSN)

Micro-data Management Toolkit in CAPMAS

Page 8: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

The next step

The use of SDMX in support of the program to facilitate the exchange of data.

Documentation of surveys carried out by CAPMAS to third-party.

Training of other government data producers on the documentationSee everything that is new to the development of

Page 9: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Micro Data AccessResearcher access

Availability has improved over the past 20 years.

Household micro-data are more accessible than establishment data.

Page 10: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Data DisseminationMethods of data dissemination are

evolving.Newspapers are becoming less important

for data dissemination.Newspaper employment down in case of

data dissemination. Web has revolutionized data

dissemination and analysis.

Page 11: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Data DisseminationStatistical agencies increasingly interact with

customers directly through their websites.Users have access to more data than ever

before.However, data are dispersed across

agencies ,Can be hard to locate proper data set Explanations of methodologies underlying the data are hard to find.

Page 12: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Future of Micro-data Access by the Public

Match confidential and public use data files within and across agencies.

Will advances in firewall and security technologies allow increased researcher access to confidential data?

Page 13: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Future of Micro-data Access by the Public

Access to the sampling frames of other agencies may improve sampling efficiency.

Access to administrative records from other agencies may reduce duplication.

Page 14: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Future of DisseminationNeed to recognize broad range of data

users (not just policy-makers).Each group has distinct needs.Varying technical abilities.Realign focus from outputs to

“outcomes”.

Page 15: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Future of DisseminationData Delivery. Internet – websites are now the “faces” of

statistical agencies. Web-based data releases

Social media and other mobile electronic devices.

Private sector helping to fill in the gap – Google Public Data Explorer

Page 16: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Future of DisseminationHarmonize measurement concepts

across programs Example: industry classifications are

standardized, but products and services classifications are not

Example: concept of earnings and how it is measured across different surveys can be very confusing

Page 17: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Future of DisseminationCentralize data warehousing? Data by concept: One place to find all

government data on housing, education, retirement, health, etc.

Customizing data Allow the customer to customized the data they

need with options for delivery of update notices

Page 18: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Future of Dissemination

Transparency Clear, easy to understand, explanations of

concepts underlying data Up-to-date technical documentation

Page 19: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

The Accelerated Data Program ( ADP )International HouseholdSurvey Network (IHSN)

Micro-data Management ToolkitIHSN Activities

Coordinating survey programs Web based information on planned surveys

Harmonizing concepts & methods Planning, sampling, questionnaire design, processing, data disclosure & confidentiality, etc.

Maintaining a survey catalog Web based central catalog

Developing data dissemination tools Micro-data Management Toolkit

Page 20: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Improving survey quality and data harmonization

Documenting helps harmonizing.Documenting helps identifying data gaps.ADP : assessing and improving quality of

survey data.Mid term proposed solution: international /

national question banks (XML repository of re-usable survey metadata).

Page 21: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

ADP implementation: pilot Countries Africa

Burkina Faso, Cameroon, Ethiopia, The Gambia, Ghana, Guinea *, Kenya, Liberia, Mali, Mauritania *, Mozambique, Niger, Nigeria, Senegal, Tanzania, Tunisia, Uganda (+ Botswana, Lesotho, Namibia and Swaziland [TFSCB])

Asia Bangladesh, Fiji, Indonesia, Lao PDR, Mongolia, Philippines,

Sri Lanka, Thailand, Vietnam

Central and South America Argentina, Bolivia, Costa Rica, Dominica, Guatemala, Haiti*,

Honduras, Mexico, Peru, Uruguay

Middle East Yemen

Page 22: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Looking Forward: Tools and guidelines

Micro-data Management Toolkit: Building on success Dissemination Policy Guidelines: Anonymization tools: Preserving Confidentiality Comprehensive protocol in metadata preservation Guidelines on improving:

Data ProcessingData AnalysisData QualitySurvey Methodology

Release of the Survey Quality Assessment Framework

Page 23: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Micro-data Management Toolkit

Software + guidelines + training materials For data documentation: DDI Metadata Editor

Page 24: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Access policies and procedures are crucial to protect data.

IHSN “Policy Guidelines & Recommendations”.

Why / how / when / to whom should micro-data be disseminated?.

Practical guidelines with suggested access agreement forms, etc.

To be adapted to country specificities.

Dissemination Policy Guidelines

Dissemination of micro-

data files

Page 25: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Micro-data Management Toolkit

CDROM and Web-Builder Web cataloguing system

For data dissemination: open-source tools

Page 26: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

By a Task Force; building on existing work

Not an integrated software. Using power of statistical

packages for processing complex algorithms

A collection of specialized tools for:

Measuring the risk Reducing the risk Assessing the information loss Intelligent system To generate anonymized subsets on-demand

Anonymization Tools

Page 27: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems
Page 28: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

Key Challenges Overlap between the individuals

responsible for various stages of census data and the individuals responsible for the archiving of census data.

Do not specify a time for archiving. The presence of more than one source

has the census data, which impedes the archiving of census data.

Metadata collection and delivery Ensuring solution integrated with data

dissemination Access to Egypt-wide outputs Micro-data provision Product definition and delivery

Mechanisms

Page 29: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems
Page 30: Country Paper on: Access Policy and Dissemination of Micro-Data: Egypt’s Experience Prepared by Khaled Hamed El-Deib Director of decision support systems

E-mail:      [email protected]

E-mail:      [email protected]