unsd-escwa regional workshop on census data processing in the escwa region: contemporary...

25
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing Doha, State of Qatar, 18-22 May 2008 PDAs-Handheld Devices/Internet for Census Data Collection

Upload: travon-brunt

Post on 30-Mar-2015

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

PDAs-Handheld Devices/Internet for Census Data Collection

Page 2: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Overview of the Presentation

Challenges with Paper-based Data Collection and Challenges with Paper-based Data Collection and Processing Processing

Moving to PDA/Handheld-based Data Collection and Moving to PDA/Handheld-based Data Collection and ProcessingProcessing

PDAs: Key Features/Other Optional Features PDAs: Key Features/Other Optional Features Internet-based Census Data CollectionInternet-based Census Data Collection Benefits/IssuesBenefits/Issues Recommendations - ConclusionsRecommendations - Conclusions

Page 3: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Paper-based Data Collection

Paper-based

Data Collection

Paper-and-Pencil Interviewing

Self-administrated Questionnaire

Handheld devices

Internet

Page 4: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Challenges with Paper-based Data Collection/ ProcessingChallenges with Paper-based Data Collection/ Processing

Slow and time-consumingSlow and time-consuming Re-keying information is inefficient and Re-keying information is inefficient and

increases chance of errorincreases chance of error Paper-based forms increase chance of errorPaper-based forms increase chance of error Submitting multiple forms for a single processSubmitting multiple forms for a single process Cannot capture value-added data – GISCannot capture value-added data – GIS Data Integrity and AuthenticityData Integrity and Authenticity

Page 5: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

PDA and Handheld Computer

Personal digital assistant: “A personal digital assistant (PDA) is a handheld

computer, also known as small or palmtop computers.” (Wikipedia)

PDA vs Handheld computer: Handheld computer offers more features than a PDA

(larger than a PDA; smaller than a Laptop!) Used interchangeably

Page 6: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Paper-based Approach vs PDA’s Approach

Manual

ManualComputer-assisted

-Key entry/computer-assisted- OMR/OCR/ICR

ManualComputer-assisted

Automated/built-in

Paper-based Approach

PDA ‘s Approach

Data Collection Data Entry Data Coding/Editing

Data Collection/Entry/Coding/Editing

Data Coding/Editing

(partial)

Page 7: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

PDA: Way of Functioning

Simultaneously data entering and data coding Possibility to enter data in two ways: with selection from

the offered list of answers (or from classification in hierarchical order ) or with typing a text

The next question could not be answered if the current one is not answered

To have report of enumerated units (cumulative) in each moment

To measure the time needed for enumeration of each separate enumeration unit

Page 8: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

PDAs - Key Features

Works like a “Pocket Computer” Processor, RAM, ROM, Operating System Applications can we loaded on the device Device has processing power

Increases Productivity “on the move” Data can be collected in digital format in the

field Data can be directly uploaded into the server

Page 9: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Cont…

Connectivity Options Data connectivity using GPRS /CDMA Data Connectivity options using Wi-Fi (Wireless) Data can be transferred by “syncing” with Computer:

wired connectivity via USB cable (PDAs connect to computer)

Enhanced data storage Increase storage capacity through add on SD cards

Optional features Camera, Biometric, GPS, Add on Smart Card reader etc

Page 10: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Two Types of Handheld devices:

Pen Based Pocket PC’s

o Stylus based inputo Data transfer through “sync”

Converged Pocket PC with Connectivity

o Connected via GPRS / CDMAo Options of Camera, GPS

Page 11: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Three forms of data transfer (from HP)

Collect data in the

field

Sync and transfer

data

Using PDA with data sync option Option 1

Collect data in the

field

Send data via Inbuilt

GPRS

Using PDA inbuilt GPRS capability

Option 2

Collect data in the field

Send data via phone

Using PDA in connection with Bluetooth Phone / connected cable

Option 3

Page 12: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Selection Criteria:

Data Input Method Stylus, On device keyboard, Off Device Keyboard

Memory capacity RAM:64-128 MB ROM: Inbuilt ROM, Additional ROM via SD Card

Connectivity Options Sync through computer, In-built GPRS/CDMA, Wi-Fi, Bluetooth

Ruggedness

Regional Language Support Arabic, English plus additional languages

Other Options GPS, Camera, etc.

Page 13: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Other Decision Making Criteria:

Real time data upload Vs Batch data upload

Recurring costs for data connectivity

Ease of data entry/Ease of holding device in one hand

Battery Life / Battery Charging Options

Page 14: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Managing devices in the field: Some Considerations

How do we manage the devices in the field?

Data security?

Device security?

Application version on device?

Troubleshooting on device?

Page 15: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Measures for data protection

Ensure protection from: Loosing of already entered records Ex-post data correction in entered records Unauthorized using of data

Measures: Biometric Security Security for Wireless and GPRS Encrypting Data Make it “solid” (rugged?) Make it “ugly”!

Page 16: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Optional Features

The device can be enabled with GPS to: geo-reference units visited

(urban and rural) track location of data entrytrack location of data entry Positioning and guidance of the Positioning and guidance of the

enumeratorenumerator

With Cellular, camera and OS applications

Page 17: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

PDAs Costs

Pocket PCs: $300-$1200

Cost dependent on User Interface Upgrading

Economy of scale Deployment issues

Page 18: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Summary of Key Features

Integrated field platforms with GPS, cellular, camera and OS applications

Real-time task management from office Manage field time, expenses, etc. Geographical and map processing Data synchronization and management Secure applications, procedures and protocols Ability to encrypt data for secure transmission

Page 19: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Self-administrated Questionnaire

Paper-based

Data Collection

Paper-and-Pencil Interviewing

Self-administrated Questionnaire

Handheld devices

Internet

Page 20: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Internet-based Census Data Collection (eCensus)Internet-based Census Data Collection (eCensus)

Why?Why? Requested by the population (e.g. France)Requested by the population (e.g. France) E-Government Policy (e.g. Canada)E-Government Policy (e.g. Canada)

Some benefitsSome benefits Accurate and timely data collectionAccurate and timely data collection Processing time reducedProcessing time reduced Rapid availability of clean data for statistical analysisRapid availability of clean data for statistical analysis Enhanced analyticsEnhanced analytics Reuse and consumption by multiple DepartmentsReuse and consumption by multiple Departments Enhanced Efficiency: eliminating layers, reducing staff and Enhanced Efficiency: eliminating layers, reducing staff and

costscosts

Page 21: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Example: Canada Experience

Government On-Line (GOL) initiative

Census 2006: 73% Mail-out via Canada Post Development and integration of Internet

application and processing was outsourced to private sector

Target: 20% of initial response from the Internet

Page 22: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Example: European Census Organization Pilot for 2011

The pilot includes two key aspects: •eCensus (census online) and •Handheld devices. They want to equip census takers with hand-held devices to update addresses nationwide, and for non-response follow up or to input information during a canvass of homes whose residents fail to submit paper census surveys.

From “RGI Conference on Technology Options”, IBM

Page 23: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Recommendations for the use of PDAsRecommendations for the use of PDAs

Think Integration – People, Process, TechnologyThink Integration – People, Process, Technology

Build Partnership with:Build Partnership with: Application development partner Device Manufacturer Connectivity provider Capacity building supporter

Nodal Agency:Nodal Agency: Operationalize the whole processOperationalize the whole process

Page 24: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Summary-Conclusions

1. The qualitative as well as quantitative benefits of handheld devices have been proven in field in many countries (Australia, Canada, Brazil, Malaysia, New Zealand, etc…)

2. Various Options are available for selecting handheld devices

3. Clear identification of objective is required for selecting best device

4. Important to have extensive training prior to deployment

5. Post implementation support – technical as well as hardware support ensures project success

Page 25: UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data

UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing

Doha, State of Qatar, 18-22 May 2008

Thank You