UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
PDAs-Handheld Devices/Internet for Census Data Collection
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Overview of the Presentation
Challenges with Paper-based Data Collection and Challenges with Paper-based Data Collection and Processing Processing
Moving to PDA/Handheld-based Data Collection and Moving to PDA/Handheld-based Data Collection and ProcessingProcessing
PDAs: Key Features/Other Optional Features PDAs: Key Features/Other Optional Features Internet-based Census Data CollectionInternet-based Census Data Collection Benefits/IssuesBenefits/Issues Recommendations - ConclusionsRecommendations - Conclusions
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Paper-based Data Collection
Paper-based
Data Collection
Paper-and-Pencil Interviewing
Self-administrated Questionnaire
Handheld devices
Internet
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Challenges with Paper-based Data Collection/ ProcessingChallenges with Paper-based Data Collection/ Processing
Slow and time-consumingSlow and time-consuming Re-keying information is inefficient and Re-keying information is inefficient and
increases chance of errorincreases chance of error Paper-based forms increase chance of errorPaper-based forms increase chance of error Submitting multiple forms for a single processSubmitting multiple forms for a single process Cannot capture value-added data – GISCannot capture value-added data – GIS Data Integrity and AuthenticityData Integrity and Authenticity
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
PDA and Handheld Computer
Personal digital assistant: “A personal digital assistant (PDA) is a handheld
computer, also known as small or palmtop computers.” (Wikipedia)
PDA vs Handheld computer: Handheld computer offers more features than a PDA
(larger than a PDA; smaller than a Laptop!) Used interchangeably
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Paper-based Approach vs PDA’s Approach
Manual
ManualComputer-assisted
-Key entry/computer-assisted- OMR/OCR/ICR
ManualComputer-assisted
Automated/built-in
Paper-based Approach
PDA ‘s Approach
Data Collection Data Entry Data Coding/Editing
Data Collection/Entry/Coding/Editing
Data Coding/Editing
(partial)
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
PDA: Way of Functioning
Simultaneously data entering and data coding Possibility to enter data in two ways: with selection from
the offered list of answers (or from classification in hierarchical order ) or with typing a text
The next question could not be answered if the current one is not answered
To have report of enumerated units (cumulative) in each moment
To measure the time needed for enumeration of each separate enumeration unit
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
PDAs - Key Features
Works like a “Pocket Computer” Processor, RAM, ROM, Operating System Applications can we loaded on the device Device has processing power
Increases Productivity “on the move” Data can be collected in digital format in the
field Data can be directly uploaded into the server
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Cont…
Connectivity Options Data connectivity using GPRS /CDMA Data Connectivity options using Wi-Fi (Wireless) Data can be transferred by “syncing” with Computer:
wired connectivity via USB cable (PDAs connect to computer)
Enhanced data storage Increase storage capacity through add on SD cards
Optional features Camera, Biometric, GPS, Add on Smart Card reader etc
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Two Types of Handheld devices:
Pen Based Pocket PC’s
o Stylus based inputo Data transfer through “sync”
Converged Pocket PC with Connectivity
o Connected via GPRS / CDMAo Options of Camera, GPS
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Three forms of data transfer (from HP)
Collect data in the
field
Sync and transfer
data
Using PDA with data sync option Option 1
Collect data in the
field
Send data via Inbuilt
GPRS
Using PDA inbuilt GPRS capability
Option 2
Collect data in the field
Send data via phone
Using PDA in connection with Bluetooth Phone / connected cable
Option 3
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Selection Criteria:
Data Input Method Stylus, On device keyboard, Off Device Keyboard
Memory capacity RAM:64-128 MB ROM: Inbuilt ROM, Additional ROM via SD Card
Connectivity Options Sync through computer, In-built GPRS/CDMA, Wi-Fi, Bluetooth
Ruggedness
Regional Language Support Arabic, English plus additional languages
Other Options GPS, Camera, etc.
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Other Decision Making Criteria:
Real time data upload Vs Batch data upload
Recurring costs for data connectivity
Ease of data entry/Ease of holding device in one hand
Battery Life / Battery Charging Options
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Managing devices in the field: Some Considerations
How do we manage the devices in the field?
Data security?
Device security?
Application version on device?
Troubleshooting on device?
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Measures for data protection
Ensure protection from: Loosing of already entered records Ex-post data correction in entered records Unauthorized using of data
Measures: Biometric Security Security for Wireless and GPRS Encrypting Data Make it “solid” (rugged?) Make it “ugly”!
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Optional Features
The device can be enabled with GPS to: geo-reference units visited
(urban and rural) track location of data entrytrack location of data entry Positioning and guidance of the Positioning and guidance of the
enumeratorenumerator
With Cellular, camera and OS applications
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
PDAs Costs
Pocket PCs: $300-$1200
Cost dependent on User Interface Upgrading
Economy of scale Deployment issues
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Summary of Key Features
Integrated field platforms with GPS, cellular, camera and OS applications
Real-time task management from office Manage field time, expenses, etc. Geographical and map processing Data synchronization and management Secure applications, procedures and protocols Ability to encrypt data for secure transmission
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Self-administrated Questionnaire
Paper-based
Data Collection
Paper-and-Pencil Interviewing
Self-administrated Questionnaire
Handheld devices
Internet
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Internet-based Census Data Collection (eCensus)Internet-based Census Data Collection (eCensus)
Why?Why? Requested by the population (e.g. France)Requested by the population (e.g. France) E-Government Policy (e.g. Canada)E-Government Policy (e.g. Canada)
Some benefitsSome benefits Accurate and timely data collectionAccurate and timely data collection Processing time reducedProcessing time reduced Rapid availability of clean data for statistical analysisRapid availability of clean data for statistical analysis Enhanced analyticsEnhanced analytics Reuse and consumption by multiple DepartmentsReuse and consumption by multiple Departments Enhanced Efficiency: eliminating layers, reducing staff and Enhanced Efficiency: eliminating layers, reducing staff and
costscosts
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Example: Canada Experience
Government On-Line (GOL) initiative
Census 2006: 73% Mail-out via Canada Post Development and integration of Internet
application and processing was outsourced to private sector
Target: 20% of initial response from the Internet
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Example: European Census Organization Pilot for 2011
The pilot includes two key aspects: •eCensus (census online) and •Handheld devices. They want to equip census takers with hand-held devices to update addresses nationwide, and for non-response follow up or to input information during a canvass of homes whose residents fail to submit paper census surveys.
From “RGI Conference on Technology Options”, IBM
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Recommendations for the use of PDAsRecommendations for the use of PDAs
Think Integration – People, Process, TechnologyThink Integration – People, Process, Technology
Build Partnership with:Build Partnership with: Application development partner Device Manufacturer Connectivity provider Capacity building supporter
Nodal Agency:Nodal Agency: Operationalize the whole processOperationalize the whole process
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Summary-Conclusions
1. The qualitative as well as quantitative benefits of handheld devices have been proven in field in many countries (Australia, Canada, Brazil, Malaysia, New Zealand, etc…)
2. Various Options are available for selecting handheld devices
3. Clear identification of objective is required for selecting best device
4. Important to have extensive training prior to deployment
5. Post implementation support – technical as well as hardware support ensures project success
UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region: Contemporary technologies for data capture, methodology and practice of data editing
Doha, State of Qatar, 18-22 May 2008
Thank You