Everything you wanted to know about Electronic Data Reporting (EDR) at Statistics Canada June 2007

Download Everything you wanted to know about Electronic Data Reporting (EDR) at Statistics Canada June 2007

Post on 21-Jan-2016




0 download

Embed Size (px)


Everything you wanted to know about Electronic Data Reporting (EDR) at Statistics Canada June 2007. Outline of Presentation. Introduction Background Original approach for EDR Services What happened? Consequences Electronic Collection Framework Summary/Conclusions. Introduction. - PowerPoint PPT Presentation


<ul><li><p>Everything you wanted to knowabout Electronic Data Reporting(EDR) at Statistics Canada</p><p>June 2007</p><p>International Conference on Establishment Surveys</p></li><li><p>Outline of PresentationIntroductionBackgroundOriginal approach for EDR ServicesWhat happened?ConsequencesElectronic Collection FrameworkSummary/Conclusions</p><p>International Conference on Establishment Surveys</p></li><li><p>IntroductionStatistics Canada (STC) began using Electronic Data Reporting 10 years ago by mailing questionnaires on diskettes.</p><p>Six years ago a Government On-line initiative was launched; STC awarded funding to develop a comprehensive Internet collection platform.</p><p>International Conference on Establishment Surveys</p></li><li><p>IntroductionProject originally focused on developing an EDR solution for 50 business and agriculture surveys, since these respondents complete large numbers of surveys on an ongoing basis. </p><p>Since then, the 2006 Census provided a customized electronic data reporting option, and achieved a 20% take-up rate on the household side.</p><p>Today, Statistics Canada has a new plan to provide electronic collection service to respondents, based on last 5 years of somewhat painful experience.</p><p>International Conference on Establishment Surveys</p></li><li><p>BackgroundSTC administers over 400 surveys across four business lines: social, institutional, agricultural and business.</p><p>Computer assisted telephone interviewing (CATI) and personal interviewing (CAPI) are the mode of collection for social surveys; paper as well as CATI are used for agriculture, business and institutional surveys.</p><p>International Conference on Establishment Surveys</p></li><li><p>BackgroundStrict confidentiality and privacy policies require a sophisticated security model for EDR, along with a complex technical infrastructure.</p><p>The wide diversity in STCs surveys (complexity, length, frequency, sample size) added to the challenges for developing EDR applications.</p><p>International Conference on Establishment Surveys</p></li><li><p>Original Approach for EDR ServicesIntroduced EDR to small surveys or sub samples of larger business/agriculture surveys to minimize potential reduction in response rates. Original mode (usually paper) kept as an option for respondents.</p><p>Selected sub-annual surveys whenever possible.</p><p>Created separate EDR applications and integrated later with other collection streams (e.g. CATI and paper).</p><p>International Conference on Establishment Surveys</p></li><li><p>Original ApproachWeb-based and Excel-based options developed to handle different requirements for different surveys.</p><p>Web-based option used HTML, Java Script.</p><p>Both options used PKI-Entrust (which required respondents to download a Java Applet on a JVM).</p><p>International Conference on Establishment Surveys</p></li><li><p>Original ApproachCreated secure staging area physically separate from the Internet and STCs internal network for maximum security.</p><p>Built authentication and encryption services, along with virus and detection capability.</p><p>Implemented a Thick client model (edits executed on client-side).</p><p>International Conference on Establishment Surveys</p></li><li><p>What Happened?Unable to assess cost/benefit of EDR as a mode of collection, given small EDR sample sizes.</p><p>Response rates varied (0% - 60%).</p><p>Technical infrastructure not stable due to high level of complexity.</p><p>Respondents had technical difficulties accessing site and completing surveys.</p><p>International Conference on Establishment Surveys</p></li><li><p>What Happened?Costs to develop and support 50 unique applications too high. </p><p>EDR with a CATI follow-up (i.e. multiple, independent systems) does not provide significant benefits (time or money).</p><p>Surveys adopting EDR need to develop their collection approach from a single instrument point of view.</p><p>Overall - minimum success achieved with majority of surveys originally selected for EDR.</p><p>International Conference on Establishment Surveys</p></li><li><p>ConsequencesUndertook a complete review of Statistics Canadas approach to EDR services.</p><p>Statistics Canada moving towards a simpler, more technically integrated collection environment. </p><p>Proceeded to adopt an enterprise wide view of collection with a more generic/integrated approach across modes.</p><p>Adopted new standards for surveys wanting to offer an EDR option (e.g. minimum sample of 6,000).</p><p>Developed an Electronic Collection Framework outlining short to medium term strategy for EDR.</p><p>International Conference on Establishment Surveys</p></li><li><p>Electronic Collection FrameworkStabilize current EDR environment</p><p>Gather Business Requirements</p><p>Conduct Options Analysis</p><p>Conduct Pilots</p><p>The Way Forward</p><p>International Conference on Establishment Surveys</p></li><li><p>Electronic Collection FrameworkStabilize Current EDR Environment (Completed)</p><p>Documented all outstanding issues</p><p>Created lessons learned document</p><p>Reduced existing suite of EDR surveys to only those with a good business case</p><p>Implemented upgrades to environment based on maximum improvement for minimum cost</p><p>International Conference on Establishment Surveys</p></li><li><p>Electronic Collection FrameworkGather Business Requirements (Completed)</p><p>Conducted an Agency wide analysis of the business requirements for EDR. Involved 40 divisions and all types of surveys</p><p>Produced the STC Electronic Collection Services, a summary of requirements</p><p>Identified the need for 2 core electronic servicese-file transfer service (urgent)e-questionnaire service</p><p>International Conference on Establishment Surveys</p></li><li><p>Electronic Collection Framework</p><p>e-file transfer servicea secure service to collect (&amp; share) survey related administrative filesbi-directional: serves STC and its partnersbased on the Managed File Transfer Technologye-questionnaire servicea self-administered questionnaire serviceEnables respondents to securely fill and submit surveys online (internet) </p><p>International Conference on Establishment Surveys</p></li><li><p>Electronic Collection FrameworkConduct Options Analysis (Completed)</p><p>Assessed buy (using COTS) vs build software for new infrastructure</p><p>Identified 10-12 potential COTS products aligned with each of the 2 core services</p><p>Undertook detailed analysis of key products</p><p>International Conference on Establishment Surveys</p></li><li><p>Electronic Collection FrameworkConduct Pilots (in progress)</p><p>Obtained free access to 2 COTS products</p><p>Record STC hands-on experience</p><p>Gather end-user feedback</p><p>e-file transfer pilot (complete)9 Divisions, 5 External PartnersVery positive feedback</p><p>e-questionnaire pilot (underway)2 social surveys participating in pilot as well as business survey</p><p>International Conference on Establishment Surveys</p></li><li><p>Electronic Collection FrameworkWay Forward</p><p>Obtain corporate approval for Electronic Collection Framework Strategy/Business Case</p><p>Complete e-questionnaire Pilot</p><p>Undertake competitive processes for both e-file transfer and e-form COTS software</p><p>Launch Agency wide e-file transfer service spring 2008</p><p>Offer limited e-questionnaire service summer 2008</p><p>International Conference on Establishment Surveys</p></li><li><p>Summary/ConclusionsDifficult start up for EDR at Statistics CanadaNew approach of integration and simplification of collection processes helping to redefine the role of EDR in futureConsultation exercise established priorities for e-services.Re-engineering of current infrastructure under way (subject to funding approval)Increasing interest by Social SurveysFuture looks promising</p><p>International Conference on Establishment Surveys</p></li></ul>