data quality – uk activities

Download Data Quality – UK activities

Post on 24-Feb-2016




0 download

Embed Size (px)


Data Quality – UK activities. Iain Macleay Head of Energy Balances, Prices and Publications. 27 September 2013. Contents. Aspects of quality Standard errors Revisions Risk based quality reviews Quality training. Aspects of quality. DECC follow UK statistical practice: Relevance - PowerPoint PPT Presentation



Data Quality UK activitiesIain MacleayHead of Energy Balances, Prices and Publications27 September 2013Aspects of qualityStandard errorsRevisionsRisk based quality reviewsQuality training

ContentsDECC follow UK statistical practice:RelevanceAccuracyTimeliness & punctualityAccessibility & clarityComparabilityCoherence

Aspects of qualityDECC release data to pre-announced, year in advance, timetable all releases at 9:30am. Energy Trends Thursday 26 September; Thursday 19 December Thursday 27 March Thursday 26 JuneDates set for coming year, by the DECC Chief Statistician no political interference

If data not released at 9:30 DECC need to report breech to UK National Statisticians Office

Data released as soon as available

Timeliness & punctualityDifficult to measure, but Sample sizes of surveys published with information on coverageWhere useful, standard errors publishedWeighting to adjust for coverageAdministrative sources used where appropriateCheck accuracy of recording by comparing data sources (volume surveys, price surveys, company reports)

AccuracySample sizes and standard errors for Quarterly Fuels Inquiry - published in industrial price methodology note

As working in policy departments regular liaison so data meet needs.Also try to anticipate their future needs.Regularly survey of wider user community to check meeting their needs, every 2 to 3 years results published on webReview content of press notices and channels of communication (tweets etc)

RelevanceData presented in consistent formatHelpful commentary drawing users to key points of interest (even if politically difficult), written independently by the statistics teamClear info on contact details of DECC statistical teamsAll info available for free on webMetadata published detailed method notes on webSome info on revisions publishedAccessibility & clarity Revisions final consumption annual growth after one quarter

Monthly data consistent with quarterly, and annual data revised in line with better more complete informationStandard geographies used where possibleEnergy balance format used so supply and demand consistent

Coherence & comparabilityData collections and publications should be reviewed on a regular basisTricky in practice time consuming activityRisk based approach being trialledMethodically go through checklistMost activities fairly low risk

Quality reviewsRisk based review templateSourcesMethodsSystemsProcessesQualityUsers & reputationPeopleCensusData acquisition/questionnaire designSystem aData collection & preparation processRelevanceUser feedbackPeopleAdminCoverage of dataSystem bResults & analysis processesAccuracyFuture user needsSurveyProcessing, edit & imputationTimeliness & punctualityReputationAnalysisAccessibility & clarityDisclosureComparabilityCoherence

Domestic fuel prices inquirySourcesMethodsSystemsProcessesQualityUsers & reputationPeopleSurvey 98% sample coverage

Complex detailed survey, many issues including change of tariff structure etc.System redesigned in 2012Data validation & editingProduces bills based on standard consumption rather than actualsGood feedback receivedNew person each year as data processed by sandwich studentGood geographical coverageSpread sheet back-up availableMain system newly developed, but back-up used as double check Release 12 weeks after end of quarterKey policy area so new data needs emergingLarge survey company 100 tariffs in 14 regions - so much scope for problems.AnalysisInformation published is disclosive, but pre-agreed with former monopoly suppliersActionsMeet companies to improve form fillingEngage pro-actively with policy to find future needs

Ensure good documentationHave sufficient staff trained to use systemCheck data with that from similar surveysCheck data against firms published annual reports

How do we ensure good quality statisticsWell trained staffTraining sessions held focusing on qualityAll staff to attend take through stages of statistical value chainIn DECC two statisticians trained up to train others

Quality training