a centralised management tool for quality indicators in eustat jorge aramendi, anjeles iztueta,...

A Centralised Management Tool for Quality Indicators

in EUSTAT

Jorge Aramendi, Anjeles Iztueta,

Cristina Prado, Marta Mas

EUSTAT. Basque Statistics Office

Helsinki, 4 May 2010

Where the Basque Country is & What Eustat is

• The Basque Country is in the Northern part of Spain.

• An autonomous agency set up pursuant to the 1986 Basque Statistics Act.

• Headquarters are located in Vitoria. Provincial offices are in Bilbao, San Sebastián and Vitoria.

Index

– Eustat Quality System

– Origin and definition of the project. HOBETU

– Proposed indicators

• Indicator attributes

• Task distribution

• Minimum indicators

– Results

– Future approach

Eustat Quality System

1. StatisticalOperation

3. Annual Programme and Audit

4. Marketing

5. Continuous Improvement

6. Administration

8. Human Resources 7. Information and

Communication Systems

9. Knowledge Management

2. StrategyStrategic Plan

Marketing Planand Dissemination

Services Charter

Training plan

Equality Plan

Commitment to Basque Language Plan

EUSTAT PLANS EFQM MODELSTATISTICAL OPERATIONS

Technical Projects

Indicator Registries

Quality report

Quality Reportson Data Collection

Defining the project

• Organisational problems due to information dispersion

• Need for centralisation

• Tool: HOBETU

Defining the project

• Over 100 statistical operations.

• Source of the information• Statistical Operation Indicator Registry• Quality reports• Technical Projects • Quality Report on Data Collection

• Problems detected• Indicator integration• Ranks, units, calculation, registry, periodicity,...• Quality reports that are not comparable.

• Redefining: Uniformity and standardisation of indicators

Proposed indicators

• Realistic approach: availability, utility, calculable, work load.

• Common to all operations

• Part of the quality report

• Interesting for the organization

• EUROSTAT quality factors

• 4 of Relevance, 2 of Opportunity & Punctuality, 2 of Comparability, 3 of Accessibility & Clarity, 5 of Accuracy and Reliability, 1 of Costs and 1 of Geographical Scope

• Indicator bank for the whole organization

Indicator attributes

• Name

• Definition

• Calculation Method

• Measure

• Unit responsible for carrying out the work

• Periodicity

• Data source

• Registered value

• Reference value

• Target value

• Compliance

• Quality factor

• Quality report

Task distribution

• Centralised workload:• Current value: Website Hits, Media Hits, Satisfaction Index, Level of

Importance, Total Cost.

• Reference Value of all indicators.

• Unit Responsible for Operation:• Current Value and Target Value: Schedule Compliance, Time Lag,

Comparability Rate, Comparable Periods, Methodological Documents Disseminated Online, Publications Disseminated, Nº of Clicks to Access Information, Geographical Disaggregation, Response Rate, Coverage Rate and Sampling Errors.

• Target Value (Annual): Website Hits, Media Hits, Satisfaction Index, Level of Importance, Total Cost and Preparation Time.

Minimum indicatorsRelevance •Website Access

•Media hits•Satisfaction Rating•Importance level

Opportunity and Punctuality

•Schedule compliance•Time Lag

Comparability •Comparability rate•Comparable Periods

Accessibility and Clarity

•Methodological documents disseminated on the website.•Publications disseminated •No of Clicks to access information

Accuracy and Reliability

•Response rate •Over-coverage rate •Coverage rate or sampling fraction•Sampling errors (maximum 4)

Costs •Total Cost

Geographical Scope •Geographical Disaggregation

Summary

– HOBETU tool that centralises management of the indicators

– Coherence

– Comparability

– Assessment tool

– Quality reports

– Compliance reports

Future approach

– Register all the indicators of the EUSTAT’s quality system

•EFQM processes

•Institutional plans

Thank you

Jorge Aramendi

EUSTAT. Basque Statistics Office

j-aramendi@eustat.es