fulvia cerroni - serena migliardo - enrica morganti italian national institute of statistics session...
TRANSCRIPT
Fulvia Cerroni - Serena Migliardo - Enrica Morganti
Italian National Institute of Statistics
Session 27: Use of administrative sources I
Helsinki 5 May 2010
A quality evaluation analysis of the Italian Business Register of Enterprise Groups
European Conference on quality in Official Statistics
Q2010 Helsinki
5 May 2010 2
Agenda
Backgrounds
Data quality Management
The sources and the process
Quality of the input
Quality of the process
Quality of the output
Conclusions
A quality evaluation analysis of the Italian BR
on EGs
5 May 2010 3
Backgrounds
• use of administrative archives in place of statistical surveys
• reducing the statistical burden
• From 1999 first model result of meetings with experts, academic and administrative providers
• EGs year 2003 are disseminated
• From 2004 profiling activity on largest EGs
• From 2005 Inward FATS integrated into BR
• reengineering of the process
A quality evaluation analysis of the Italian BR
on EGs
5 May 2010 4
Data Quality management
STEP Relevance AccuracyTimeliness and punctuality
Accessibility and clarity
Coherence and comparability
Output quality trade off
User needs and perceptions
Performance, cost and respondent burden
Confidentiality transparency and security
INPUT X X
PROCESS X X
OUTPUT X X X X X X X X X
• Data Quality Management
• From 2005 a system of quality indicators as a Quality Report
• A three step approach: input/process/output
A quality evaluation analysis of the Italian BR
on EGs
5 May 2010 5
The sources and the process (1)
Stock Exchange contains: all relevant shareholders of listed shared companiesinformation structure: bottom-up / top down
Chamber of Commercecontains all shareholders of non listed shared companiesinformation structure: bottom-up
Annual Reportscontains: list of consolidated enterprises by Italian Group Heads
Also foreign subsidiaries are includedinformation structure: top down
A quality evaluation analysis of the Italian BR
on EGs
5 May 2010 6
The sources and the process (2)
Preconditions:• same linking key
• same timeliness
• same information content
1. Integration of the administrative sources
2. Checking and validation procedures
• Inward Fats survey
• Italian top 50 EGs
• EGs with at least 500 employees
• Enterprise with at least 250 employees in ASIA (BR of Active
enterprises)
A quality evaluation analysis of the Italian BR
on EGs
5 May 2010 7
STEP = INPUTA quality evaluation analysis of the Italian BR
on EGs
Var Var Var
[2006, 2005] [2007, 2006] [2008, 2007]
Annual Report 366,711 363,774 368,762 -2,937 4,988 244,107 -124,655
Stock Exchange 23,755 23,476 25,084 -279 1,608 28,598 3,514
Chamber of Commerce 2,120,130 2,485,897 2,527,333 365,767 41,436 2,541,999 14,666
Annual Report 341,224 338,845 342,75 -2,379 3,905 230,808 -111,942
Stock Exchange 23,673 23,399 24,996 -274 1,597 25,137 141
Chamber of Commerce 2,120,130 2,485,897 2,527,333 365,767 41,436 2,541,999 14,666
2005 2006 2007 2008
A.1 - Total number of relationships by source
A.2 - Total number of univocal relationships by source
Accuracy - Coverage Sources
Var Var Var
[2006, 2005] [2007, 2006] [2008, 2007]
Annual Report 16 15 14 -1 -1 14 0
Stock Exchange 17 16 13 -1 -3 12 -1
Chamber of Commerce 16 15 14 -1 -1 9 -5
2006Timeliness Sources 2005 2007 2008
T.1 - Months b/e the end of reference period and the date in which sources are available
ACCURACY
TIMELINESS
5 May 2010 8
A quality evaluation analysis of the Italian BR
on EGs
Var Var Var[2006, 2005] [2007, 2006] [2008, 2007]
Annual Report 90,96 91,478 93,959 518 2,481 82,985 -10,974
Stock Exchange 12,125 11,931 12,883 -194 952 13,668 785
Chamber of Commerce 313,607 382,083 401,447 68,476 19,364 421,987 20,541
Fats 4,652 4,864 5,861 212 997 -5,861
Manual Check 173 167 821 -6 654 285 -536
Total 421,517 490,523 514,971 69,006 24,448 518,925 3,954
Accuracy - Coverage
Sources 2005 2006 2007 2008
A.7 - Number of control relationships
STEP = PROCESS (1)
Var Var Var[2006, 2005] [2007, 2006] [2008, 2007]
Annual Report 37,212 32,566 33,299 -4,646 733 30,237 -3,062
Stock Exchange 6,345 6,41 6,862 65 452 6,962 100
Chamber of Commerce 99,078 127,45 129,634 28,372 2,184 140,178 10,544
Annual Report, Stock Exchange and Chamber of Commerce1,519 1,797 1,87 278 73 1,916 46
Annual Report and Stock Exchange 1,355 1,221 1,175 -134 -46 1,3 125
Annual Report and Chamber of Commerce 38,799 42,878 44,119 4,079 1,241 37,397 -6,722
Stock Exchange and Chamber of Commerce 501 599 740 98 141 626 -114
FATS 4,651 4,863 5,859 212 996 -5,859
Manual Check 173 165 813 -8 648 277 -536
Total 189,633 217,949 224,371 28,316 6,422 218,893 -5,478
2007 2008
A.8 -Number of control relationships of groups with at least two legal units
Accuracy - Coverage
Sources 2005 2006
ACCURACY (1)
5 May 2010 9
A quality evaluation analysis of the Italian BR
on EGsSTEP = PROCESS (2)
ACCURACY (2)
5 May 2010 10
A quality evaluation analysis of the Italian BR
on EGsSTEP = PROCESS (3)
ACCURACY (3)
before FATS after FATS before FATS after FATS
- frequency 7.9 12.0 8.6 11.6
- employees 5.3 9.0 5.8 8.9
- enterprises 11.9 23.9 14.2 24.7
% of foreign EGs on total EGsEGs 2005 EGs 2006
Kind of Check Frequency %
Amended relationships 437 39.8
Added relationships 156 14.2
Duplicated relationships with ITALIAN parent
70 6.4
Duplicated relationships with FOREIGN parent
307 28
Change of the Group Head unit 3 0.3
Added foreign legal unit 124 11.3
TOTAL 1,097 100.0
INWARD FATS survey
Manual checks
Var Var
[2006, 2005] [2007, 2006]
T.2Integration of administrative sources, Inward Fats and manual checks
24 15 7 -9 -8
2007Timeliness Sources 2005 2006 TIMELINESS
5 May 2010 11
A quality evaluation analysis of the Italian BR
on EGs
Var Var
[2006, 2005] [2007, 2006]
T.3Months from the end of the process and the dissemination of data
7 4 1 -3 -3
Timeliness 2005 2006 2007
STEP = OUTPUT
ACCURACY
TIMELINESS
Var Var
[2006, 2005] [2007, 2006]Total EGs with at least one active enterprise 63,656 70,872 74,681 7,216 3,809
- with a Italian Group Head 56,028 62,635 66,090 6,607 3,455
- with a Foreign Group Head 7,628 8,237 8,591 609 354
A.18
EGs with at least one active enterprise of which having a physical person as Group head 16,959 20,270 21,640 3,311 1,370
A.19 Number of Italian active enterprises of BR on EGs 154,247 171,994 176,789 17,747 4,795
A.20 Number of employees of Italian active enterprises of BR on EGs 5,308,316 5,578,949 5,729,210 270,633 150,261
Coverage of Italian active enterprises% of Italian active enterprises from BR EGs / Total enterprises of Italian BR of Active enterprises
Coverage of employees of Italian active enterprises % of employees of Italian active enterprises from BR EGs / employees of Italian BR of Active enterprises
21.5 1.3 -0.1
A.22 56.2 56.9 56.4 0.07 -0.5
A.17
A.21 20.3 21.6
STEP =O UTPUT
Accuracy - Coverage 2005 2006 2007
5 May 2010 12
A quality evaluation analysis of the Italian BR
on EGsSTEP = OUTPUT
ACCESSIBILITY
COHERENCE
OUTPUT QUALITY TRADE OFF
PERFORMANCE, COST RESPONDENT BURDEN
• Internal users / external users
• 5 years are available and comparable
• Benchmark to check MNEs on EGR
• Timeliness / accuracy
• Sometimes accept lower accuracy in order to reduce timeliness
• Cost for quality maintenance :
• cost for source acquisition
• cost for high skilled resources
5 May 2010 13
A quality evaluation analysis of the Italian BR
on EGsSTEP = OUTPUT
USERS NEEDS • Inward FATS survey statistics
• International trade
• National Accounts
• EGR project
• Eurostat
• External users requests
5 May 2010 14
A quality evaluation analysis of the Italian BR
on EGs Conclusions
Strengths of Italian BR on EGs
• Standardized process • Integration and complementary of input sources • Data monitored annually by source and by step process
Weakness• Change in data providers • Stakeholders needs• Timeliness• Human resources
Solutions• good relationship / maintenance of stability and continuity of the data flow• active role of Istat with administrative bodies detaining data
5 May 2010 15
Thank you for your attention
For further information:
Fulvia Cerroni: [email protected]
Serena Migliardo: [email protected]
Enrica Morganti: [email protected]