Download - The trouble with numbers
![Page 1: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/1.jpg)
Counting on confusion
Why no one knows how manypeople are visiting their websites
![Page 2: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/2.jpg)
What if everyone is wrong?
![Page 3: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/3.jpg)
The mystery emerges
• Boston.com, BostonHerald.com complain of lowballing
![Page 4: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/4.jpg)
The mystery emerges
• Boston.com, BostonHerald.com complain of lowballing
• Internal counts are three times higherthan Nielsen ratings
![Page 5: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/5.jpg)
The mystery emerges
• Boston.com, BostonHerald.com complain of lowballing
• Internal counts are three times higherthan Nielsen ratings
• Whose count is accurate? Agencies’ or content-providers’?
![Page 6: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/6.jpg)
Panel-based metrics
• Nielsen and comScore sample what sites audience is visiting
![Page 7: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/7.jpg)
Panel-based metrics
• Nielsen and comScore sample what sites audience is visiting
• Afternoon traffic is undercounted, local sites are a challenge
![Page 8: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/8.jpg)
Panel-based metrics
• Nielsen and comScore sample what sites audience is visiting
• Afternoon traffic is undercounted, local sites are a challenge
• Nielsen once gave washingtonpost.com 10m and comScore 17m
![Page 9: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/9.jpg)
Server-side metrics
• An actual count of incoming traffic.What could go wrong?
![Page 10: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/10.jpg)
Server-side metrics
• An actual count of incoming traffic.What could go wrong?
• Visitors are counted by device. Less accurateif they clear cookies.
![Page 11: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/11.jpg)
Server-side metrics
• An actual count of incoming traffic.What could go wrong?
• Visitors are counted by device. Less accurateif they clear cookies.
• No way of separating out robotic hitsfrom search engines
![Page 12: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/12.jpg)
What is a unique visitor?
• Most agree it is someone who visited once during time span
![Page 13: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/13.jpg)
What is a unique visitor?
• Most agree it is someone who visited once during time span
• Unique visitors per month is most common Internet traffic measure
![Page 14: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/14.jpg)
What is a unique visitor?
• Most agree it is someone who visited once during time span
• Unique visitors per month is most common Internet traffic measure
• Other measures: return visits, number of page views, time spent
![Page 15: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/15.jpg)
Dearth of free data
• Compete.com is best known, samples a panel of 2 million people
![Page 16: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/16.jpg)
Dearth of free data
• Compete.com is best known, samples a panel of 2 million people
• Quantcast gets good reviews from some, but code must be installed
![Page 17: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/17.jpg)
Dearth of free data
• Compete.com is best known, samples a panel of 2 million people
• Quantcast gets good reviews from some, but code must be installed
• Alexa provides a lotof data, but results seem very odd
![Page 18: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/18.jpg)
Was newspaper data better?
• No one knows how many people actually open up the paper
![Page 19: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/19.jpg)
Was newspaper data better?
• No one knows how many people actually open up the paper
• Multipliers of “readers” versus “subscribers”is highly suspect
![Page 20: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/20.jpg)
Was newspaper data better?
• No one knows how many people actually open up the paper
• Multipliers of “readers” versus “subscribers”is highly suspect
• Chicanery to make numbers look higheris not unusual
![Page 21: The trouble with numbers](https://reader031.vdocuments.mx/reader031/viewer/2022020101/5549a9acb4c90507608b56ba/html5/thumbnails/21.jpg)
Credits
• Much of this presentation is based on “Confusion Online: Faulty Metrics and the Future of Digital Journalism,” by Lucas Graves, John Kelly and Marissa Cluck, Tow Center for Digital Journalism, Columbia University Graduate School of Journalism, September 2010.