combining analytics and user research
DESCRIPTION
Presentation about combining analytics and user research, talk at UX Brighton event, 13 July 2010.TRANSCRIPT
![Page 1: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/1.jpg)
Combining Analytics and User Research
Alex TarlingUser Experience Consultant
![Page 2: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/2.jpg)
About the session:
Why is it good to combine methodologies?
Why doesn’t this commonly happen already?
Some opportunities to combine analytics and user research…
… some case studies and some hints and tips to get started!
![Page 3: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/3.jpg)
Who am I?
Freelance user experience consultant
12 years experience of design research, UX, information architecture
Projects for Intel, BBC, Nokia, Orange, New Look, Blacks, Millets etc
http://linkedin.com/in/alextarling
![Page 4: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/4.jpg)
User Experience Research
“User experience research is a collection of tools designed to help you find the boundaries of peoples needs and abilities“- Mike Kuniavsky
![Page 5: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/5.jpg)
User Experience Research
“User experience research is a collection of tools designed to help you find the boundaries of peoples needs and abilities“- Mike Kuniavsky
”The field of user experience, is blessed (or cursed) with a very wide range of research methods“- Christian Rohrer
![Page 6: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/6.jpg)
Web Analytics
"Web Analytics is the measurement, collection, analysis and reporting of Internet data for the purposes of understanding and optimizing Web usage.“- The Official WAA Definition of Web Analytics
![Page 7: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/7.jpg)
Why use a combination of methods?
”When all you have is a hammer, everything looks like a nail”- Abraham Maslow
![Page 8: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/8.jpg)
Why use a combination of methods?
All methods have strengths and weaknesses
Combining methods with different attributes allows us to:
Triangulate between the strengths of individual methods
Mitigate the weaknesses and risks of each
![Page 9: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/9.jpg)
Why are user research and analytics methods not routinely combined?
Because user research and analytics are often commissioned and actioned by very different functions in the organisation.
Because user research and analytics often happen at different stages in the product cycle.
Analytics developed in a context to measure against business-goals, whereas user research is deployed as an aspect of the customer experience.
![Page 10: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/10.jpg)
Attributes of different methods:
Observational User Research
Primarily qualitative: provides insights about users’ goals, motivations and attitudes
We can explore context and opportunities, and what doesn’t happen as well as what does happen
But, small sample sizes and high cost means we end up with a snapshot in time, and specific demographics. Lab settings can also be problematic
So, observational findings open to challenge / multiple interpretation
Web Analytics
Quantitative and based in real-world data – talks about what is happening.
Large sample sizes mean high degrees of confidence
But, interpretation of behavioural aspects is hard without additional customer insight
Where we predefine measures, prior assumptions about meaning and significance can become entrenched
![Page 11: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/11.jpg)
Design of Terminal 5 - Risks of insight research…
![Page 12: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/12.jpg)
Quantitative methods also have down sides...
”Not everything that can be counted counts; and not everything that counts can be counted ”- Albert Einstein
![Page 13: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/13.jpg)
We have ‘abandonment’ issues…
www.shopsafe.co.uk/news/online-shopping-cart-abandonment-analysed-by-royal-mail/10098
![Page 14: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/14.jpg)
We have ‘abandonment’ issues…
www.shopsafe.co.uk/news/online-shopping-cart-abandonment-analysed-by-royal-mail/10098
… assumptions about the implications of ‘abandonment’ don’t talk to real-world customer experience…
![Page 15: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/15.jpg)
We have ‘abandonment’ issues…
(econsultancy.com/blog)
![Page 16: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/16.jpg)
We have ‘abandonment’ issues…
= Still missing the opportunity to genuinely explore and design for customer experience!
![Page 17: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/17.jpg)
Opportunity 1:
Use customer insight data to inform analytics measures So that analytics reporting genuinely
reflects and supports the customer experience, not just the business goals
![Page 18: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/18.jpg)
Opportunity 1: use customer insight data to inform analytics measures
Deliver actionable analytics metrics from your customer research insights
(because user research and analytics often happen at different stages in the product cycle)
Broker communication and collaboration across informational silos, and between phases in the product lifecycle
(because user research and analytics are often commissioned and actioned by very different depts.)
How to get started:
![Page 19: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/19.jpg)
Opportunity 2:
Use analytics data to drive the user research programme
![Page 20: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/20.jpg)
E-commerce redesign project:
Driving the user research programme from analytics data
![Page 21: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/21.jpg)
Opportunity 2: use analytics data to drive the user research programme
Just do it! You can do a lot with even basic
levels of analysis Think laterally about the sources of
data that are available Commission specific analysis of
existing data sources
How to get started:
![Page 22: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/22.jpg)
Opportunity 3:
Integrate analytics and user research to optimise the user experience throughout the product lifecycle
![Page 23: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/23.jpg)
The Open University
support for new distance learners:
![Page 24: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/24.jpg)
Opportunity 3: Integrate analytics and user research to optimise user experience throughout the product lifecycle
Ongoing use of analytics to discover and target behaviors or
interactions for the research programme to ‘evidence’ user research insights
Rapid iterations of ‘fast’ user research interventions Targeted against specific analytics findings to generate insights and use-cases for
development
Integration means adapting the product lifecycle to support continual innovation ‘Launch early and listen’ and agile
strategies
How to get started:
![Page 25: Combining analytics and user research](https://reader035.vdocuments.mx/reader035/viewer/2022070304/54c7fa884a795954348b4615/html5/thumbnails/25.jpg)
In summary
Opportunity 1: use customer insight data to inform analytics measures
Opportunity 2: use analytics data to drive the user research programme
Opportunity 3: integrate analytics and user research to optimise user experience throughout the product lifecycle
Thanks!