experimentation by design: perspectives from research · lucy kimbell innovation insights hub, ual...
TRANSCRIPT
![Page 1: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/1.jpg)
Lucy Kimbell Innovation Insights Hub, UAL
@lixindex [email protected]
Experimentation by Design: Perspectives from research
Danish Design Centre Copenhagen, December 2017
![Page 2: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/2.jpg)
h"p://www.behaviouralinsights.co.uk/publica7ons/applying-‐behavioural-‐insights-‐to-‐organ-‐dona7on/
Growing visibility of ‘experimentation’ in policy development
![Page 3: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/3.jpg)
Prototyping and mock-ups of concepts are one kind of ‘experimentation’ in policy development
h"ps://openpolicy.blog.gov.uk/2015/10/15/go-‐science-‐workshops-‐for-‐the-‐future-‐of-‐ageing/
![Page 4: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/4.jpg)
Prototyping and mock-ups of concepts originate in the culture of the design studio
![Page 5: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/5.jpg)
The culture of the design studio is tied to consumer product design
![Page 6: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/6.jpg)
h"p://www.samsung.com/global/galaxy/galaxystory/s6-‐inside-‐stories/ux/
Software and hardware prototyping is rooted in engineering design which can be more formal and structured
![Page 7: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/7.jpg)
h"p://liveworkstudio.com/approach/
With complex systems and services, what does ‘prototyping’ look like?
![Page 8: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/8.jpg)
What if anything is distinctive about ‘experimentation’ in the culture of design? What concepts help explain it?
Abduc7on
Inven7veness
Expandable ra7onality
The studio as centre of synthesis
![Page 9: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/9.jpg)
Abduction
h"ps://philosophyisnotaluxury.com/2013/12/01/the-‐holis7c-‐evolu7on-‐of-‐charles-‐sanders-‐peirce/
![Page 10: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/10.jpg)
Abduction
“At the point of being surprised by a surprising fact, if we can make a guess, any guess, we can make progress.” C.S.Pierce cited in Hansen, Hans. (2008). Abduc7on. In Barry, David and Hansen, Hans (eds). The Sage Handbook of New Approaches in Management and Organiza7on. p.457
![Page 11: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/11.jpg)
Abduction
“Something unintelligible is discovered in the data and, on the basis of the mental design of a new rule, the rule is discovered or invented and, simultaneously, it becomes clear what the case is.” Reichertz, Jo. (2010). Abduc7on: The Logic of Discovery of Grounded Theory. Forum: Qualita7ve Social Research. 1(13).
![Page 12: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/12.jpg)
Design abduction
Dorst 2015
![Page 13: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/13.jpg)
Abduction
Kimbell 2015
![Page 14: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/14.jpg)
Inventiveness is not the novelty of ideas or methods in themselves, but in the novelty of the arrangements with other objects and activities within which artefacts and instruments are situated, and might be situated in the future
Celia Lury & Nina Wakeford, 2012, Inventive Methods
Inventiveness
![Page 15: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/15.jpg)
Learning devices Things to learn about what has to be learned or could be learned
Hatchuel, A. (2001) “Towards design theory and expandable rationality: The unfinished programme of Herbert Simon.” Journal of Management and Governance, 5, 3-4, 260-273
Expandable rationality
Social interactions Understanding and designing the social interactions of a design process is an essential part of the design process itself
Expansions of initial concepts Unexpected designs can emerge from the process
![Page 16: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/16.jpg)
The studio as a centre of synthesis
Wilkie, A. and Michael, M. (2015). The design studio as a centre of synthesis. In Wilkie, A. Farias, I.. Studio Studies: Operations, Topologies and Displacements. Routledge.
![Page 17: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/17.jpg)
Opening up possibili7es
Experimentation by design =
Expanding ini7al concepts
Using learning devices
Synthesising many diverse knowledges and perspec7ves
Designing the social interac7ons of the design process itself
Being ‘usefully vague’
Making a guess to move things on
![Page 18: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/18.jpg)
@PolicyLabUK
A brief case study based on the first year of the Policy Lab team in the Cabinet Office of the UK Government
![Page 19: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/19.jpg)
Collabora've explora'on of issues
Designing the social interac7ons of the design process itself
Expanding ini7al concepts
Making a guess to move things on
Being ‘usefully vague’
Synthesising many diverse knowledges and perspec7ves
![Page 20: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/20.jpg)
Par'cipatory conversa'ons about future prac'ces
Designing the social interac7ons of the design process itself
Being ‘usefully vague’
![Page 21: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/21.jpg)
h"ps://openpolicy.blog.gov.uk/2015/10/15/go-‐science-‐workshops-‐for-‐the-‐future-‐of-‐ageing/
Rapid idea genera'on and model making
Using learning devices
Expanding ini7al concepts
Making a guess to move things on
Synthesising many diverse knowledges and perspec7ves
![Page 22: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/22.jpg)
Credit: Policy Lab
Using learning devices
Expanding ini7al concepts
Involving par'cipants in an issue in genera'ng ideas
Designing the social interac7ons of the design process itself
![Page 23: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/23.jpg)
Early prototyping of mock-‐up solu'ons with users/delivery
Using learning devices
Designing the social interac7ons of the design process itself
Expanding ini7al concepts
Synthesising many diverse knowledges and perspec7ves
Credit: Policy Lab
![Page 24: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/24.jpg)
Theory of the world/theory of knowledge
Logic
What it does
Complexity
Focus
Cri=cal success factors
Exper=se required
Investment required
Outcomes
Abduc7ve Deduc7ve/induc7ve Uses learning devices to build confidence in a direc7on of travel, generates insights (proto-‐theories), expands/opens up new possibili7es
Uses randomised comparisons to confirm or disprove hypothesis, informed by exis7ng evidence/theory
Many variables and dependencies Fewer variables and dependencies
Holis7c Specific
Selec7ng the mix of concepts, sites and par7cipants to be involved; leadership to create the space for experimenta7on and respond to what is opened up
Iden7fying the underlying theory and research ques7ons; elec7ng the variables and test sites; leadership to create the space for experimenta7on
Par7cipatory design; design research; anthro-‐design
Experimental social science
Lower investment in 7me and resources; possible reputa7onal risk
Higher investment in 7me and resources; lower reputa7onal risk as ‘scien7fic’
Pausible solu7ons; insights about the fit/lack of fit with the site/prac7ces; new possibili7es not previously imagined
Reliability (eg it works in other sites) and validity (eg explicit theories are tested using agreed protocols) but few new insights
Early stage prototyping RCTs
Comparison of two kinds of experimenta'on in policy development
The world results from our ac7ve construc7on of it; we make and interpret knowledge as social beings
The world exists ‘out there’ independent of us; general laws exist and you can observe reality to test them
Lucy Kimbell. 2017. Drah
![Page 25: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/25.jpg)
Early explora=on of issues/user contexts generates insights and concepts that can be refined and further tested at scale before implementa=on
RCT
Ways to combine experimenta'on in policy development
There are some fundamental incompa7bili7es at the level of theories of the world and theories of knowledge, but different approaches to experimenta7on rooted in design and in RCTs can be combined.
Explora'on to confirma'on
Parallel experimenta'on
Early stage prototyping
RCT
Refining for implementa'on
RCT
+
Running both approaches in parallel allows new possibili=es to be explored and developed alongside building evidence at scale
New insights, new concepts, new possibili'es
Prototyping
New insights, new concepts, new possibili'es
Evidence at scale
Evidence at scale
Organia'onal learning, new possibili'es, evidence at scale
Evidence at scale
Prototyping details of user interac=ons with touchpoints aGer RCT builds holis=c understanding of a solu=on
Early stage prototyping
Lucy Kimbell. 2017. Drah
Holis'c evidence for implementa'on
![Page 26: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/26.jpg)
Some questions
![Page 27: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/27.jpg)
h"p://www.samsung.com/global/galaxy/galaxystory/s6-‐inside-‐stories/ux/
What comes with the culture of ‘agile’ policy making rooted in the ‘new spirit of capitalism’?
![Page 28: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/28.jpg)
Are people from design culture equipped to design the right experiments in policy or strategic settings?
![Page 29: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/29.jpg)
How can large organisations develop design capacities alongside other kinds of experimentation?
![Page 30: Experimentation by Design: Perspectives from research · Lucy Kimbell Innovation Insights Hub, UAL @lixindex l.kimbell@arts.ac.uk Experimentation by Design: Perspectives from research](https://reader031.vdocuments.mx/reader031/viewer/2022022608/5b8be5bb09d3f23b638c223a/html5/thumbnails/30.jpg)
How do organisational routines shaping professions, rewards and competences enable or disable experimentation?