what happens next? strategies for building and assessing the long-term impact of research projects
TRANSCRIPT
![Page 1: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/1.jpg)
What happens next? Strategies for building and assessing the long-term impact of research projects
Closing keynote presentation
8th International Conference on Qualitative and Quantitative Methods in Libraries
27th May 2016
Dr Hazel HallProfessor of Social Informatics
@hazelh
![Page 3: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/3.jpg)
www.napier.ac.uk/iidi
Page 3
@hazelh
#QQML2016
![Page 4: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/4.jpg)
www.napier.ac.uk/iidi
Page 4
Impact
![Page 5: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/5.jpg)
www.napier.ac.uk/iidi
Page 5
![Page 6: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/6.jpg)
www.napier.ac.uk/iidi
Page 6
![Page 7: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/7.jpg)
www.napier.ac.uk/iidi
Page 7
http://jis.sagepub.com/content/42/3/369.abstract
![Page 8: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/8.jpg)
www.napier.ac.uk/iidi
Page 8
![Page 9: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/9.jpg)
www.napier.ac.uk/iidi
Page 9
![Page 10: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/10.jpg)
www.napier.ac.uk/iidi
Page 10
![Page 11: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/11.jpg)
www.napier.ac.uk/iidi
Public engagement and impact
Page 11
![Page 12: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/12.jpg)
www.napier.ac.uk/iidi
Page 12
![Page 13: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/13.jpg)
www.napier.ac.uk/iidi
Public engagement is not impact
Page 13
![Page 14: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/14.jpg)
www.napier.ac.uk/iidi
Page 14
![Page 15: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/15.jpg)
www.napier.ac.uk/iidi
Page 15
To what extent do our services meet these
particular (information) needs?
How does the use of our services have a wider impact
on our users?
What is the value of our services (in general)?
In LIS: impact understood in terms of service value
![Page 16: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/16.jpg)
www.napier.ac.uk/iidi
Page 16
How should we evaluate academic impact in general
(bibliometrics)?
To what extent does LIS research influence LIS
practice?
How should we evaluate library and information
services?
In LIS impact as a theme of study
![Page 17: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/17.jpg)
www.napier.ac.uk/iidi
Page 17
What can we do to ensure that our research has an
impact on practice?
Today’s agenda: impact as integral part of research activity
How can you design a study to measure impact? Show us the evidence!
![Page 18: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/18.jpg)
www.napier.ac.uk/iidi
Page 18
To facilitate a co-ordinated and strategic approach to LIS research across the UK (2009-2012)
![Page 19: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/19.jpg)
www.napier.ac.uk/iidi
Page 19
To facilitate a co-ordinated and strategic approach to LIS research across the UK (2009-2012)
To explore the extent to which LIS research projects influence practice (2011)
To create outputs to support the use and execution of research by librarians and information scientists (2012)
To develop a UK-wide network of LIS researchers (2011-2012)
![Page 20: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/20.jpg)
www.napier.ac.uk/iidi
Page 20
What can we do to ensure that our research has an
impact on practice?
Today’s agenda: impact as integral part of research activity
How can you design a study to measure impact? Show us the evidence!
![Page 21: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/21.jpg)
www.napier.ac.uk/iidi
Page 21
To explore the extent to which LIS research projects influence practice (2011)
To create outputs to support the use and execution of research by librarians and information scientists (2012)
![Page 22: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/22.jpg)
www.napier.ac.uk/iidi
Page 22
Recommendations derived from:
Literature reviewPractitioner poll (200)‘Impactful’ project case studies (5)Sector-specific focus groups (3)
Public Academic Healthcare
Validation survey (213)
![Page 23: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/23.jpg)
www.napier.ac.uk/iidi
Page 23
Recommendations for researchers:
Seek high-profile sponsorship and on-going support of projectsConduct sector-specific studies of direct relevance to particular groupsEngage practitioners in project design and implementationDeploy dissemination strategies that align with how and where practitioners consume new information
Create teaching and community support materials
Publish in non-academic titles using clear language
![Page 24: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/24.jpg)
www.napier.ac.uk/iidi
Page 24
![Page 25: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/25.jpg)
www.napier.ac.uk/iidi
Page 25
http://lisresearch.org/rilies-project
![Page 26: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/26.jpg)
www.napier.ac.uk/iidi
Page 26
What can we do to ensure that our research has an
impact on practice?
Today’s agenda: impact as integral part of research activity
How can you design a study to measure impact? Show us the evidence!
![Page 27: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/27.jpg)
www.napier.ac.uk/iidi
Page 27
To develop a UK-wide network of LIS researchers (2011-2012)
![Page 28: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/28.jpg)
www.napier.ac.uk/iidi
DREaM events and reach
Page 28
Five events
2 conferences3 linked workshops – for the ‘cadre’ of DREaMers213 participants, 33 presenters
Remote audience
~80 blog posts~800 tweetsMultiple web pages, SlideShares, SoundClouds, Vimeos etc.
![Page 29: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/29.jpg)
www.napier.ac.uk/iidi
Page 29
Expert-led research methods training:
• 3 workshops• 12 sessions
![Page 30: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/30.jpg)
www.napier.ac.uk/iidi
Page 30
Dissemination of research:
• Unconference half hours at workshops
• One minute madness at conferences
![Page 31: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/31.jpg)
www.napier.ac.uk/iidi
DREaM impact in 2012
Page 31
Growth in knowledge and expertise in research skills
Substantial growth in theoretical knowledge Modest increase in application of new skills Greater confidence as researchersWidened networks
Brettle, A., Hall, H., & Oppenheim, C. (2012). We have a DREaM: the Developing Research Excellence and Methods network. Paper presented at the 4th International Conference on Qualitative and Quantitative Methods in Libraries, Limerick, Ireland, 22-25 May 2012.
![Page 32: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/32.jpg)
www.napier.ac.uk/iidi
DREaM impact to 2015: anecdotal evidence
Page 32
Development of new resources
Research, evaluation and audit, Facet, 2013First editor was a DREaMerA third of the book’s authors had some involvement with the LIS Research Coalition
Events
Organised by DREaMersParticipation from others who were associated with the project
But what else?Particular interest in less visible impact
![Page 33: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/33.jpg)
www.napier.ac.uk/iidi
Page 33
Have the DREaM workshop participants innovated in the
workplace since 2012?
Has their post-DREaM research determined services provision, or
influenced the LIS research agenda?
To what extent can they point to any impact of their post-DREaM research on end-
user communities?
Has DREaM network participation opened up new
opportunities for their research?
Do they continue to operate as a network?
![Page 34: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/34.jpg)
www.napier.ac.uk/iidi
Page 34
Survey distributed to workshop participants:
• Population of 35• Completion by 32
Work undertaken in 2015: survey
![Page 35: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/35.jpg)
www.napier.ac.uk/iidi
Work undertaken in 2015: focus groups
Page 35
10 participants
4 in Edinburgh6 in London
![Page 36: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/36.jpg)
www.napier.ac.uk/iidi
Page 36
https://hazelhall.org/2015/06/22/dream-again-project-launch/
![Page 37: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/37.jpg)
www.napier.ac.uk/iidi
Page 37
Have the DREaM workshop participants innovated in the
workplace since 2012?
Has their post-DREaM research determined services provision, or
influenced the LIS research agenda?
To what extent can they point to any impact of their post-DREaM research on end-
user communities?
Has DREaM network participation opened up new
opportunities for their research?
Do they continue to operate as a network?
![Page 38: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/38.jpg)
www.napier.ac.uk/iidi
Page 38
YES!
‘[I have used this session] to inform consultancy work with
clients. It highlighted a number of issues and
prompted me to research further.’
‘Although I have not used this in my own research...this
has been really helpful in allowing me to understand
and participate in discussions about research methods.’
![Page 39: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/39.jpg)
www.napier.ac.uk/iidi
Page 39
Have the DREaM workshop participants innovated in the
workplace since 2012?
Has their post-DREaM research determined services provision, or
influenced the LIS research agenda?
To what extent can they point to any impact of their post-DREaM research on end-
user communities?
Has DREaM network participation opened up new
opportunities for their research?
Do they continue to operate as a network?
![Page 40: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/40.jpg)
www.napier.ac.uk/iidi
Page 40
YES!
50% actively involved in research
Themes: information literacy, policy, health, cultural heritage, data mining, data protection,
economics, education, employability, knowledge
management, law, politics, psychiatry, social justice
Claims of 12 participants that 40 of 87 outputs have informed
policy (20), determined services provision (23), developed LIS research agenda (15), all 3 (5)
![Page 41: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/41.jpg)
www.napier.ac.uk/iidi
Page 41
Majority:
• Internal presentations• Blogs and social media• Journal publications• Peer review service
![Page 42: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/42.jpg)
www.napier.ac.uk/iidi
Page 42
Have the DREaM workshop participants innovated in the
workplace since 2012?
Has their post-DREaM research determined services provision, or
influenced the LIS research agenda?
To what extent can they point to any impact of their post-DREaM research on end-
user communities?
Has DREaM network participation opened up new
opportunities for their research?
Do they continue to operate as a network?
![Page 43: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/43.jpg)
www.napier.ac.uk/iidi
Page 43
We have examples
Understanding of student use of learning spaces changes to physical environment within
academic library
Articulation of information literacy priorities public library
participation in the discourse
![Page 44: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/44.jpg)
www.napier.ac.uk/iidi
Page 44
Have the DREaM workshop participants innovated in the
workplace since 2012?
Has their post-DREaM research determined services provision, or
influenced the LIS research agenda?
To what extent can they point to any impact of their post-DREaM research on end-
user communities?
Has DREaM network participation opened up new
opportunities for their research?
Do they continue to operate as a network?
![Page 45: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/45.jpg)
www.napier.ac.uk/iidi
Page 45
DREaM contributed to the development of my research capability and profile and has
influenced my decision to seek a stronger academic role.
Involvement in the project helped me develop confidence as an LIS researcher to go on to write successful bids and be
an active part of the LIS research community.
YES!
![Page 46: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/46.jpg)
www.napier.ac.uk/iidi
Page 46
17 job changes - and participation in the DREaM project was a factor in 11
(NB correlation between number of research outputs and
likelihood of changing role)
I have been promoted… This required a considerable
research portfolio and DREaM has contributed to this. Furthermore [two cadre
members] provided references.
DREaM gave me the confidence to go for more
senior roles, and gave me a thorough background
knowledge in research.
![Page 47: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/47.jpg)
www.napier.ac.uk/iidi
Page 47
Have the DREaM workshop participants innovated in the
workplace since 2012?
Has their post-DREaM research determined services provision, or
influenced the LIS research agenda?
To what extent can they point to any impact of their post-DREaM research on end-
user communities?
Has DREaM network participation opened up new
opportunities for their research?
Do they continue to operate as a network?
![Page 48: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/48.jpg)
www.napier.ac.uk/iidi
Page 48
YES!
Majority (22) maintain social and work ties
All but one of the rest maintain either social
or work ties
12 active collaborators on 37 initiatives
Collaborators most productive: 70% research outputs
The higher the number of work-related ties,
the greater the quantity of research
outputs
![Page 49: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/49.jpg)
www.napier.ac.uk/iidi
Page 49
Other forms of impact from DREaM
Delivery of events
Format, e.g. lecture-workshop switchDelegate participation, e.g. One Minute MadnessSpeaker participation, e.g. widened pool
Reporting of events
Deployment of social media
![Page 50: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/50.jpg)
www.napier.ac.uk/iidi
Page 50
What can we do to ensure that our research has an
impact on practice?
Mission accomplished?
How can you design a study to measure impact?
Find advice in 11 recommendations of the RiLIES
project
DREaM Again as a worked case study
![Page 51: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/51.jpg)
www.napier.ac.uk/iidi
Page 51
Over to you!
![Page 52: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/52.jpg)
www.napier.ac.uk/iidi
Contact Hazel Hall
Page 52
@hazelhhttp://hazelhall.orghttp://about.me/hazelh
[email protected]+44 (0)131 455 2760
Slides on SlideShare at:http://slideshare.net/hazelhall
![Page 53: What happens next? Strategies for building and assessing the long-term impact of research projects](https://reader036.vdocuments.mx/reader036/viewer/2022070516/587560371a28ab00528b704f/html5/thumbnails/53.jpg)
What happens next? Strategies for building and assessing the long-term impact of research projects
Closing keynote presentation
8th International Conference on Qualitative and Quantitative Methods in Libraries
27th May 2016
Dr Hazel HallProfessor of Social Informatics
@hazelh