UKOLN is supported by:

Evidence, Impact, Metrics

Institutional and Social Web Services: Evidence for Their Value

WelcomeBrian Kelly

UKOLN

University of Bath

Bath, UK

http://www.ukoln.ac.uk/web-focus/events/workshops/eim-2010-12/http://www.ukoln.ac.uk/web-focus/events/workshops/eim-2010-12/

This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence (but note caveat)

Acceptable Use PolicyRecording this talk, taking photographs, discussing the talk using Twitter, IM, etc. is permitted if distractions to others are minimised.

Acceptable Use PolicyRecording this talk, taking photographs, discussing the talk using Twitter, IM, etc. is permitted if distractions to others are minimised.

Twitter:#ukolneim

Blogs: Twitter:http://ukwebfocus.wordpress.com/ @briankellyhttp://blogs.ukoln.ac.uk/evidence-impact-metrics/ @ukwebfocus

2

About Me

Brian Kelly:• UK Web Focus: a national advisory post• Long-standing Web evangelist • Established Institutional Web Management

Workshop (IWMW) in 1997• Based at UKOLN at the University of Bath

UKOLN:• A national centre of expertise in digital

information management• Funded by the JISC• A JISC Innovation Support Centre

Intr

od

uct

ion

Evidence, Impact, Metrics

Evidence, Impact, Metrics (EIM):• UKOLN activity funded by the JISC

Aims to:• Explore ways of gathering evidence which

can demonstrate the impact of services and devise appropriate metrics to support such work

By:• A number of events• The EIM Blog

3

Evidence, Impact, Metrics

Areas of Work• Institutional Web services (November):

How can we demonstrate the effectiveness and impact of institutional Web services? What metrics are relevant? What concerns may there be?

• The Social Web (December):How can we demonstrate the effectiveness and impact of Social Web services? What metrics are relevant? What concerns may there be?

• ….4

Intr

od

uct

ion

5

Workshop Aims

By the end of the workshop we should have:• Discussed ways of gathering evidence to

demonstrate the value and impact of Social Web services.

• Identified ways that the value and impact can be measured and articulated to third parties

• Explored ways in which such measures can be standardised in order to provide level of consistency, whilst acknowledging institutional diversity

We should also:• Be in a position to develop and/or commission

work to gather and interpret evidence

Intr

od

uct

ion

The Context •The need to demonstrate value in light of Government cuts

6

Why?Why do we need to do this?

• (Respond to criticisms from others)

• Be able to demonstrate our value

• Be able to identify & address deficiencies

• …

7

Using Freedom of Information legislation the Telegraph discovered eight examples of universities spending between £100,000 and £280,000 on one-off website redesigns, as much as five times higher than the average spending.The average annual spending on the maintenance of a university website is £60,375. That figure excludes additional spending on one-off redesigns, for which the average spending is £60,882.The most expensive university website is the University of xxxx, which spent £278,094 on a redesign by Precedent Communications and Straker UK, completed in May 2008. The university also employs staff whose salaries cost £221,500 every year, in addition to £14,500 each year for software support.

Prisoner’s DilemmaWe can all benefit by:

• Sharing best practices• Sharing examples of flawed

approaches• Agreeing on ways forward

But concerns that:• We might be seen to be doing

badly• We want to learnt from others,

but not share our experiences

8

The aim is to demonstrate the value of institutional Web services across UK HE. That is a clear unambiguous message to sell (to e.g. THE)

Concerns

ProgrammeTime Content

10.00-10.20 Introduction

10.20-10.40 Case Study: What We’re Doing at the University of Bath. Alison Kerwin, University of Bath

10.40-11.00 Case Study: Should We Outsource? Assessing Costs and ROI. Stephen Emmott, LSE

11.00-11.20 Coffee

11.20-11.40 Impact and Revenue: Dashboard Approaches to Measuring Value: Ranjit Sidhu

11.40-12.30 Breakout Groups: Reviewing the Approach

12.30-13.30 Lunch

13.30-13.45 Beyond the Institution: Value of Cloud Services & the Social Web

13.45-14.25 Case Studies: Jeremy Speller & Sarah Sherman

14.25-15.00 Group Exercise

15.00-15.15 Coffee

15.15-15.50 Report Back & Action Plans

15.50-16.00 Conclusions 9

About You

In small groups cover:• Where you work• What you do• Your areas of interest• Specific issues would you like to see

addressed• Expertise you can contribute

10

E

11

Questions

Any questions or comments?

Reviewing Approaches

You have heard about:• Two case studies• A institutional dashboard approach to

monitoring value based on institutional priorities

You will now:• Identify the relevance of such approaches

for your institution• Explore limitations and benefits• Make recommendations for further work

12

13

Questions

Any questions or comments?

Action Plans

What Next? Building on Today’s Work• What will you do next?• What should your institution do next?• What related work needs to be done at a

regional or national level?

What Next? Additional Areas of Work• What additional areas could the EIM

activity address?

14 15.15-15.45

D