reflections on experiences in managing the piloting and evaluation phase of open source learning...

© 2009 NetSpot Pty Ltd

Piloting LMSenvironments in theHigher Education sectorMark Drechsler

Professional Services Manager

NetSpot Pty Ltd

© 2009 NetSpot Pty Ltd

Today’s Presentation

• A bit about NetSpot

• Open Source pilot experiences in the last year

• Supporting the case for change

• Critical success factors for LMS pilots

© 2009 NetSpot Pty Ltd

About NetSpot

© 2009 NetSpot Pty Ltd

Sakai Commercial Affiliate

Mahara Partner

Moodle Partner

Wimba Authorised Reseller

Partner

© 2009 NetSpot Pty Ltd

Pilot experiences in 2009

© 2009 NetSpot Pty Ltd

2009: Increased interest in piloting Open Source learning technologies.

© 2009 NetSpot Pty Ltd

What do we classify as a „Pilot‟?

“...small scale preliminary study conducted before the main research in order to check the feasibility or to improve the design of

the research”

- Wikipedia

© 2009 NetSpot Pty Ltd

Different kinds of pilots

Evaluation focus

• to support LMS selection process

Pre-implementation focus

• to help plan production deployment

© 2009 NetSpot Pty Ltd

Integration

Content migration

Technical evaluation

Hosting environment

Stakeholders

Support

Functional evaluation

Pilotconsiderations

© 2009 NetSpot Pty Ltd

Common trade off

Increased:

• Scope

• Stakeholder participation

• Integration

• Configuration

• t, $

• Evaluation data

© 2009 NetSpot Pty Ltd

Open Source vs Proprietary:

The flexibility of Open Source means that far more options are available for a pilot

© 2009 NetSpot Pty Ltd

A note on Sakai

In our experience, some technical configuration effort is required to showcase its true potential

© 2009 NetSpot Pty Ltd

The value of partnering

Partnering with an experienced services provider can:

• Reduce implementation time

• Avoid common mistakes

• Utilise existing knowledge

• Assist evaluation of partner services such as managed hosting and technical support

© 2009 NetSpot Pty Ltd

Supporting the case for change

© 2009 NetSpot Pty Ltd

An Open Source LMS can lead to...

... a re-think of teaching practice

© 2009 NetSpot Pty Ltd

An Open Source LMS can lead to...

... the use of the LMS for more than just teaching and learning

• Research

• Collaboration

• Networking

© 2009 NetSpot Pty Ltd

An Open Source LMS can lead to...

... an alignment of institutional culture to a community-driven product

© 2009 NetSpot Pty Ltd

Critical success factors

© 2009 NetSpot Pty Ltd

1. Clear governance

Including

• a Business Owner

• a project definition

• clearly defined roles and responsibilities

• Executive buy-in

© 2009 NetSpot Pty Ltd

2. Sound evaluation framework

Consider

• Pedagogical

• Support

• Integration

• Financial

• Strategic

Instruments such as surveys, observations, interviews, feature lists, TCO estimates

© 2009 NetSpot Pty Ltd

3. Stakeholder representation

Including

• Teaching and learning

• Technology

• Support staff

• Administrative staff

© 2009 NetSpot Pty Ltd

The biggest challenge?

Complex pilot that closely resembles the production environment, but that takes longer and costs more

Simple pilot that focuses on key

aspects, but that may leave gaps in

the evaluation process

© 2009 NetSpot Pty Ltd

Questions?