measuring the impact of the cultural dimension in international development

Arts

Measuring the impact of the cultural dimension in international development

Dr Vicki-Ann Ware, School of Music – Conservatorium, Monash UniversityKim Dunphy, Deakin University3-4 May 2012

2

Setting the scene

3rd May 2012Measuring the impact of the arts in ID

3

Today: measuring the impact of the cultural activities in ID

Focus on measuring the impact of the arts in ID

Why are we interested in this?

Caveats:

– Arts ≠ culture; one subset– Work in progress feedback welcome!

3rd May 2012Measuring the impact of the arts in ID

4

Outline of presentation

Description of initial project leading to this exploration of measurement

Case studies

Some possible explanations

Thoughts going forward

3rd May 2012Measuring the impact of the arts in ID

5

Systematic review

3rd May 2012Measuring the impact of the arts in ID

6

Systematic review Methods

Progress to date

– Identified 214 articles thus far – 24 evaluations– 37 alternative research/critique– 80 case studies– 26 policy documents– 25 practice/process issues– ~ 40 articles analysed thus far

Discovery: measurement issues

3rd May 2012Measuring the impact of the arts in ID

7

Case studies

3rd May 2012Measuring the impact of the arts in ID

8

Case study (1)Braden, S. and M. Mayo (1999). "Culture, community development and

representation." Community Development Journal 34(3): 191-204.

Clear theory of change

Project designed, based upon the evidence underpinning this theory of change

Case study clearly describes population involved, process and outcomes effective, rigorous

However:

– No tool for measuring extent of effectiveness.– Not experimental design ...yet....

3rd May 2012Measuring the impact of the arts in ID

9

Case study (2)Nogueira, M. P. (2006). "Reflections on the impact of a long term theatre

for community development project in Southern Brazil." Research in Drama Education: The Journal of Applied Theatre and Performance 11(2): 219-234.

This study: two projects, two approaches in one location

Research question: what are the benefits of long-term theatre practice in this community?

Approach one: cultural renewal (based on Krugli and Dasté)

Approach two: Theatre for Development, based on Freire and Boal

Data collected through interviews

A range of challenges and positive changes documented.

Voice of community privileged in assessing research question.3rd May 2012Measuring the impact of the arts in ID

10

Case study (3)

Assertions with no evidence

No critical reflection on artistic practices or outcomes

3rd May 2012Measuring the impact of the arts in ID

11

Some possible explanations

3rd May 2012Measuring the impact of the arts in ID

12

Why don’t artists measure the impacts of their work?

Resourcing

Training

Worldview

Issues with research methodologies

3rd May 2012Measuring the impact of the arts in ID

13

Are research methods part of the problem?

Community arts is about process at least as much as product

need methods which explore processes more than products

Community arts do not start with a hypothesis to be (dis)proved

3rd May 2012Measuring the impact of the arts in ID

14

Why is this important?

Purpose of measurement

Building profile and developing integral place for arts in ID

Improving resourcing for arts in ID

3rd May 2012Measuring the impact of the arts in ID

15

Conclusions

3rd May 2012Measuring the impact of the arts in ID

16

Final thoughts

We know intuitively that the arts can be powerful, but the evidence is weak.

Values alignment....

This evidence needs to be strengthened....

3rd May 2012Measuring the impact of the arts in ID

3rd May 2012Measuring the impact of the arts in ID 17

Any comments or questions?

Contact details:

Vicki-Ann Ware: vicki-ann.ware@monash.edu