f7-65*0/3&1035...although online audience feedback forms are available their use did not provide...

eVALUATION REPORT 2019/20

INTRODUCTION

This report refers to events and act iv i t iesproduced by DOCA for the act iv i typer iod 01/04/19 - 15/05/20.

It refers specif ical ly to data col lect ionalong with audience and volunteer(Fest ival Maker) feedback, col lected,col lated and analysed at the fo l lowingevents: Devizes Carnival, Picnic in the Park,Devizes International Street Festival,Colour Rush, Confetti Batt le, t icketedshows and Festival of Winter Ales

METHODOLOGY

Who we work with (people)The nature, qual i ty, access ibi l i ty and impact of ourwork.

the aims of our monitor ing and evaluat ion seeksfeedback on:

The system of data col lect ion and feedback up to andincluding the t icketed shows descr ibed fol lowed theprocedures and forms that had been adopted pr ior tothe appointment of the Development Manager in June.Although onl ine audience feedback forms are avai labletheir use did not provide many responses, the vastmajor i ty of data col lected was via face to facequest ionnaires. The summer events were used to lookat the systems effect iveness in order to review andimprove our evaluat ion methods which would inform anew evaluat ion plan and strategy. We tr ia l led var iouscreat ive ways of data gather ing giv ing usefulsnapshot data or col lected informat ion in moreeff ic ient ways than c l ipboard surveys.

OUR ORGANISATION

The management of our organisat ion is overseen by 6Volunteer Trustees, a l l res idents of Wi l tshire andhave expert ise needed to ensure the successfulrunning of DOCA complying with char ity law.

3 part-t ime profess ional staff del iver the day to daywork in the equivalent of 7 .5 day working week, withaddit ional staff being brought in on a task and f in ishbasis such as Volunteer Co-ordinators, GraphicDesigners or Workshop Leaders.

Our Volunteers or Fest ival Makers jo in us for specif ictasks or events throughout the year. Dur ing th isf inancial year we clocked a total of 453 volunteershifts (of 4 hours or more)

We recruited 12 new Volunteer Fest ival Makersdur ing the project per iod and worked with twostudent placements over four-week per iods. We have73 act ive Fest ival Makers taking into considerat ionhaving also lost 5 due tp i l l health and change ofcircumstance. We worked with one work exper iencestudent from Devizes School and one UndergraduateStudent Placement from UWE dur ing 2019

OUR AUDIENCES

Our data shows either an increase or no change inattendance from 2018 for a l l events other than theInternat ional Street Fest ival Sunday only and theCarnival . The decrease in attendance at the Street Fest ivalon Sunday may have been due to extremely h ightemperatures and lack of shade on the Green. Our target for Carnival audience was not met. Webel ieve th is was s ignif icant ly impacted by the datechange which was apposed by many localtradit ional ists .We saw an increase in new attendees from thePewsey area, poss ibly result ing from acol laborat ion with Ginkgo Projects and the NewKings Carnival Project . Our audience numbers for indoor shows saw asignif icant increase - poss ibly due to lower t icketpr ices and increased market ing. Colour Rush and Confett i Batt le saw a s ignif icantgrowth in numbers - th is would have been impactedby the date change. Town centre audiences are measured throughsurvel l ience cameras analyt ics .

AUDIENCES IN NUMBERS

Carniva

l

Picnic

Int St. F

est

Confetti B

attle

ticke

ted sh

ows

Fest. W

inter A

les

Lanter

n Parade

20,000

15,000

10,000

5,000

0 Carnival 2018 Picnic 2018 Int. St. Fest 2018 Confetti Battle 2018 ticketed shows 2018 Fest. Winter Ales 2018 Lantern Parade

20,000

15,000

10,000

5,000

0 Item 1 Item 2 Item 3 Item 4 Item 5 Item 6 Item 7

20,000

15,000

10,000

5,000

0

Target for 2019Attendance 2018 Attendance 2019

UNDERSTANDING OUR REACH

We like to know where are audiences are from. These pins showaudience locality for all our events based on information collected.We know that different events appeal to different audiencedemographics.

This information helpsus to understand thepotential to expandour reach and targetour marketing moreeffectively.

We are now betterequipped to talk topotential partnersand sponsors andmake a stronger casewhich will appeal tothose consideringadvertising with us.

AUDIENCE ORIGINS

It is clear there is potential to attract audiences fromoutside Devizes, particularly villages in the wider AreaBoard boundary.It is important to retain our local audiences and give themnow and inspiring creative offers. With no railway station and poor public transport links tonearby towns and cities of Bath and Bristol we have tofocus on independently mobile audiences. There is potential to explore ways to coordinate grouptravel from nearby towns. Devizes is developing a reputation for tourism, our datashows that substantial audience members are visitorsrather than residents - there is scope to deepenrelationships with hospitality and tourism providers.

A total of 226 payingattendees at ticketedevents as part of 2019Festival Fortnight, with70 comps given tosponsors & supporters

42% of our audienceat We are Bronte hadnever attended a DOCAticketed show in thepast


Devizes Town38%

2 - 4 miles from Devizes32%


10 - 24 miles 10%

CARNIVAL

PICNIC IN THE PARK

Devizes Town45%


4 - 10 miles 7%

At each event we took a sample survey to work out the distancespeople travel to get to us and their age group. This helps usunderstand who the event appeals to so we can taylor ourcommunications appropriately.

We collected 107postcodes atCarnival


Devizes Town47%



10 - 24 miles 6%

INTERNATIONAL STREETFESTIVAL

CONFETTI BATTLE

Devizes Town37.6%

2 - 4 miles from Devizes37.6%


10 - 24 miles 3.2%

We collected 262postcodes atStreet Fest


Devizes Town47%



10 - 24 miles 6%

COLOUR RUSH

FESTIVAL OF WINTER ALES



Devizes Town22.2%


We collected 116postcodes atColour Rush

18 - 24 25 - 34 35 - 44 45 - 54 55 - 64 Over 65

30

20

10

0

18 - 24 25 - 34 35 - 44 45 - 54 55 - 64 Over 65

25

20

15

10

5

0

Our capacity to collect data varies at each event. The following data shows thebreakdown of audience age group at each event according to our survey sample.Ticketed events such as Colour Rush are 100% acurate, others are taken from asample of the audience through surveys.

UNDERSTANDING OUR AUDIENCES

CARNIVAL

CONFETTI BATTLE " Wowzers!! This is new!And different!!" (fromWestbury)

UNDERSTANDING OUR AUDIENCES

18 - 24 25 - 34 35 - 34 45 - 54 55 - 64 Over 65

30

20

10

0

18 - 24 25 - 34 35 - 44 45 - 54 Over 65

25

20

15

10

5

0

COLOUR RUSH


"Plan to come again evenafter we’ve moved upnorth. Entertainment

excellent

"We're new to Devizes andeverything we’ve been to is

fun interesting andinspirational. Thank You."

Understanding how our audiences view our events is important tous, we use it to ensure our future planning evolves and responds

to their preferences. Audience reaction to the quality of our workand their experience at our events is collected through paper

questionnaires. Where rating has been cited as poor we have seenspecific comments relating to this.

Excellent/good83.6%

So-so7.3%

9.1%PICNIC IN THE PARK - MUSIC

Excellent/good90.9%

9.1%

OUR AUDIENCE EXPERIENCE

we asked 30 people what their opinion of

the quality of the music was at the event.

This represents 3% of our audience


the quality of the creative workshops was

at the event. This represents 33% of our

audience

PICNIC IN THE PARK - WORKSHOPS


Excellent or good83.6%

So-so7.3%

9.1%

Excellent/good

95%

So-so

5%

PICNIC IN THE PARK - PERFORMANCE


the quality of the performance at the

event. This represents 3% of our audience


the quality of our indoor ticketed event 'we

are bronte' which was sold out. our sample

represents 25% of the audience.

WE ARE BRONTE

OVERALL - ALL EVENTS


So-so6.5%

10%

We are quite pleased with our overall

feedback. This is a good snapshot of how we

are performing, for more details see the

breakdown on the following pages


Excell

ent/g

ood

97%

So-so

3%

UDUL BY LOS GALINDOS - PERFORMANCE

we asked 37 people what their opinion

of the quality of the performance at

the event. This represents 27% of our

audience.


So-so16%

Poor2.9%


the quality of our carnival was. our

sample represented 2.2% of the audience.

CARNIVAL

INTERNATIONAL STREET FESTIVAL


Poor3.5%


the quality of our street festival was. our

sample represented 0.5% of the audience.


So-so18.4%CONFETTI BATTLE


So-so4.3%

They dislike the date change and the lack of event schedule leading up to the event.

2 respondents felt that the customary (and rescheduled) carnival week events added

to the atmosphere and it now felt disjointed.

1 person responded that there should be more floats, lights, a carnival queen and

carnival babies.

people who cited that the carnival did not meet their expectations commented:


we asked 56 people what their opinion

of the quality of the event. This

represents 1% of our audience.


the quality of the event was. our sample

represented 26.5% of the audience.


TO BE CONSIDERED

At our largest and smallest events we trialled collecting a snapshotof opinion for specific shows using speech bubble whiteboardsand audio recordings. Examples of this are shown below. We trialled ‘Whiteboard Counts’ at UDAL performances,and at ISF shows Circus Raj, Ockhams Razor, Ian Deadly, Dansi,Rin Tins and Kongo Dia Ntotiia.

QUALITY RATING ACTIVITY

More engaging for both evaluator and responderMore data collected quicker and with a potent focus on aspecific evaluation taskEffective in getting audience feedback on a show in a timelymannerLess invasive of audience timeWe need to refine the processIt's quick to collate the data at the end of the event.

Speech Bubble Whiteboards:

Some audience members disconcerted by beingrecordedAmbient noise effects qualityTransfer of information timelySome level of tech knowledge required to operateUseful snapshots gatheredNot suitable for all eventLimited by equipment available

Audio recording:

OUR LEARNING OUTCOMES

Trialing a variety of data gathering methodologyat different events gave us an insight to howour audiences like to communicate and whatworks with our available resources and for ourvolunteers. This is what we found:

THE WORD ON THE STREET

"WONDERFUL, LOVED IT. I’MA CHURCHGOER AT ST

MARY’S, SO THIS IS A BITDIFFERENT FROM MY

‘NORMAL" We Are Bronte

We Are Bronte

"VERY TALENTEDPERFORMERS"

Confetti Battle

"BRILLIANTLITTLE TOWN,AND BRILLIANT

EVENT"

"We bring visitors down each year for it,

have seen Some greatshows today"

Street Festival

"Club Shed had us all dancing, the oldies and thetots! How great is that! Great

concept!"Street Festival

"Came last year and had a great time, so back for more this year"

Street Festival

"LOVE THE VIBE"Festival of Winter Ales

UNDERSTANDING OUR PARTICIPANTS

Participation is key to DOCA’s work. We rely heavily on adedicated, skilled and willing team to make things happen, with thehelp of a huge team of volunteers, our appreciation of the goodwill and a pro active approach to nurturing a supportive cohesiveand caring team is key to this work. Public participation in our workshops and events is also central toour events. We aim to grow and improve the quality ofparticipation wherever possible year on year. Our mainparticipatory activities relevant to this report (excludingLantern Parade) are:

CARNIVALIn 2019 we ran our first series of schools Carnival workshops formany years. We engaged with 292 young people - this will be ourbenchmark to improve upon in future years.

COLOUR RUSH

PICNIC WORKSHOPS

As this is a ticketed event we have the contact details of all theparticipants which makes it easier to gather information andfeedback.

These workshops are delivered on a drop in basis, young peopleoften attend unaccompanied or with siblings as their families arewithin eyeshot, this can make it difficult to gather feedback. Weheld participatory performance with a mass kazoo session in 2018 &the Balloo Toss in 2019.

2018 2019

400

300

200

100

0

400

300

200

100

0

2018 2019

400

300

200

100

0

2018 2019

250

200

150

100

50

0

OUR PARTICIPANTS

PICNIC:

TARGETS

ACTUAL PARTICIPATION

COLOUR RUSH

TARGETS

ACTUAL PARTICIPATION

workshops & participatory

performance

MEASURING OUR IMPACT

TARGET 150

ACTUAL 216

NUMBER OF NEW COMMISSIONS

TARGET15

ACTUAL 35

DAYS EMPLOYMENT FOR ARTISTS & TECHNICIANS

TARGET 85

ACTUAL 93

NUMBER OF PERFORMANCE OR EXHIBITION DAYS

TARGET 80

NUMBER OF SESSIONS FOR EDUCATION, TRAINING OR PARTICIPATION

ACTUAL 156

TARGET 1500

ACTUAL 38,174

PARTICIPANTS

TARGET 1500

ACTUAL 2101

AUDIENCE MEMBERS - LIVE

TARGET 30,000

ACTUAL 6000

UNDERSTANDING WHO BENEFITS

ARTISTS, CREATIVES OR MUSEUM SPECIALISTS

TARGET165

ACTUAL 216

AUDIENCES ON LINE, THROUGH BROADCASTS OR WRITING

We aimed to touch the lives of 33,165 people we reached 40,491including online interactions

At our ticketed showUdul by Los Galindos

100% of the audience

agreed theirexpectations weremet or exceeded

DOCA understands the need to capture data to quantify andvalidate the effect of its activities on the economy of Devizes. So farlimited data has been collected to enable us to estimate the impactour events have on the town. Our Development Plan explores howthis work can be done better in the future.

We have some basic data collected from our Carnival event whichgives us some basic information to make some qualified estimates.

*Taking the midpoint of each Spend Range collected, multiplying itby the number of responders gives an approximate average spendof £20 per person. Taken further, multiplied by 65% (as an adult /child split of total attendance) of the total estimated audience size(3750) this gives a calculation of 2437 x £20 = £48,750

UNDERSTANDING WHO BENEFITS

GOING FORWARD

ECONOMIC IMPACT

Carnival brings £48,750* into Devizes

We now have benchmark figures to set targets agains for future years,though we know that Covid 19 will have a huge impact on our work we hopeto return to the successes we have seen this year, we will continue toimprove our data collection methods and bring further depth into ourresearch.

f7-65*0/3&1035...although online audience feedback forms are available their use did not provide...

Documents