otorohanga championsareyouok.org.nz/assets/uploads/mfvin-otorohanga...focus group with champions and...

Otorohanga Champions Evaluation of the 2015 /2016 Campaign

Prepared by:

Debbie Goodwin: DBZ Consultancy Ltd

March 2016

Executive Summary

This summary identifies key themes from all the data sources (event

surveys, champions focus group and surveys, project team focus group and

survey, community survey, log books, agency referral data, observations,

document review). It answers the key evaluation questions:

What are the key components of the Otorohanga Champions project and

how do they contribute to reducing Family Violence in Otorohanga?

How well has the project been implemented and how effective has the

collaboration been with the community?

What impact has the project had in the community?

What can we learn from the project to inform future projects?

What are the key components of the Otorohanga

Champions project and how do they contribute to

reducing Family Violence in Otorohanga?

The key components of the Otorohanga Champions are outlined in a theory of change model (next page).

The project contributes to reducing Family Violence in Otorohanga through:

Engaging the community in meetings and establishing a representative project team to support the campaign

Recruiting and training community people to champion family violence-free messages

Undertaking public events and communication strategies to engage the community and raise awareness

This has resulted in increased discussion and knowledge about family violence-free messages, support services and how to get help (slide 27,28,32,33)

A key element is the Champions impact on their circle of influence which appears to create significant engagement in the key messages

It was not possible to determine whether there has been increased referrals to support agencies, however some Champions made a number of referrals. While agency referral data was obtained this is limited and requires comparison dates to understand the trends for seeking help.

Establish a community project team

Recruit, train and resource community champions to support key FV messages

Raise awareness of FV in the community and messages that support getting help - through public events and communication strategies

Increase community discussion and knowledge about family violence-free messages, support services, how to get help, and how to support others

More people reporting FV and accessing support services

A community that supports Violence Free Families

Family Violence Free Otorohanga

A Theory of Change Model for Otorohanga Champions

Programme

How well has the project been implemented

and how effective has the collaboration been

with the community?

The project team and Champions group were set up representing a range of different groups

from the community

The Champions campaign was well planned and implemented with good participation from the

community (Slides 27, 33,48)

Champions training:

The Champions have good knowledge of the services available and are trusted people in the

community

Most Champions felt prepared for their role however ongoing training, experience and full

attendance by all Champions could better support them in their role

Overall the Champions grew in knowledge and confidence during the training and the campaign

but they acknowledge that there is still a lot to learn (Slide 43 – 46).

What impact has the project had in the

community?

Champions are having lots of discussion with people in their communities

about the Champions project and family violence, especially in their own

circles of influence.

There was great community spirit at all the events and a greater awareness of

family violence was evident.

There is increased discussion about family violence in the community.

Many people from the community remember the key messages of the

campaign, and Champions noted some change in attitudes.

There have been a number of referrals made and support given by

Champions.

See slides 18, 27, 28, 32,33, 36,38 for examples.

What can we learn from the project to

inform future projects?

There is a strong desire by Champions, the Project team and the members of the

public for the campaign and events to continue.

There is an understanding that the promotion of key messages need to continue in the community to further the campaign’s impact.

There is a need to focus on unreached groups in the community.

More involvement from young people both in the community survey and as Champions is an area to look into in the future. A focus on youth strategies may support promotion of the key messages amongst this group.

Capturing a baseline of referral and service data requires a joint agreement with the key agencies and over time will provide an understanding of the demands for help-seeking in the local community, however there are significant limitations to using this as data for family violence incidence and it won’t capture those that seek help from services outside the district.

[Slide 39 – example of feedback]

Background

The Champions project has been identified as an effective way of addressing family violence in communities.

The national TV campaign ‘It's Not OK’ has had a key part to play in laying the ground work for communicating the key messages of “It’s not OK” and “It’s OK to ask for help.”

It’s important to acknowledge that raising awareness and making family violence a less taboo conversation is the first step to making a difference.

The overall goal of the campaign is a:


The objective is to:

Reduce family violence and its effects on

children.

Background

Key groups involved

The Otorohanga Family Violence Champions Campaign is a community collaboration led by the MFVIN group (the Maniapoto Family Violence Intevention Network).

Groups involved are:

Maniapoto Family Violence Intervention Network

New Zealand Police

Waitomo / Waipa Women’s Refuge

Otorohanga Support House

Te Oranga Pai (Kokiri Trust)

Ngati Maniapoto Marae Pact Trust

Population Health

Te Kuiti Community House

Ministry of Social Development

Otorohanga College

Otorohanga District Council & Waitomo District Council


Aims:

To contribute to reducing Family Violence in Otorohanga

by promoting ongoing positive change in people’s lives and

in their communities.

To raise awareness of family violence in the Otorohanga

community.

To increase community knowledge about support services.

To increase access to support services.

To increase `reporting` (not incidence) of family violence.

To facilitate sustainable change in Otorohanga community

attitudes utilising ‘It’s Not Ok` messages.

The Campaign planning began in May 2015 and was launched

in November 2015. Twenty two Champions were recruited.

Community Public Meetings – May / June 2015

Set up of Project Working Group – June 2015

Recruitment of Community Champions – ensuring good representation across the community – July 2015

Training for Champions – August – November 2015

Launch of Campaign – Picnic in the Park – November 2015

Campaign communication strategy – Billboards, Posters, Community Events, Facebook, Newspaper articles

Delivery of posters to 105 Otorohanga businesses (15th – 22nd January 2016)

Delivery of posters to 12 Kawhia businesses (12th Feb 2016).

5 Billboard sites installed 4th January 2016 (Village Green, Bailey Ingham, Oto Medical Centre, Oto Pool Complex, Oto Soccer Club)

Kawhia BBQ on the Beach – 27th Feb 2016

Poukai at Marakopa

This is an evaluation report developed in partnership

with the Project Team

An external evaluator

supported members of the

project working group with

developing the evaluation

framework, methods and

reporting. Much of the data

collection was undertaken by

members of the project

working group.

The aim of this evaluation was

to build on previous evaluations

and build the capacity of the

project working group to

evaluate their own

interventions in future.

The key evaluation

questions are:

What are the key components of the Otorohanga Champions project and how do they contribute to reducing Family Violence in Otorohanga?

How well has the project been implemented and how effective has the collaboration been with the community?

What effect/impact has the project had in the community?

What can we learn from the project to inform future projects?

Success criteria were developed with the working group

Champions also provided feedback on the criteria

Criteria covered key components of the campaign

Champions

Community Events

Other promotions

Project organisation

Overall campaign success

Key success criteria were developed with the team.

Champions Community Events Other Promotions Project organisation Overall Campaign success

Champions are educated and aware

of family violence, feel confident to

share knowledge around family

violence and help others when asked

Large numbers attend the

PIP Launch Event

Other promotional

resources are displayed and

aligned with the National

“It’s Not Okay” Campaign

There is good community

involvement and

collaboration in the service

Family violence support services are

utilised more in the community

(increased uptake)

There is increased reporting (not

increased incidence)

More people coming forward for help

(to Champions, community agencies)

Eventually less police call outs for FV

Champions have good knowledge of

the services in Otorohanga

There is good community

spirit at the events

Five billboards are

displayed in good locations

in the community

Community leadership is

developed

There is more open discussion by the

public about Family Violence and it is

demystified

People in the community recognise

the Champions

Community awareness

about Family Violence is

raised

Promotional materials are

respected by the

community, and stimulate

conversation in the

community

Collaborative partnerships

are fostered and developed

The key messages are remembered by

the public and awareness is raised

about Family Violence

-more people know it’s not okay

-more people know it’s okay to ask for

help

-more people know where to go for

help

People in the community approach

and engage with Champions

There is positive feedback

from all age groups about

the events

Key messages are repeated

at all events

Training is appropriate and

supports the needs of the

champions to perform their

role

Community knowledge about family

violence as well as support services is

increased,

Support people are friendly and

helpful

Evaluation Success Criteria

Evaluation Success Criteria (pg 2) Champions Community Events Other Promotions Project organisation Overall Campaign success Champions are trusted by people The events and the

campaign have good

media coverage in the

Waitomo news / MFM/

Cruise FM (and social

media)

Promotions are well

received by the public,

responsive and easy to

understand (short succinct)

The project working group

feel they were provided

with good information and

support from the MFVIN

representatives?

Improved attitudes toward family

violence and helping others

Champions feel confident and

passionate to be actively advocating

at community events and

opportunistically

Champions involvement

in community events e.g.

Christmas parade

The campaign overall was

well planned and

implemented

People feel more comfortable asking

for help or helping others in need

Champions support and encourage

each other to support the

community

Key learnings are identified

for future programmes

Reduction in family violence

incidences

Children are safer

Champions will continue beyond Feb

2016

The project is sustained

beyond February 2016

Family Violence free Otorohanga is the

norm, the cycle of family violence is

broken

There is interest from other

towns about implementing

the Champions programme

Other community members become

champions and the project is ongoing

The Oto community

mentors other towns and

communities – success

breeding success)

Otorohanga is known for its stand

toward violence-free environments

This campaign supports the

next phase “It’s OK to Help”

Evaluation methods Document review

o Previous evaluations, minutes, promotional material, facebook page

Champions training surveys

o These were developed against key criteria

Champions logbook

o An app was developed for use on mobile phones to log interactions with people

Launch and events public surveys

o Several event surveys were developed and implemented against key criteria

Referral data from family violence services and police

o These were used to develop a baseline understanding for future reference

Community/Public survey

o 76 people were canvassed in the main streets of Otorohanga and at different public

events after the campaign (Feb 2016)

Focus group with champions and project working group

Most conversations reported by Champions were about others recognising the

campaign and increased awareness; there were lots of discussions, and a

smaller number of actions and referrals being made

32 10

89

267

15

290

15 0

50

100

150

200

250

300

350

Champion's impact on others (n = 20)

Findings - Champion’s log book

Champion’s contacts were fairly even across all contact types – a number

of Champions had a lot more contacts with people than others

85

93 91

77

0

10

20

30

40

50

60

70

80

90

100

Family Friend Work Colleague Other

Champion's contact type (n = 20)


Champions are receiving good response and recognition in

the community

“All my old work colleagues really backed the cause ever since they found out I was a champion. Since then they have made sure that everyone (at work) knows about the program. They even put up some posters in the crew room, to spread the awareness.”

“Eight total strangers have recognised me from the billboard and posters in town.”

“Up to 20 friends have commented on the posters and news coverage. Some have been jokes but all have encouraging and has increased the awareness about family violence.”

“When wearing the champions T shirt out of town (like in TA) I've had nods & "good on you" comments from a handful of strangers.”

“Four of my bosses at work know I'm involved with the project and have been supportive of the cause.”


Champions are helping to shift awareness in their own circles and people

are starting to talk about family violence.

Several Champion’s had to make a stand in social circles when people

joked about the topic.

“Group chat explaining and discussing champions’ campaign. Sensed a shift in

awareness and receptiveness to even talking about family violence. Improved

realisation that it's not just physical abuse and that it happens in white middle

class families too!”

“Another joke made about hitting/smacking children...this time the children in

the room said ‘family violence is not ok.’”

“I have been recognised for my role in a few friends’ circles and some joke but

when they see that you are respectful and willing to fulfill the role with huge

seriousness then they settle down with the silly talk.”


Friends and family are learning more about family violence and

sharing their own problems, and a few champions were able to

point people in the right direction.

“Whānau realised that yelling is emotional abuse.”

“All of my friends have been really intrigued about the program, and have all been asking me about it, and I’ve actually had a few of them reveal problems that they have had in the past, so I talked to them help them to talk about it, and referred them to other people they could go see to help.”

“She also disclosed that her friend is in an abusive relationship. We talked about ways that she can help her friend.”


Champions are making a difference in the community and it

is having a ripple effect.

Champions are taking a stand in the community.

“One on one discussions with several grandparents who openly admit the

problem.... will take the message home to children / grandchildren. Would have

liked to see more of the young ones there. Many have personal experience and

see the value in breaking the cycle.”

“I have given this family pamphlets of information and advice along with all local

support phone numbers. Great discussion.”

“Nine adult family members wore their It's Not OK T-shirt to McDonald's for

dinner and to promote the message. Many people looked at us but none came to

talk with us.”


Champions are providing referral information and support to

family members

“I was asked to support a friend’s friend to get

away from a situation but she isn't fully ready

for intervention…I have offered to make

myself available when she is ready.”

“Six people have asked for in-depth help and

I've referred them on to help services & some

to refuge.”

“I had a local family asking for support with a

family member who is violent to his partner -

they were seeking help so I offered them all

the local numbers of different people who can

support them through this tuff time!”


The local events have helped Champions connect with the community as a

person standing up against family violence

“Woman who was physically abused by her father when

she was a child spoke to me about her childhood and

aspirations for her own violence free family. This was

at Picnic in the Park.”

“So I told him it's not ok to control his partner or her

actions. I said there is help available if he wants

it…Annnnnnd. ....he has contacted a counsellor to seek

help.”

“Woman who I didn't know waved to me at the Xmas

parade. I went to give her a badge and she THREW her

arms around me and told me that it's been really tough

and she has just left a "BAD" relationship. I wish I had

more time to listen to her story. I told her to stay

strong and she has done the right thing. Gosh.”


Key messages are getting through; the many positive comments were evidence

of the overwhelming support for the day

5

28

24

12

5

0

5

10

15

20

25

30

Champs are here to represent key messages about family violence

It's okay to ask for help Violence is not okay Other Community coming together

Key messages from Picnic in the Park - Nov 2015 (n = 70) “Awesome! Well

organised and

those that are

involved are

really

approachable!”

“It was a good

family day out.

Mean day for all

of my Tribe.”

Findings – Picnic in the Park survey

Ratings were high at Picnic in the Park, over 90% believed key messages of

family violence were heard, and that they had a better understanding

themselves (n = 86)

1% 2% 2% 1% 4% 3% 5% 4%

1%

20%

32%

26%

19%

26%

80%

65% 66%

73% 69%

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

There is good communityspirit at this event.

Key messages about familyviolence were heard and

now locals are more aware

You have a betterunderstanding of the

services that help peoplewho may experience

family violence

You have a betterunderstanding of the

effects of family violenceon families and children

Locals will recognise theChampions and feel morecomfortable approachingthem if they need help

Not at all A little Some Good Excellent


Suggestions for improvements

to Picnic in the Park

The most common suggestion was to keep the event going and to do more events like Picnic in the Park

There were a lot of statements encouraging the team to “keep going”

More activities were suggested including more children’s activities, games, water activities and talent quest

A number of amenities were suggested such as water, sunblock, more shade, and even an icecream or iceblock stand

Cultural performances were suggested as well as combining the event with Māori sports days/events

A few suggested more promotion and advertising, listing the services and using more professionals involved (fire brigade, pastors, business people)

0

5

10

15

20

25

30

35

40

45

< 18 18 - 24 25 - 44 45 - 60 plus 60

Age breakdown of respondents (n = 84)

(NB 85% who completed the survey were

females).


The event was advertised via 3000 mailbox invites, 2 newspaper

pre-articles, 200 invites given out at Countdown, personal

invitation to all Otorohanga South Students, posters down

Otorohanga main street, school newsletter ads, Face Book post.

Findings – Maniapoto Family Violence Intervention Network

Facebook page is well utilised and has a wide reach

Some Facebook posts have reached over 5,000 people

Kawhia video - 1535 people reached, 686 engaged

Kawhia photo album - 1100 people reached, 1907 engaged

Marae poster – 1700 people reached, 613 engaged

Rugby - 5200 people reached, 777 engaged

Annie & Andrea - 1400 people reached, 576 engaged

Dennis - 3023 people reached, 944 engaged

Picnic in the Park – 678 people reached, 2467 engaged

Definitions:

“Reached” means appears on unique user news feed)

“Engaged” means post clicks, reactions, comments, shares)

Page Visits 86 1

9

Weekly Total

Reach (Unique people who see

the page / Newsfeeds)

2,778

1

,

1

4

2

People Engaged (Liked, commented,

shared)

313 1

2

4

Total Page

Likes 514

5

0

4

Monthly Statistics as at end Feb

2016

Most Kawhia people who answered the survey remembered the key messages

of Violence is Not Okay and It’s Okay to Ask For Help.

They thoroughly enjoyed coming together, the BBQ, free food and music

0

1

2

3

4

5

6

7

8

9

It's okay to ask for help Violence is not okay Community coming together,free food and music

Other

Key messages at Kawhia BBQ on the beach - Feb 2016 (n = 19)

Findings – Kawhia survey

Ratings were positive at the Kawhia BBQ public survey and over 90% had a better

understanding of the effects of family violence and the services available (n = 21)

5%

14%

19%

5% 5%

24%

14%

24%

33% 33%

24%

72%

57% 57%

62%

52%

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

There is good communityspirit at this event.

Key messages about familyviolence were heard and now

locals are more aware

You have a betterunderstanding of the services

that help people who mayexperience family violence

You have a betterunderstanding of the effectsof family violence on families

and children

Locals will recognise theChampions and feel morecomfortable approachingthem if they need help

Not at all A little Some Good Excellent


Suggestions for Kawhia

BBQ at the beach

0

1

2

3

4

5

6

7

8

9

10

< 18 18 - 24 25 - 44 45 - 60 plus 60


While many people felt there were no improvements a few

suggestions were made including more events like Picnic in

the Park: Maybe later in the day

Encourage more young parents to attend

Promote it more

Keep in good contact with the local health providers to support

if they can

Band/karaoke

“Have it more often – our children are so precious.”

“Awesome for my kids to be around such a positive event. Lovely

to see all generations of whānau present today - & loved the

Zumba.”

“Thank you to all the helpers and organisers for a great day.”


Many members of the

public remembered key

messages (n = 77)

17

37

9

2

0

5

10

15

20

25

30

35

40

It's okay to askfor help

Violence is notokay

Talk about it /Break the

silence / Speakout

OtherN

um

ber

of

com

ments

made

Key messages - public survey

Most mentioned Champions by those surveyed were:

(between 23% – 33%)

Donna

Ernest

Porky

Eru

Dennis

Findings – Community public survey

The most common medium for seeing the campaign messages was

the newspaper

54

37 34 34 33 31

21 19

3

0

10

20

30

40

50

60

Can you tell me where you have seen or heard the family violence free messages?


The general public are very aware of the Champions and campaign messages,

and over 60% believe the messages will make a positive change (ratings of good

to excellent)

3% 1% 4% 4%

1% 1%

8%

25%

33%

20% 22%

18%

36%

24%

32%

26%

37% 36%

30%

60%

53%

25% 29%

32%

19%

32%

3%

15% 14% 11%

7%

18% 19%

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

The messages wereeasy to understand

The Champions aretrusted people inthe community

The campaign hasencouraged locals

to talk openlyabout family

violence

The campaign hashelped locals to

better understandwhat familyviolence is

Locals are morelikely to knowwhere help is

available becauseof the campaign

Locals will start toask for help earlyor refer a familymember or friend

to appropriateservices

The messages havemade a positive

change inOtorohangacommunity

Perc

enta

ge

Not at all A little Some Good Very good/Excellent Don’t know


What can we learn from the

campaign feedback?

Changes the public have

seen/heard

Posters and photos of Champs

around the town

Messages that help is available

People are more aware of family

violence

People are talking about the

messages to others

Suggested campaign

improvements Keep promoting it: keep getting the

message out there, be seen more, more use of social media and newspaper

Try other places: schools, marae, sports clubs

More events: more people at events, keep doing the events, timing to suit farming community

Champions: more people who have been there, less champions, pick more locally known people


Comments from the campaign feedback?

“Some champions

never seen them

before”

“I realise not all

the champions are

at events, Why is

that?”

“I believe it is more

important to tackle

the issue of the

misuse of alcohol

and that is more

likely to curb the

violence”

“I think they are doing a

good job in spreading the

news of family violence”

“Well done! You are doing

an excellent job”

“Thank you all for your

caring for our community”


A limitation of the community survey are that there were few

people under 24 years contributing.


0

5

10

15

20

25

30

< 18 18 - 24 25 - 44 45 - 60 plus 60

The survey was undertaken

by the Project team at

several different sites in the

community including;

A Soccer event

Lifestyles public meeting

Main street of Otorohanga


Champions have grown in confidence over the campaign (n = 13), however

some feel there is a lot more learning to do.

All of the Champions (who completed the survey) felt ‘somewhat prepared’ for

their role while a number felt ‘very well prepared.’

0

1

2

3

4

5

6

7

8

9

Not at all A little Some Quite a bit Lots

How confident do you feel in your role as Champion (before and after the campaign)?

Before… Now…

Findings – Champions survey

Most champions learnt a lot about family services available and many

people talked to them about family violence issues

0

1

2

3

4

5

6

7

8

9

Not at all A little Some Quite a bit Lots

How well did you know the services that support families experiencing family violence (before and after the campaign)?

Before… Now…


Champions felt that the community has learnt more about

family violence and there are improved attitudes and

behaviour toward family violence

Examples include:

Raised awareness

Work and friends really got behind the programme

It's become less acceptable to "make light" of family violence

A heightened awareness of need to break the cycle

Many women I spoke to… who were keen to take messages back to

whānau or who had experienced family violence themselves and

keen for their children / grandchildren to break the cycle

Making people aware that any form of violence Is not okay and that

joking about it could be harmful to others

Challenged stereotypes mostly i.e. joking about family violence


Champions felt their role was received very positively by the

community, family and friends, although there were some

‘interesting’ reactions by some.

The Champions felt that the role should continue and that

others should be invited in.

Keep pushing the programme to keep up the awareness, notices

through social media, school newsletters, newspaper

Continue to offer information to the community i.e. seminars,

info nights, business leaders programme

Other suggestions included reaching out to ‘untouched’ groups

i.e. farming community, more public meetings/picnics,

Also suggested were faster paced and more intensive training

“Continue to

make a stand

against family

violence. Invite

'new' champions

yearly.”

“Some of the

champions have

huge circles of

influence”

(Project team

member)


Project working group members felt there was lots of community

collaboration and that they worked well to implement the

campaign (n = 10)

The project working group felt the champions were “somewhat prepared” for

their role, but more consistent attendance would have helped.

Many of the project team were approached by others to talk about family violence

Examples of this included:

“People and family were interested in the project”

“At the Christmas parade, providers talking to me about services my team provide”

People stopping to talk at the supermarket, street, service station, discussion at sports events, and to neighbours

People talking about issues that people had in the home regarding violence

Compliments about taking a stand and being a champion

General discussion about what the Champions Project was about

Lots of discussion about posters

Findings – Project team survey

“Went very

well for our

first time,

passionate

team,”

“A lot left to

Caren / Anne”

The project working group felt there was ‘quite a bit’ of talking going on by the

community about family violence.

They also believed this led to some changed

attitudes and behaviours toward family violence

and engagement with the surveys helped further

the discussion.

Examples included:

Stopping people from joking about it

By people talking to each other and the use of surveys

gets them talking

More about it being okay to talk about it

A lot of talking has started

Lots of discussion with people in the community during

evaluations. And this has been a great start.


There is more to be done:

“Still getting out in the community”

“Think it will take time”

Most of the campaign components were believed to be ‘quite effective’ or

‘very effective’

0

1

2

3

4

5

6

7

8

9

Community events Billboards Posters Other promo materiale.g. kites

Media/social media Champions

Num

ber

How effective were the following campaign components? (n = 10)

Not effective at all Could be better Quite effective Very effective indeed


The project team want to see the momentum continue…

A number felt the role of Champions should be continued and new ones

recruited, with older ones becoming mentors

What more needs to happen?

Continuing and sustaining the effort – “carry on, don’t lose the momentum.”

Ongoing training and support for Champions

Keep refreshing the messages through the media/social media

Suggestions for improvements:

Expectation and commitment set for training at the outset, as well as catch up sessions

Marae-based training over weekend, and more opportunities to practice scenarios

Different age groups and successional planning, buddy up the Champions

Larger and more billboards, and billboards on the main road

More funding and business involvement.


Monitoring of statistics is required for better understanding

of the impact of family violence in the community

November 2015 – February 2016

Five agencies supported 63 people

living in the Otorohanga District

(incl. Kawhia) where family

violence was taking place.

Ages were largely adults between

25 and 64 years old (n = 38).

Seven were children under 18

years, and 15 were aged between

18 and 24 years.

48 households had children living in

them ranging from between 1 and

5 children.

57% were female and 43% were male.

Two thirds were Māori and one-third were European.

Violence included physical, emotional, sexual, financial, neglect or other.

Family violence incidences (reported by the Police) rose slightly compared to the Nov – Feb 2014/15 year (from 94 to 101 for the same period).

NB: Other statistics were obtained for people living in the Waitomo District (i.e. Te Kuiti / Piopio) however these were not counted in this analysis.

NB: not all categories were completed

Findings – Agency statistics

Performance Rating

Performance descriptors for answering Key Evaluation Questions

Excellent Performance is clearing very strong or exemplary in relation to the question. Any gaps or

weaknesses are not significant and are managed effectively.

Good Performance is generally strong in relation to the question. Less significant gaps or

weaknesses are mostly managed effectively.

Adequate Performance is inconsistent in relation to the question. Some gaps or weaknesses. Meets

minimum expectations/requirements as far as can be determined.

Poor Performance is unacceptably weak in relation to the question. Does not meet minimum

expectations/requirements.

Insufficient evidence Evidence unavailable or of insufficient quality to determine performance.

Judgements were made using the range of data available and moderated by

the project team and champions. The performance ratings are defined below,

and the overall ratings against the success criteria are on the following pages…

Source Davidson, J. Wehipeihana N., & McKegg, K. Presentation at the Australasian Evaluation Society Conference, Sydney, 2011

Overall evaluative judgements: making sense of the data

Overall Campaign Success

Poor Adequate Good Excellent Comments

Family violence support services are utilised more in the community (increased uptake)

No evidence available: A baseline of service use has been recorded

There is increased reporting (not increased incidence)

Too early to tell There is slightly more incidences being reported to Police compared to period prior (Nov 14 – Feb 15 period)

More people coming forward for help (to Champions, community agencies)

Too early to tell

Eventually less police call outs for FV

Too early to tell - Tracking of reported incidences and service use over future years remain important to understand changes

There is more open discussion by the public about Family Violence and it is demystified

57% of respondents said good/excellent

The key messages are remembered by the public and awareness is raised about Family Violence

Over 80% at the events said good/excellent.

-more people know it’s not okay

Over 60% (from community survey) remembered a key message

-more people know it’s okay to ask for help

55% feel locals will start to ask for help or refer to appropriate services

-more people know where to go for help

69% feel locals will know where to go for help because of the campaign

Community knowledge about family violence as well as support services is increased

55% of respondents said good/excellent (FV) and 69% support service knowledge

Support people are friendly and helpful

No data is currently collected around satisfaction of support services for this project

Champions


Champions are educated and aware of family violence, feel confident to share knowledge around family violence and help others when asked

NB: While Champions feel more confident, there is still a lot of room for growth in this area

Champions have good knowledge of the services in Otorohanga

People in the community recognise the Champions

People in the community approach and engage with Champions

Champions are trusted by people

77% respondents said yes (good / excellent)

Champions feel confident and passionate to be actively advocating at community events and opportunistically

Champions support and encourage each other to support the community

Champions will continue beyond Feb 2016

There is a lot of desire to continue on with the campaign

Community Events


Large numbers attend the PIP Launch Event

There is good community spirit at the events

Community awareness about Family Violence is raised

There is positive feedback from all age groups about the events

More data is required from the younger age groups < 18 and <25 years

The events and the campaign have good media coverage in the Waitomo news / MFM/ Cruise FM (and social media)

Champions involvement in community events e.g. Christmas parade

Other Promotions


Other promotional resources are displayed and aligned with the National “It’s Not Okay” Campaign

Five billboards are displayed in good locations in the community

No billboards were able to be erected on the Main Road which would ensure excellent coverage.

Promotional materials are respected by the community, and stimulate conversation in the community

Key messages are repeated at all events

Promotions are well received by the public, responsive and easy to understand (short succinct)

96% reported that the messages were easy to understand.

Project organisation


There is good community involvement and collaboration in the project Community leadership is developed Collaborative partnerships are fostered and developed Training is appropriate and supports the needs of the champions to perform their role

NB: Consistent attendance is required to cover key training aspects

The campaign overall was well planned and implemented Key learnings are identified for future programmes The project is sustained beyond February 2016

Too early to tell: There is a strong desire to sustain the programme

There is interest from other towns about implementing the Champions programme

Te Kuiti is keen to implement the Champions programme

The Oto community mentors other towns and communities – success breeding success

Too early to tell: It has been suggested that Champions could role model new Champions

This campaign supports the next phase “It’s OK to Help”

This campaign is in good stead to inform the next phase.

Success Criteria

Overall Performance

Overall campaign success

Champions

Community Events

Other Promotions

Project Organisation

While there was some areas of excellent

performance, in general, performance was

strong, with less significant gaps or weaknesses

managed effectively.

In some areas it was too early to make a

judgment and/or no evidence was available.

Overall, looking across all the data, a good

level of performance has been achieved across

the success criteria

Refer to slides 54-59 for more detail

Thank you from MFVIN.

Thank you to all the Otorohanga Champions

for your dedication to the project and

willingness to make a difference in the

community toward violence-free families in

Otorohanga.

MFVIN would also like to acknowledge and thank our major funders:

Its Not OK Campaign,

Trust Waikato,

Health Promotion Agency,

The Police Guild Trust,

Otorohanga Districts Charitable Trust.

To the Project Team and Otorohanga Champions…

Ngā mihi nui ki a koutou katoa.

Thank you to all those who contributed to and

participated in the evaluation.

Your dedication and work is much appreciated.

Contact Details:

Debbie Goodwin: DBZ Consultancy Ltd

PO BOX 330 Hamilton 3240

P I 0274470208 E I [email protected]

otorohanga championsareyouok.org.nz/assets/uploads/mfvin-otorohanga...focus group with champions and...

Documents