a new approach to social marketing: intervention logic ... · intervention logic modeling and...

1

Social Marketing Downunder Conference 2005

A New Approach to Social Marketing:

Intervention Logic Modeling and Research Evaluation

2

Dr Paul DuignanParker Duignan Ltd – WellingtonSenior Research Fellow forCentre for Social and Health Outcomes Research and Evaluation (SHORE)Massey University Auckland

More on outcomes theory:www.strategicevaluation.info

Andrea KanDirectorUMR Research Ltd Wellington–Auckland–Sydney-Brisbane

More about UMR:www.umr.co.nz

3

Increased willingness to take preventive

actionIncreased stakeholder

willingness to participate in partnerships

Increased base level tolerance / support for

effective incursions mitigation

Increased willingness to take mitigation

action

Increased appropriate preventive behaviore.G. Declaring items

Increased appropriate

mitigation behavior

Increased stakeholder partnership initiatives

Increased support for specific incursion

mitigation

Increased Biosecurity

Reduction in biosecurity incursions

Effective incursion mitigation (eradication or management)

Increased under-standing of what to look for and how to respond if you see

something suspicious

Increased understanding of personal action

needed for effective mitigation

Increased under-standing of need for

biosecurity mitigations measures

Increased under-standing of what not to bring into NZ and what to

declare

Increased understanding of ballast water and

hull cleaning procedures

Increased stakeholder

understanding of the problem and

solutions

Increased Public understanding of biosecurity

Increased Stakeholders’understanding of biosecurity

Increased Inward Travelers’understanding of biosecurity

The Beginning

TheoryNew Way?Outcomes

TheoryPracticeModel

Development ??Intervention Logic ModelModel Assessment!Get it straightCreativityCreativityAtmosphereAtmosphere

No BoundariesNo Boundaries

We can work it outModel Refinement

RevolutionNo Evolution!

ActionInformed Logic

With feelingDefine – Implemented

Logic?Breakout!

Increased Inward Travellers’understanding of biosecurity






declare





solutions











action




mitigation


mitigation behavior




MAF Biosecurity Social Marketing Intervention Model

Informed logic outcomesOnly time will tell –iterative processWe can work it outWe can work it out

4

The beginning…(Planned Logic)

5

Theory to Practice

• Based on outcomes theory– Analytical framework for outcome systems

• Intervention logic (programme modelling, programme theory, outcome hierarchies, results chains)– Intermediate steps to achieve change or final

outcome for programme or policy

• Accepted good practice

6

Uses

• Used to:– Assist stakeholder consultation– Programme planning & implementation– Outcomes measurement– Indicator development– Reporting– Research & evaluation priorities– Programme & policy evaluation

7

Model Development

• Input on preferred outcomes/ how achieved:– Current knowledge of issues– Existing research– Expert opinion








action

Increased appropriate preventive behaviore.g. Declaring items


mitigation behavior



mitigation











declare





solutions



Increased Inward travellers’understanding of biosecurity

9

Getting it Wrong

• Key issues:– Measuring the underspecified– Continually evolving– Wide range of potential risks– Diverse sectors– Cost of data collection– Acknowledged difficulty in measuring social

marketing campaigns

10

Getting it straight!(Informed Logic)

11

Model Assessment

• Assessment of assumptions by:– Existing research (not conclusive)– Expert opinion

• And…

12

Something New

• Creativity groups

• Not ‘new’ as such– New to New Zealand– Beyond projectives, focus groups

13

The Difference

• Ideas generation

• New angles

• Richer understanding

• Testing the hard to define

14

Once More with Feeling• The theory

– Hierarchy of emotionsHigh Reason

Feelings

Emotions

Basic LifeRegulation

15

Theory to Practice• Intuitive

• Evolving practice

• What’s new?– Creative thinking/ recruitment– Atmosphere– Set no boundaries – big picture– Moderation – low key, empathetic– Large breakout groups

16

Techniques

17

Techniques

18

Techniques

19

Working it out…(Informed Logic Outcomes)

20








action



mitigation behavior



mitigation











declare





solutions



Increased Inward Travelers’understanding of biosecurity

21

Model Refinement

A Travellers/ countries of origin/ sea portsB StakeholdersC NZ Public-mitigation measuresD NZ Public-personal actionE Business, importers, productionF EducationG Environment








declare

Increased Understanding of Ballast Water and

Hull Cleaning Procedures



solutions

Increased understanding of ballast water and hull cleaning

procedures

ShippingSailorsYachtiesCruise Ships

Increased under-standing of what not to bring into NZ and what

to declare

Travellers-Casual-Frequent-Sport-Business-O/S students-Recreation-Ethnic groups-Friends/relativesIncreased under-

standing of what to look for and how to respond

if you see something suspicious

‘Responsible’ NZersElderlyChildrenGardenersProduction SectorEnvironmentalistsIncreased stakeholder

understanding of the problem and solutions

Enforcement, Educative & Eradication Agencies



Ignorant/Unaware General public

Increased understanding of personal action needed

for effective mitigation

Travel agentsAirline staffTourism BoardEmbassiesInternational airports

Audiences


Increased Stakeholders’ understanding of biosecurity

Increased Inward Travellers’understanding of biosecurity

Increase Information Sources in Countries of Origin

Increased Business/Importers/Primary Producers understanding of biosecurity

Increased Environmental Groups understanding of biosecurity

Increased Media/Educatorsunderstanding of Biosecurity



Increased Inward Travellers’ understanding of biosecurity

Increased Permanent Recent Arrivals understanding of biosecurity

Additional Audiences

Increased Sea Port Users understanding of biosecurity







action

Heavy penaltiesBorder controlEducation

Increased willingness to take preventive action

Increased stakeholder willingness to participate in

partnerships Partnership/cooperationCare for your countryEconomic benefit



Increased willingness to take mitigation action

Health and economic repercussionsFuture generationsCare for your countryPartnership

Actions/ Messages

25

Revolution? No Evolution!

26Increased NZ public understanding of biosecurity

Increased awareness ofWhat not to bring and what

To declare

Increased awareness ofPersonal action needed for

Effective mitigation

Increased awareness ofNeed for mitigation and

management

IncreasedSupport by

Individuals forBorder

Regulation thatPersonally

Affects them

Increased Local supportFor specificMitigationactivities

IncreasedNational

Support forSpecific

Mitigationactivities

Increased awareness of what to look for and how to respond if aperson sees something suspicious

Increased appropriatePreventivebehavior

Increased willingnessTo take preventive

action

Increased willingnessTo take mitigation

action

Increased stakeholderWillingness to

participate

Increased appropriateMitigationbehaviour

Increased appropriateStakeholder

activity

Pests within New Zealand are managedHarmful and potentially harmful organisms do not crossNew Zealand’s borders

Improved Biosecurity

Well supportedMitigation activities

Increased awareness ofNeed for strong borders

IncreasedSupport for

StrongBorder

regulation

Biosecurity Logic Model

27

The next step…(Implemented Logic)

28

Implemented Logic

• Informed by:– Empirical evidence attributed to programme– Expert opinion– Tailored research

29

Role of Research

• In-depth understanding – attitudes, motivations, behaviour

• Segmentation to manage priority audiences and direct resources

• Direct communication• Measure on-going performance of

programme

30

• Personal importance of biosecurity (e.g. 31% very important)

• Importance of biosecurity to New Zealand

• Knowledge of key actions to enhance New Zealand biosecurity

• Increased appropriate preventive behaviour (from a range of actions)

• Increased support for strong border regulation (from a range of actions


To declare

IncreasedSupport by



Affects them



action

Harmful and potentially harmful organisms do not crossNew Zealand’s borders



StrongBorder

regulationIncreased awareness of what to look for and how to respond if a

person sees something suspicious

Measures: Prevention

31

• Support of increased national mitigation action (e.g. 29% strong support)

• Willingness to accept localised mitigation activities

• Awareness of personal responsibility

• Willingness to take specific mitigation activities (specific actions)




management


IncreasedNational

Support forSpecific



action


Pests within New Zealand are managed

Well supportedMitigation activities


Measures: Mitigation

32

Increased NZ public understanding of biosecurity


To declare




management


Develop AWARENESS ofBiosecurity as a consumerconcern

GOAL:Create reasons for actionand desire to get involved

Personal Relevance

Programme Launch

Source: Social Change Media http://media.socialchange.net.au/strategy/

33

Action PlanProvide actions that people can take to support biosecurity outcomes –

DESIRE, SKILLS, OPTIMISM and FACILITATION

PRE-BORDER: Appropriate preventive behaviour

BORDER: Preventive behaviour and compliance with regulations

POST-BORDER: Take individual action to support biosecurity campaigns and take action in mitigation activities

IncreasedSupport by



Affects them


IncreasedNational

Support forSpecific





action


action

Increased stakeholderWillingness to

participate


Increased appropriateStakeholder

activityWell supported

Mitigation activities


StrongBorder

regulation

34

Only time will tell….(Iterative Process)

35

Working it Out… Again

• Iterative process

• Planned Logic Model

• Informed Logic Model

• Implemented Logic Model

36

We can work it out…(Model in Practice)

37

- Underspecified/ risks- Diverse sectors

- Hard to measure- Cost to measure

Model developed from existing:- Knowledge- Research- Expert opinion

Model tested by:- Existing research- Expert opinion

Research- Ideas generation-Test model

Model informed by:- Empirical data- Expert opinion

Research-Deep understanding-Potent communication-Prioritise-Measure

Model Development

Model Refinement

Model Implementation

Enhanced: - Outcomes- Stakeholderconsultation

- Planning/ decision making

- Implementation

Assists in:- Communication- Reporting- Measurement- Indicatordevelopment

- Evaluation- Priority setting

Impacts for Social

Marketing

Planned Logic Implemented LogicInformed Logic

39

- You may not copy or display for redistribution to third parties or for commercial

purposes any portion of this presentation. You may not republish, retransmit,redistribute or otherwise make such information available to any other partywithout express prior written consent.

- All trade marks, brand names and business names or logos contained in thispresentation are our property or that of their respective owners.

Important Information

a new approach to social marketing: intervention logic ... · intervention logic modeling and...

Documents