mcgraw-hill/irwincopyright © 2014 by the mcgraw-hill companies, inc. all rights reserved. surveys...

38
McGraw-Hill/Irwin Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

Upload: alicia-craycroft

Post on 29-Mar-2015

220 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

McGraw-Hill/Irwin Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.

SURVEYS

Chapter 10

Page 2: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-2

Learning Objectives

Understand . . . The process for selecting the appropriate and optimal communication approach.

Factors affect participation in communication studies. Sources of error in communication studies and how to minimize them. Major advantages and disadvantages of the three communication approaches. Why an organization might outsource a communication study.

Page 3: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-3

Pull Quote

“If social media is the temperature check, surveys are the taste test to validate that the meal is cooked properly. A good survey enables you to: (1) tune out the noise and zero in on the opinions and comments that are directly applicable to your most pressing questions, and (2) validate trends and shifts in preference that you may have suspected, but weren’t certain about.”

Reggie Aggarwal, CEO,Cvent

Page 4: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-4

Data Collection Approach

Page 5: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-5

Selecting a Communication Data Collection Approach

Page 6: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-6

Dilemma for Surveys

“The ubiquity of cell phones and the rapid and continuing development of the Internet have completely altered the way we talk to each other, the way marketers talk to customers, the way customers shop and the way the media research their audiences.”

Alain Tessier, founder, Mediamark Research, Inc.

Page 7: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-7

Communication Approach

StrengthsVersatilityEfficiencyGeographic

coverage WeaknessesErrorInaccessible

populations

Page 8: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-8

Sources of Error

Measurement Questions

Interviewer

Participant

Page 9: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-9

Participant Motivation

Page 10: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-10

Response Terms

Noncontact rate

Refusal rate

Incidence rate

Page 11: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-11

Communication Approaches

Self-Administered

Survey

Survey via PersonalInterview

TelephoneSurvey

Page 12: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-12

Self-Administered Surveys

Disk-by-MailDisk-by-Mail

InterceptIntercept

ModesModes

Drop-offDrop-off

Mail

CASI

FaxFax

Page 13: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-13

Self-Administered Surveys

AnonymityAnonymity

Topic Coverage

Topic Coverage

SystematicSystematic

Sample Accessibility

Sample Accessibility

Costs

Time Constraints

Page 14: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-14

Designing Questionnaires Using the TDM

Easy to readEasy to read

Offer clear directionsOffer clear directions

Include personalizationInclude personalization

Notify in advanceNotify in advance

Encourage responseEncourage response

Page 15: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-15

Options for Web-based Surveys

Surveying Software

Fee-BasedService

Page 16: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-16

Advantages of Surveying Software

Questionnaire design in word processing environment

Question and scale librariesAutomated publishing to the WebReal-time viewing of incoming dataRapid transmission of resultsFlexible analysis and reporting

mechanisms

Page 17: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-17

The Web as a Survey Research Venue

AdvantagesCost savingsShort turnaroundUse of visual stimuliAccess to

participants Perception of

anonymityAccess to data and

experiences otherwise unavailable

DisadvantagesRecruitmentCoverageDifficulty

developing probability samples

Technical skillSystem

compatibility issuesPossible self-

selection bias

Page 18: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-18

Advantages of Self-Administered Study

Access inaccessible participants

Incentives for higher response rates

Lowest-costGeographic

coverageMinimal staff

neededPerceived

anonymityReflection time

Question complexity

Rapid data collection

Visuals possibleMultiple sampling

possible

Page 19: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-19

Disadvantages of Self-Administered Study

Low response rates in some modes

No interviewer intervention

Cannot be too longCannot be too

complexRequires accurate

list

Skewed responses by extremists

Participant anxiety possible

Directions necessaryNeed for low-

distraction environment

Security

Page 20: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-20

Improving Response Rates

Monetary IncentivesMonetary Incentives

Participation DeadlinesParticipation Deadlines

Promise of AnonymityPromise of Anonymity

Appeal for ParticipationAppeal for Participation

Advance NotificationAdvance Notification

RemindersReminders

Return Directions & DevicesReturn Directions & Devices

Page 21: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-21

Telephone Survey

Traditional

CATI systems

Computer-administered

Page 22: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-22

Designing Questionnaires Using the TDM

Lower Cost vs. Personal InterviewLower Cost vs. Personal Interview

Fast completion timeFast completion time

Random dialingRandom dialing

CATICATI

Wide geographic coverageWide geographic coverage

Fewer InterviewersFewer Interviewers

Reduced interviewer biasReduced interviewer bias

Page 23: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-23

Disadvantages of the Telephone Survey

Lower response rate

Early terminationHigher costs if

geographically dispersed sample

Limited Interview length

Inaccessible populations

Limited complexity of scales

iPhone

Voice-over IP

Page 24: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-24

Survey via Personal Interview

InterceptCAPI

Page 25: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-25

Personal Interview Survey

AdvantagesGood cooperation

ratesInterviewer can

probe and explainVisual aids possibleIlliterate

participants can be reached

Interviewer can prescreen

CAPI possible

DisadvantagesHigh costsNeed for highly

trained interviewersTime consumingLabor-intensiveSome unwilling to

invite strangers into homes

Interviewer bias possible

Page 26: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-26

Key Terms

Communication approach

Computer-administered telephone survey

Computer-assisted personal interviewing (CAPI)

Computer-assisted self interview (CASI)

Disk-by-mail survey

Computer-assisted telephone interviewing (CATI)

Intercept interview

Interviewer error Mail survey

Page 27: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-27

Key Terms (cont.)

• Noncontact rate• Nonresponse

error• Panel• Personal

interview• Random dialing• Refusal rate

• Response error• Self-administered

survey• Survey• Telephone

interview• Web-based

questionnaire

Page 28: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

McGraw-Hill/Irwin Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.

ADDITIONAL DISCUSSION OPPORTUNITIES

Chapter 10

Page 29: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-29

Snapshot: Gamification in Research

Page 30: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-30

PicProfile: Methodology Trends

Page 31: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-31

PicProfile: Mixed-mode Research

Page 32: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-32

Snapshot: Are Cell phones & Smartphones Ready for Research?

31.6% wireless only homes31.6% wireless only homes

Multi-method phone studies are the norm

Multi-method phone studies are the norm

Multi-method phone studies are the norm

Multi-method phone studies are the norm

Phone method data is weighted by population parameters

Phone method data is weighted by population parameters

Cell phone studies offer unique challenges.

Cell phone studies offer unique challenges.

Page 33: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-33

PicProfile: Declining Phone Response

Page 34: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-34

Snapshot: Voice Adds Depth

“By eliminating the human interviewer from the call, we allow the caller to participate whenever it suits them, rather than when it suits us.”

Longer, more robust answers to open-ended questions

Longer, more robust answers to open-ended questions

Page 35: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-35

Pull Quote

“There once was a demographic survey doneto determine if money was connected tohappiness, and Ireland was the only placewhere this did not turn out to be true.”

Fiona Shaw Irish actress and theater director

Page 36: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-36

PulsePoint: Research Revelation

45 The percent of smartphone users who check their e-mail before they get dressed.

Page 37: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

McGraw-Hill/Irwin Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.

SURVEYS

Chapter 10

Page 38: McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10

10-38

Photo Attributions

Slide Source

7 ©Ocean/Corbis

14 Fuse/Getty Images

21 Purestock/SuperStock

22 Liam Norris/Getty Images

29 Courtesy of Research Through Gaming

32 ©Siri Stafford Digital Vision/Getty Images