presentation objectivesnehacert.org/2014_aec/fs1404.pdfpresentation objectives ... • at google, we...
TRANSCRIPT
1
1
John Marcello
Regional Retail Food Specialist
FDA/ORA/Pacific Region
Improving Behaviors on the Front Line
FDA’s Partnership with Google to Test the
Effectiveness of Oral Culture Learner Project Materials
Chuck Catlin, RS, MPA
Global Food Quality & Risk Manager
Google, Inc.
78th NEHA AEC Conference, Las Vegas, NV
2
Presentation Objectives
• Attendees will be able to describe:
– Differences between oral and print culture learners
– FDA’s Oral Culture Learner Project (OCLP)
– The experiment conducted in partnership with Google to test the effectiveness of the OCLP materials
3
The Faces and Families Behind the Statistics (Source: http://www.stopfoodborneillness.org)
2
4
5
Oral versus Print Culture Learners
• Dr. Donna Beegle
• 2004 Oregon Environmental Health Specialist Network (EHS-Net) Communication Study
• Study conclusion:– Food employees = oral culture learners– Regulators = print culture learners
Oral versus Print Culture Communication:How we receive, process, & retain information
• Oral • Print
6
3
7
Recommendations for Communicating Food Concepts to Oral Culture Learners
(cont’d)
• Share stories, sayings, vivid examples of outbreaks
• Stress the importance of role modeling
• Have information presented by someone they trust
• Use simple words or examples food workers can relate to
• Present information verbally and often(Beegle, 2004)
8
Recommendations for Communicating Food Concepts to Oral Culture Learners
(cont’d)
• Minimize power dynamic (with exception, use eye contact)
• Focus on the big picture, not the gory details
• Be interactive
(Beegle, 2004)
9
FDA’s Oral Culture Learner Projecthttp://www.fda.gov/foodemployeetraining
• Multi-language posters, storyboards, and video testimonials
• Available for free
• Focus on the consequences of not following the food safety practice
• Are designed to enhance, not replace, existing training materials
4
5
13
To order free posters, go tohttp://www.fda.gov/foodemployeetraining
14
Foodborne Illness Victim Video Testimonials
• Available for viewing and download
• Spanish and English closed captioning
15
To view the testimonials, go to http://www.fda.gov/foodemployeetraining
6
16
To download the testimonials, go to http://www.fda.gov/foodemployeetraining
17
FDA Oral Culture Learner Project –Current and Future Activities
• Additional posters and storyboards will be posted soon
• DVDs and display kits available soon
• Consultation with Stakeholder Group to improve project marketing and delivery
• More video testimonials?
18
Partnership between FDA and Google to Test the Effectiveness of the Oral Culture Learner Project
Materials
Chuck Catlin, RS, MPA Global Food Quality & Risk Manager
Google, Inc.
7
“Emotion is evolutions way of giving meaning to our lives.”
Dr. Gordon H. Bower 1992 Stanford University
“An emerging theme is the question of how emotion interacts with and influences other domains of cognition in particular attention, memory and reasoning.”
Dr. R.J. Polan 2002
Definition of Insanity
Repeating the same process over and over and expecting to get different outcomes……
• At Google, we are always looking for the next 10X project. Not incremental improvement, but exponential improvement.
– Google Search Engine
– Voice Recognition and Translation
– Driverless Car
Google-FDA PartnershipEffectiveness Experiment
8
Could The FDA Oral Culture Materials be a 10X Food Safety Training System?
• Could the FDA Oral Culture training provide the spark to better outcomes and increased positive food safety behaviors?
– Learning
– Recall
– Actual Behavior Change
Google is not working on the true Neuralyzer
23
So What Did We Do?
• What were our goals?
– To see a positive directional change in behavioral performance by using the Oral Culture learning materials
• We did not do a controlled study
– Not possible to completely control the environment
– Not enough participants (+300)
– Did not provide long enough training (1.5 hour sessions)
– Be Safe Training
9
Goal is 100% Compliance with the
Be Safe behaviors
26
Google-FDA PartnershipEffectiveness Experiment
• Participants:
– Google Food Team
– Bon Appetit
– FDA
– Santa Clara County, CA Health Department
– Monterey County, CA Health Department
27
Google-FDA PartnershipEffectiveness Experiment
• Location: Googleplex, Mountain View, CA
• 35 full service establishments
• Focus on poor personal hygiene risk factor
• Baseline data collection
• All employees had basic CA food handler training & Bon Appetit corporate training
10
28
Google-FDA PartnershipEffectiveness Experiment
• 24 establishments grouped into three cohorts:
– Cohort 1 received no additional training (control)
– Cohort 2 received food handler training
– Cohort 3 received food handler + oral culture training
• 307 food employees trained
• Behavior change was evaluated using post training audit data
29
Group Activity Using the Oral Culture Posters/Videos
• What food safety messages were communicated in the poster/video?
• How did the poster/video make you feel?
• Did the poster/video make you want to ____________?
What Did We See
• We saw the directional improvement needed to move forward with Phase II
• Food handlers who received the Oral Culture Training would stop me as I walked through the kitchen to say we are working hard not to kill Mrs. Ploghoft
11
Phase II
• Google will help support the development of an on-line food handler class that features the Oral Culture materials (Will help to enhance the current material)
• Google will work with the FDA to help develop daily flash card reminder training for alley rallies or other quick real time training reminders
• Continue to measure the progress. We would love to see 10X improvement in food safety behaviors. (100% Compliance with Be Safe)
32
John Marcello
Regional Retail Food Specialist
FDA/ORA/Pacific Region
(480) 829-7396 x2035
Chuck Catlin, RS, MPA
Global Food Quality & Risk Manager, Google, Inc.
(602) 769-1418 [email protected]
• Univ. of Minnesota Extension
• Johnson and Wales
• UGA, Center for Food Safety
• MI State University
• Wegmans
• Food Handler
• El Pollo Loco
• CKE Restaurants
• Yum! Brands
• Chick-fil-A
• Sodexo
• Steritech
• Big Y Foods
• Compass Group
• Darden
• RaceTrac
33
2013 – 2014 Stakeholder Group
12
• Oregon Health Authority
• WA Dept of Health
• Alameda Co., CA Environmental Health
• San Diego County
• New Jersey Dept. of Health
• Univ. of Minnesota Extension
• California Emerging Infections Program
• Food Marketing Institute
• National Restaurant Association
• FL Restaurant & Lodging Association
• Bojangles
• Kroger
• Ecolab
34
2013 – 2014 Stakeholder Group