1 research based program assessment measuring innovation self-efficacy liz gerber...

30
1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber [email protected] @elizgerber Northwestern University Adam Carberry [email protected] Arizona State University Venture Well Washington DC 032015

Upload: ellen-manning

Post on 13-Jan-2016

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

1

Research Based Program AssessmentMeasuring Innovation Self-Efficacy

Liz [email protected]@elizgerberNorthwestern University

Adam Carberry [email protected] State University

Venture Well Washington DC 032015

Page 2: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

22

Page 3: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

3

Page 4: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

4

What do we call people who innovate?*

Page 5: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

5

How do we prepare people to be innovators?

Page 6: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

6

Invest in innovation education6

Page 7: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

7

&

Graphic designed by Nick Levesque from the Noun Project

Page 8: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

8

And yetFew measures are available for evaluating the effectiveness of these interventions

Page 9: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

9(Ford, 1996, Shalley & Perry-Smith, 2001, Bandura, 1997)

Innovators

Domain expertise

Skills * analytical* creative* social

Self-Efficacy

Page 10: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

10

Innovation Self-EfficacyBelief in the ability to accomplish tasks necessary for innovating

(Gerber, 2011, Gerber, Olson, & Komarek, 2012, Gerber et al, 2012)

Graphic designed by Antonis Makriyannis from the Noun Project

A B

Page 11: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

11

Innovation Self-EfficacyBeliefs in ability influence goal setting, effort, persistence, learning and attribution of failure.

(Bandura, 1997, Deci & Ryan, 1985, Schunk, 1984)

Graphic designed by Antonis Makriyannis from the Noun Project

A B

Page 12: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

12

GoalTo develop a measure for Innovation Self-Efficacy

Page 13: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

13

METHOD

Literature ReviewDesignBusinessPsychologyEngineeringOrg Management

Expert interviews

38 skills & behaviors related to innovation

(Bandura, 2006, Tierney & Farmer, 2002, Carberry et al, 2010)

Page 14: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

15

Method

Survey (N=22)

Literature Review Expert interviews

38 skills & behaviors related to innovation

25 skills & behaviors related to innovation

Page 15: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

16

TOTAL : 79 survey items

FOR EACH SKILL & BEHAVIOR3-4 different statements

Imagination 

“Come up with a lot of creative ideas.”“Come up with imaginative ideas.”“Do things in an original way.”“Think of many different ideas when considering a problem.”

Page 16: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

17

Method

Survey (N=22)

Literature Review Expert interviews

38 skills & behaviors related to innovation

25 skills & behaviors related to innovation

Pilot (N=62)

Page 17: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

18

Method

Survey (N=22)

Literature Review Expert interviews

38 skills & behaviors related to innovation

25 skills & behaviors related to innovation

Pilot (N=62) 13 skills & behaviors related to innovation

Page 18: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

19

Method

Survey (N=22)

Literature Review Expert interviews

38 skills & behaviors related to innovation

25 skills & behaviors related to innovation

Pilot (N=62) 13 skills & behaviors related to innovation

Survey (N=191) 8 skills & behaviors related to innovation

Page 19: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

21

8 SKILLS AND BEHAVIORS RELATED TO INNOVATION

CreativityExplorationIterationImplementationCommunicationResourcefulnessSynthesisVision

Cronbach’s alpha: .807-.907

Page 20: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

30

ContributionMeasure of Innovation Self-Efficacy

Creativity (Tierney & Farmer, 2002)

Engineering design (Carberry et al, 2010)

Modeling (Yildirim et al 2010)

Tinkering (Baker et al 2008)

Entrepreneurship (Chen et al, 1998)

Page 21: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

31

Analyze 260 additional surveys

Relate measure to innovation outcomes

Ongoing Work

Page 22: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

32

Experimental Platform (loft.io)

(Easterday, Rees Lewis, & Gerber, 2014, 2015)

Page 23: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

33

Experimental Platform (loft.io)

(Easterday, Rees Lewis, & Gerber, 2014, 2015)

Page 24: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

34

Experimental Platform (loft.io)

(Easterday, Rees Lewis, & Gerber, 2014, 2015)

Page 25: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

35

Page 26: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

36

Innovation EducationDevelop Domain Expertise, Skills, and Beliefs

(Gerber, 2012, 2015)

Page 27: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

37

Research Based Program AssessmentMeasuring Innovation Self-Efficacy

Liz [email protected]@elizgerberNorthwestern University

Adam Carberry [email protected] State University

Page 28: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

3838

Page 29: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

39

Influential Categories of Innovation Self-Efficacy

Page 30: 1 Research Based Program Assessment Measuring Innovation Self-Efficacy Liz Gerber egerber@northwestern.edu @elizgerber Northwestern University Adam Carberry

40

29 items