what we know about non- cognitive constructs and workplace outcomes paul sackett
TRANSCRIPT
![Page 1: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/1.jpg)
What We Know about Non-Cognitive Constructs and
Workplace Outcomes
Paul Sackett
![Page 2: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/2.jpg)
Question: what non-cognitive constructs are valued in the workplace?
Sources of information:
1) The research literature on the use of non-cognitive constructs to predict work behaviors
2) Literature on constructs employers seek in job applicants
3) Job-analytic data on constructs important for various occupations
![Page 3: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/3.jpg)
Approach 1: The literature on non-cognitive constructs predicting work outcomes
• The predictor side of the equation– Confounding of constructs and methods is
common• Many predictors are methods that can be used to
measure various constructs (e.g., interviews, situational judgment tests)
– Focus on constructs in the personality domain• The “Big 5” as a broad general framework• Conscientiousness, Agreeableness, Openness,
Emotional Stability, Extraversion as the highest level aggregates
![Page 4: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/4.jpg)
The “Big 5”
• Conscientiousness– Dependable, achievement-striving, hardworking,
persevering, orderly• Agreeableness
– Cooperative, flexible, tolerant, forgiving• Emotional Stability
– Calm, self-confident, resilient• Extraversion
– Sociable, talkative, assertive, active• Openness to experience
– Curious, broad-minded, intelligent, cultured
![Page 5: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/5.jpg)
Approach 1: Non-cognitive constructs and work outcomes (continued)
• The criterion side of the equation– Current frameworks focus on three
components of overall job performance
• Task performance
• Organizational Citizenship Behavior (OCB)
• Counterproductive Work Behavior (CWB)
![Page 6: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/6.jpg)
Approach 1: Non-cognitive constructs and work outcomes (continued)
• Strategy: examine the Big 5 as predictors of Task Performance, OCB, and CWB
• Focus on “landmark” studies and meta-analyses
• Analysis is “impressionistic”, looking for general patterns
• Analysis represents grand average across jobs
![Page 7: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/7.jpg)
Big 5 Predicting Organizational Citizenship Behavior (OCB)
Mean Min Max Mean
Rank
Conscientiousness 0.21 0.18 0.30 1.5
Agreeableness 0.14 0.10 0.20 2
Emotional Stability0.16 0.14 0.17 2.5
Extraversion 0.08 0.05 0.11 4
Openness 0.03 0.01 0.05 5
![Page 8: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/8.jpg)
Big 5 Predicting Organizational Citizenship Behavior (OCB)
Mean Min Max Mean
Rank
Conscientiousness 0.21 0.18 0.30 1.5
Agreeableness 0.14 0.10 0.20 2
Emotional Stability0.16 0.14 0.17 2.5
Extraversion 0.08 0.05 0.11 4
Openness 0.03 0.01 0.05 5
![Page 9: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/9.jpg)
Big 5 Predicting Organizational Citizenship Behavior (OCB)
Mean Min Max Mean
Rank
Conscientiousness 0.21 0.18 0.30 1.5
Agreeableness 0.14 0.10 0.20 2
Emotional Stability0.16 0.14 0.17 2.5
Extraversion 0.08 0.05 0.11 4
Openness 0.03 0.01 0.05 5
![Page 10: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/10.jpg)
Big 5 Predicting Organizational Citizenship Behavior (OCB)
Mean Min Max Mean
RankConscientiousness 0.21 0.18 0.30 1.5
Agreeableness 0.14 0.10 0.20 2
Emotional Stability 0.16 0.14 0.17 2.5
Extraversion 0.08 0.05 0.11 4
Openness 0.03 0.01 0.05 5
![Page 11: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/11.jpg)
Big 5 Predicting Counterproductive Work Behavior (CWB)
Mean Min Max Mean RankConscientiousness 0.30 0.23 0.46 1.67Agreeableness 0.27 0.08 0.46 1.67Emotional Stability 0.16 0.06 0.24 3Extraversion 0.02 -0.02 0.09 5Openness 0.00 -0.14 0.09 3.67
***CWB is reverse scored: interpret as “avoiding CWB”
![Page 12: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/12.jpg)
Big 5 Predicting Counterproductive Work Behavior (CWB)
Mean Min Max Mean RankConscientiousness 0.30 0.23 0.46 1.67Agreeableness 0.27 0.08 0.46 1.67Emotional Stability 0.16 0.06 0.24 3Extraversion 0.02 -0.02 0.09 5Openness 0.00 -0.14 0.09 3.67
***CWB is reverse scored: interpret as “avoiding CWB”
![Page 13: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/13.jpg)
Big 5 Predicting Counterproductive Work Behavior (CWB)
Mean Min Max Mean RankConscientiousness 0.30 0.23 0.46 1.67Agreeableness 0.27 0.08 0.46 1.67Emotional Stability 0.16 0.06 0.24 3Extraversion 0.02 -0.02 0.09 5Openness 0.00 -0.14 0.09 3.67
***CWB is reverse scored: interpret as “avoiding CWB”
![Page 14: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/14.jpg)
Big 5 Predicting Counterproductive Work Behavior (CWB)
Mean Min Max Mean RankConscientiousness 0.30 0.23 0.46 1.67Agreeableness 0.27 0.08 0.46 1.67Emotional Stability 0.16 0.06 0.24 3Extraversion 0.02 -0.02 0.09 5Openness 0.00 -0.14 0.09 3.67
***CWB is reverse scored: interpret as “avoiding CWB”
![Page 15: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/15.jpg)
Big 5 Predicting Task Performance
Mean Min Max Mean
Rank
Conscientiousness 0.17 0.03 0.23 1.6
Agreeableness 0.09 -0.01 0.28 3
Emotional Stability0.16 0.07 0.28 3
Extraversion 0.11 0.06 0.18 3.6
Openness 0.13 0.04 0.24 3.8
![Page 16: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/16.jpg)
Big 5 Predicting Task Performance
Mean Min Max Mean
RankConscientiousness 0.17 0.03 0.23 1.6
Agreeableness 0.09 -0.01 0.28 3
Emotional Stability 0.16 0.07 0.28 3
Extraversion 0.11 0.06 0.18 3.6
Openness 0.13 0.04 0.24 3.8
![Page 17: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/17.jpg)
Big 5 Predicting Task Performance
Mean Min Max Mean
Rank
Conscientiousness 0.17 0.03 0.23 1.6
Agreeableness 0.09 -0.01 0.28 3
Emotional Stability0.16 0.07 0.28 3
Extraversion 0.11 0.06 0.18 3.6
Openness 0.13 0.04 0.24 3.8
![Page 18: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/18.jpg)
Big 5 Predicting Task Performance
Mean Min Max Mean
RankConscientiousness 0.17 0.03 0.23 1.6
Agreeableness 0.09 -0.01 0.28 3
Emotional Stability 0.16 0.07 0.28 3
Extraversion 0.11 0.06 0.18 3.6
Openness 0.13 0.04 0.24 3.8
![Page 19: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/19.jpg)
Overall pattern of predictors of job performance
• Conscientiousness, agreeableness and emotional stability emerge as the constructs most predictive of various work behaviors
• Also: high level of predictive validity found for widely-used measures of Integrity and Customer Service Orientation
– Research shows these to be “compound traits”, each reflecting a composite of conscientiousness, agreeableness, and emotional stability
![Page 20: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/20.jpg)
Approach 2: Constructs employers seek in job applicants
• The interview is virtually always used in hiring• Structured vs. unstructured interviews
– Structured interviews typically specify a set of attributes to be evaluated
• Huffcutt et al (2001) examined 47 studies of structured interviews
– They sorted the 338 rated attributes into categories– This gives us some insight into what employers are
seeking in job candidates
![Page 21: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/21.jpg)
Most frequently evaluated non-cognitive constructs in structured interviews
• Conscientiousness– Dependability, responsibility, need for
achievement, sense of duty, initiative
• Interpersonal skills– Working with others, teamwork , cooperation
• Emotional stability– Stress tolerance, self-control
• Extraversion– Assertiveness, dominance, drive, ambition
![Page 22: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/22.jpg)
Additional issues with interview constructs
• Other constructs rated include cognitive skills (e.g., problem solving, judgment), oral communication skills, and leadership skills
• Caveat: we don’t know whether unstructured interviews focus on similar constructs
![Page 23: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/23.jpg)
Approach 3: Job-analytic data on constructs important for various occupations
• O*Net: a Department of Labor-sponsored occupational analysis system
• Based on a “content model” in which occupations are evaluated in terms of 277 attributes in 6 major categories
• Each of 681 occupations have been evaluated in terms of these attributes, by incumbents, job analysts, or both
![Page 24: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/24.jpg)
![Page 25: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/25.jpg)
Non-cognitive constructs in O*Net
• From the “Work Styles” category:
Achievement/Effort Persistence Initiative Leadership Cooperation Concern for Others Social Orientation Self Control Stress Tolerance Adaptability/Flexibility Dependability Attention to Detail Integrity Independence Innovation
Analytical Thinking
![Page 26: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/26.jpg)
Constructs are rated on importance
• 1 - Not important2 - Somewhat important3 - Important4 - Very important5 - Extremely important
• Examine the mean importance of each construct across occupations
• Weight each occupation by the number of incumbents
– Use Bureau of Labor Statistics Occupational Employment Statistics (OES) survey
![Page 27: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/27.jpg)
Occupations are rated in terms of educational requirements
• Occupations are assigned to “zones”:– 1: less than high school– 2: high school diploma– 3: high school plus– 4: bachelor’s degree– 5: bachelor’s degree plus
![Page 28: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/28.jpg)
Zone 1: less than high school
CashiersFood Preparation and Serving WorkersWaiters and WaitressesJanitors and Cleaners Maids Landscaping and Groundskeeping WorkersConstruction LaborersFood Preparation WorkersPackers and PackagersCooks, Fast Food
![Page 29: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/29.jpg)
Zone 2: High school diploma
Retail SalespersonsOffice ClerksCustomer Service RepresentativesLaborers and Freight, Stock, and Material MoversSecretariesTruck DriversNursing Aides, Orderlies, and AttendantsFirst-Line Supervisors/Managers of Retail Sales
WorkersReceptionists and Information ClerksSecurity Guards
![Page 30: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/30.jpg)
Zone 3: High school plus
Registered Nurses
Bookkeeping, Accounting, and Auditing Clerks
General and Operations Managers
Sales Representatives, Wholesale and Manufacturing
First-Line Supervisors/Managers
Executive Secretaries
Teacher Assistants
Licensed Maintenance and Repair Workers
Practical and Licensed Vocational Nurses
![Page 31: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/31.jpg)
Zone 4: Bachelor’s degree
Elementary School Teachers
Secondary School Teachers
Middle School Teachers
Management Analysts
Computer Systems Analysts
Computer Software Engineers
Sales Representatives (technical)
Computer Programmers
Network and Computer Systems Administrators
![Page 32: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/32.jpg)
Zone 5: Bachelor’s degree plus
Lawyers
Chief Executives
Medical and Health Services Managers
Pharmacists
Vocational, and School Counselors
Education Administrators
Engineering Managers
Physical Therapists
Librarians
![Page 33: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/33.jpg)
Analytic strategy
• For each non-cognitive attribute in O*Net…
• Compute mean importance across occupations…
• Within each of the 5 educational requirement zones
![Page 34: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/34.jpg)
Mean importance: ranked in terms of importance for Zone 2
Zone 1 2 3 4 5
Dependability 4.16 4.37 4.55 4.51 4.6
Integrity 3.83 4.16 4.47 4.46 4.69
Cooperation 4.04 4.15 4.3 4.29 4.34
Self Control 3.99 4.15 4.23 4.17 4.33
Stress Tolerance 3.76 3.93 4.15 4.21 4.31
Concern for Others 3.77 3.87 4.07 3.96 4.23
Adaptability/Flexibility 3.53 3.82 4.05 4.27 4.21
Independence 3.39 3.81 4.03 3.98 4.26
![Page 35: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/35.jpg)
Key facet of Conscientiousness is #1
Zone 1 2 3 4 5
Dependability 4.16 4.37 4.55 4.51 4.6
Integrity 3.83 4.16 4.47 4.46 4.69
Cooperation 4.04 4.15 4.3 4.29 4.34
Self Control 3.99 4.15 4.23 4.17 4.33
Stress Tolerance 3.76 3.93 4.15 4.21 4.31
Concern for Others 3.77 3.87 4.07 3.96 4.23
Adaptability/Flexibility 3.53 3.82 4.05 4.27 4.21
Independence 3.39 3.81 4.03 3.98 4.26
![Page 36: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/36.jpg)
Two key facets of Agreeableness are highly rated
Zone 1 2 3 4 5
Dependability 4.16 4.37 4.55 4.51 4.6
Integrity 3.83 4.16 4.47 4.46 4.69
Cooperation 4.04 4.15 4.3 4.29 4.34
Self Control 3.99 4.15 4.23 4.17 4.33
Stress Tolerance 3.76 3.93 4.15 4.21 4.31
Concern for Others 3.77 3.87 4.07 3.96 4.23
Adaptability/Flexibility 3.53 3.82 4.05 4.27 4.21
Independence 3.39 3.81 4.03 3.98 4.26
![Page 37: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/37.jpg)
Two key facets of Emotional Stability are highly rated
Zone 1 2 3 4 5
Dependability 4.16 4.37 4.55 4.51 4.6
Integrity 3.83 4.16 4.47 4.46 4.69
Cooperation 4.04 4.15 4.3 4.29 4.34
Self Control 3.99 4.15 4.23 4.17 4.33
Stress Tolerance 3.76 3.93 4.15 4.21 4.31
Concern for Others 3.77 3.87 4.07 3.96 4.23
Adaptability/Flexibility 3.53 3.82 4.05 4.27 4.21
Independence 3.39 3.81 4.03 3.98 4.26
![Page 38: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/38.jpg)
Key point: Same constructs are “top rated” across zones
Zone 1 2 3 4 5
Dependability 4.16 4.37 4.55 4.51 4.6
Integrity 3.83 4.16 4.47 4.46 4.69
Cooperation 4.04 4.15 4.3 4.29 4.34
Self Control 3.99 4.15 4.23 4.17 4.33
Stress Tolerance 3.76 3.93 4.15 4.21 4.31
Concern for Others 3.77 3.87 4.07 3.96 4.23
Adaptability/Flexibility 3.53 3.82 4.05 4.27 4.21
Independence 3.39 3.81 4.03 3.98 4.26
![Page 39: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/39.jpg)
More differentiation among zones for constructs less important for Zone 2
Zone 1 2 3 4 5
Initiative 3.36 3.72 4.12 4.25 4.39
Persistence 3.16 3.56 3.95 4.16 4.29
Achievement/Effort 3.22 3.53 3.82 4.08 4.23
Attention to Detail 3.22 3.53 3.82 4.08 4.23
Social Orientation 3.44 3.52 3.68 3.66 3.87
Analytical Thinking 2.79 3.32 3.83 4.15 4.32
Leadership 3.01 3.28 3.78 4.00 4.22
Innovation 2.80 3.26 3.61 3.88 3.89
![Page 40: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/40.jpg)
Summary
• Examined three sources of information:– Studies correlating personality measures with task
performance, citizenship and counterproductive work behavior
– Attributes rated in structured employment interviews– O*Net ratings of the importance of various attributes
• Common findings across sources– Conscientiousness (dependability– Agreeableness (cooperation, teamwork)– Emotional Stability (stress tolerance, self control)
![Page 41: What We Know about Non- Cognitive Constructs and Workplace Outcomes Paul Sackett](https://reader036.vdocuments.mx/reader036/viewer/2022062523/551b59d15503465c7e8b5eda/html5/thumbnails/41.jpg)
Discussion
• These constructs are broadly relevant– for jobs available to high school graduates– for jobs requiring additional education
• Can one’s standing on these constructs be changed?
– School is a setting with multiple opportunities to develop and reward behaviors relevant to these constructs