rea: performance appraisal & workplace performance
TRANSCRIPT
![Page 1: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/1.jpg)
Performance Appraisal & Workplace Performance
CIPD, Applied Research Conference 19 December 2016, London
![Page 2: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/2.jpg)
Postgraduate Course
![Page 3: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/3.jpg)
Postgraduate Course
![Page 4: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/4.jpg)
![Page 5: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/5.jpg)
CEBMa: what we do
Promote (seminars, papers, blogs, tweets)
Educate (universities & business schools)
Train & coach (companies > projects)
Conduct (and teach) REAs
![Page 6: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/6.jpg)
EBP: what is it?
Evidence-based practiceCentral Premise:
Decisions should be based on the ‘best available evidence‘.
![Page 7: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/7.jpg)
Best available = critically evaluated evidence
from multiple sources
EBP: what is it?
![Page 8: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/8.jpg)
Evidence?
information, facts or data supporting (or contradicting) a claim, assumption or hypothesis
![Page 9: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/9.jpg)
Sources of evidence
problem solution
Practitionersprofessional expertise
Organization internal data
Stakeholdersvalues and concerns
Scientific literature empirical studies
AskAcquire
AppraiseAggregate
ApplyAssess
![Page 10: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/10.jpg)
![Page 11: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/11.jpg)
![Page 12: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/12.jpg)
![Page 13: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/13.jpg)
Claims
![Page 14: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/14.jpg)
Claims
![Page 15: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/15.jpg)
Claims
![Page 16: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/16.jpg)
Claims
![Page 17: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/17.jpg)
Claims
![Page 18: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/18.jpg)
![Page 19: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/19.jpg)
Sources of evidence
problem solution
Practitionersprofessional expertise
Organization internal data
Stakeholdersvalues and concerns
Scientific literature empirical studies
AskAcquire
AppraiseAggregate
ApplyAssess
![Page 20: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/20.jpg)
ABI/INFORM: more than 5,000 publications
(BTW, most of it is crap)
Problem 1: volume
![Page 21: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/21.jpg)
Problem 2: incomprehensible
![Page 22: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/22.jpg)
Problem 3
It depends …
![Page 23: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/23.jpg)
GREAT! NOW WHAT?
![Page 24: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/24.jpg)
We need evidence summaries!
Systematic Review (SR)
The agreed-upon standard approach to scientific evidence assessment across fields as diverse as medicine, education, criminal justice etc. and follows a transparent structured methodology for reviewing an entire body of relevant research evidence
![Page 25: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/25.jpg)
Rapid Evidence Assessment (SR light)
Searching: consulting a limited number of databases, and excluding unpublished research. Sometimes an REA may be limited to only meta-analyses or controlled studies.
Data Extraction: only extracting a limited amount of key data, such as year, population, sector, sample size, moderators/mediators, main findings, and effect size.
Critical Appraisal: limiting quality appraisal to methodological appropriateness and methodological flaws.
We need evidence summaries!
![Page 26: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/26.jpg)
![Page 27: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/27.jpg)
Step 1: ASK
What is known in the scientific literature about the impact of performance appraisal on workplace performance?
1. What is performance appraisal?2. How is it supposed to work?3. What is the effect on workplace performance?4. What is known about possible moderators and/or mediators5. What is known about the reliability and validity?
![Page 28: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/28.jpg)
Step 2: ACQUIRE
Search for the best available scientific evidence
![Page 29: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/29.jpg)
ABI, BSP, PsycINFO
Scholarly journals, peer reviewed
English, scholarly journals, peer-reviewed
1980 to 2016 for meta-analyses; 2000 to 2016 for primary studies
Key words: performance appraisal, performance review, performance evaluation, annual review, and employee evaluation.
Step 2: ACQUIRE
![Page 30: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/30.jpg)
![Page 31: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/31.jpg)
step 3: APPRAISE
![Page 32: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/32.jpg)
step 3: APPRAISE
![Page 33: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/33.jpg)
![Page 34: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/34.jpg)
Oh, and we never look at the p-value, only at the effect sizes
![Page 35: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/35.jpg)
![Page 36: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/36.jpg)
Q1: What is it?
‘An evaluation process in which quantitative scores based on pre-determined criteria are assigned and shared with the employee being evaluated’ (e.g. DeNisi & Pritchard, 2006)
![Page 37: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/37.jpg)
Q2: How does it work?
![Page 38: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/38.jpg)
Social comparison theory: individuals tend to compare themselves with others in order to make judgments
regarding their performance.
They are concerned not only about their performance in an absolute sense, but also about how they measure up in
relation to relevant peers.
Q2: how is it supposed to work?
Feedback intervention theory: suggests that when confronted with a discrepancy between what they wish to achieve and the feedback received, individuals are strongly
motivated to attain a higher level of performance
![Page 39: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/39.jpg)
Q3: Does it work?
![Page 40: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/40.jpg)
Q4: Moderators and mediators?
![Page 41: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/41.jpg)
Q4: Moderators and mediators?
1. Reactions to feedback, rather than the feedback itself, influence performance (level A)
2. The perceived fairness of the performance appraisal process has a medium to large moderating effect on future performance (level A)
3. Negative feedback adversely affects perceived fairness (level C*), whereas feedback that focusses only on positive aspects has a medium positive effect on both perceived fairness and overall job performance (level A*)
4. Participation has a medium to large moderating effect on perceived fairness (level B).
5. The quality of the relationship between manager and employee has a substantial moderating effect on the perceived fairness of the performance appraisal (level B)
![Page 42: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/42.jpg)
Q5: Reliability & validity?
![Page 43: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/43.jpg)
Q5: Rater centric errors
1. Employees’ contextual performance has a large positive effect on job performance ratings (level A).
2. Managers’ implicit person theory regarding the malleability of personal attributes has a large effect on how they rate their employees (level A).
3. Rater training has medium to large positive effects on rating accuracy (level A).
4. The outcome of managers’ own performance appraisal has a large effect on the way in which they evaluate their employees (level A).
5. Male employees who experience a conflict between family and work receive lower performance ratings (level A)
![Page 44: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/44.jpg)
Q5: Ratee centric errors
1. Employees’ tactics for influencing raters such as ingratiation or self-promotion have a moderate effect on performance ratings (level C).
2. Employees’ organizational citizenship behaviour has a moderate to large positive effect on performance ratings (level A).
3. Employees’ political skills have a small positive effect on performance ratings (level C).
![Page 45: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/45.jpg)
Q5: System centric errors
1. The purpose of the performance (administrative vs developmental) moderates the performance rating (level A).
2. The reliability of individual performance measures depends on the type of measurement, the source of measurement and the level of job complexity (level A/B).
3. Accountability substantially affects both rating outcomes and rating accuracy (level A).
![Page 46: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/46.jpg)
Step 4: Synthesize
![Page 47: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/47.jpg)
Step 5: Apply
![Page 48: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/48.jpg)
Reactions
Who knew?
![Page 49: REA: Performance Appraisal & Workplace Performance](https://reader034.vdocuments.mx/reader034/viewer/2022042723/587016771a28ab7f428b58eb/html5/thumbnails/49.jpg)