evidence-based management (heinz 94-814) instructor ... · evidence-based management (heinz 94-814)...
TRANSCRIPT
![Page 1: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/1.jpg)
Evidence-Based Management (Heinz 94-814)
Fall 2015
Instructor: Professor Denise M. Rousseau
Voice 8-8470/ Fax 8-5338
Office 2101D HbH (Office Hours start at 4 pm before class)
Class Meeting: Wednesday 6:00-8:50 Place: 2008 HBH
TA: BJ Kim ([email protected])
Contemporary managers are heavily swayed in their thinking and decisions by habit, fads,
convention and unrealistic levels of confidence. Practitioners of evidence-based management
(EBMgt) learn to rethink their approaches to information in order to make more effective
decisions. EBMgt means making decisions based on best available evidence with special
emphasis on relevant scientific findings and unbiased organizational facts. It involves active use
of decision practices that reduce bias and judgment errors and give due consideration to ethical
concerns. This mini course is designed to promote your understanding and use of EBMgt
principles. It guides you in developing the skills and knowledge needed to identify, access, and
use quality evidence in making better decisions.
The instructor is committed to pursuing an evidence-based approach to the course itself.
Scientific evidence strongly supports the effectiveness of participation in learning activities
(Ambrose et al., 2010; Armstrong, 2010; Tough, 1971). Your success in this course will entail
actively using evidence-based processes and practices.
COURSE TOPICS
What It Means to be an Evidence-Based Manager
Finding, Interpreting, and Using Scientific Evidence as Managers (Critically Appraised
Topics or CATs)
Creating Valid Organizational Information from Raw Data
Making it Easier to Use Evidence as a Manager: Logic Models, Decision Aids and
Communities of Practice
Decision Awareness: Types of Managerial Decisions and Evidence-Based Processes
Planning Your On-Going Development as an EBMgr
LEARNING GOALS
This class is intended to help you apply the seven steps of evidence-based practice to
evidence from four sources professional expertise, scientific literature, organizational
data and stakeholder perpspectives. (See EBP STEPS FRAMEWORK)
BEHAVIORAL NORMS:
HOW SHOULD YOU CONDUCT YOURSELF IN THIS COURSE
I. YOU AND THE INSTRUCTOR SHARE RESPONSIBILITY FOR LEARNING
Real learning means changing how we think and act. Not surprisingly, people often resist
information that conflicts with their current beliefs (Armstrong, 2010; Batson, 1975). You can
expect that this class will challenge your beliefs with scientific findings that you have never seen
before. Your job is to actively question your own beliefs (and others’ including the instructor’s),
critically appraise the available evidence, and ask yourself under what conditions you might use
this information, and if not why not.
![Page 2: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/2.jpg)
2
Our class format incorporates evidence-based features of natural learning, including:
A. SETTING LEARNING GOALS.
Establishing learning goals for your EBMgt practice can help overcome the disappointing
tendency that students have to forget much of what they learn within months after completing a
course (e.g., Bacon and Stewart, 2006, found that half of the knowledge from a course on
consumer behavior was lost in 13 weeks).
Your instructor will help you think about and set your personal learning objectives for this class.
Looking to your future as a professional evidence-informed practitioner, this EBMgt course will
conclude with discussion and formulation of learning objectives for your future EBMgt practice.
B. OBTAIN RELEVANT FEEDBACK AND REFLECT ON IT TO MAKE GAINS IN
LEARNING AND PERFORMANCE. Class members will keep learning (b)logs and provide
periodic assessments in which they describe their progress. Completing assignments including
the learning (blog) on time permits timely feedback on your work. Feedback promotes the
accuracy of what you have learned. Assessments that provide relevant feedback are more useful
and informative regarding what is actually learned than faculty ratings of students and student
ratings of faculty (Clayson, 2010; Ofir, Chezy & Itamar Simonson, 2001; Roth et al., 1996). To focus
course feedback on learning, course grades will be based on demonstrated learning. There is no curve.
II. PREPARATION, PARTICIPATION, REFLECTION
A. BEFORE EACH CLASS: PRIME THE PUMP BY COMPLETING ALL
SCHEDULED READINGS, ASSIGNMENTS, AND UPDATING YOUR LEARNING DIARY.
Prior to each class, you are expected to have completed all readings and to have updated your
learning diary (below). Assigned readings should be completed prior to the class for which they
are specified. Readings will be briefly reviewed via cold calling and discussion to check for
understanding at the beginning of each class. Be prepared to answer questions regarding the
readings and more importantly to ask them.
B. IN CLASS: BE FULLY PRESENT. Absolutely no in-class email, websurfing, or
texting. Your instructor will tell you when it is okay to open your laptop and for which tasks. If
you must text your BFF, please go outside. Attention is required for learning—thus we need your
mindful presence (Langer, 1989).
C. AT END OF EACH CLASS: REFLECT ON WHAT YOU HAVE LEARNED.
WHAT QUESTIONS REMAIN? HOW MIGHT THESE BE RESOLVED? Make note of all
these reflections in your learning diary. Share your ideas for improving our learning with
instructor (email, in-class, FTF meeting)—consistent with in-class discussion of After-Action
Reviews.
III. ETHICS: ALL WORK TURNED IN MUST BE ORIGINAL AND YOUR OWN. All
information sources used are to be cited (documents, websites, people). Please ask your
instructor if you have any questions about appropriate citation or academic conduct.
READINGS
Assigned Articles and Cases: provided in class or on-line via Blackboard.
![Page 3: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/3.jpg)
3
Supplementary Resources: For our Critically Appraised Topics or CATs, see page 4 (and your
own professional development), I encourage you to become familiar with original sources of
research relevant to management, especially those available electronically through ABInform,
ProQuest, and Web of Science.
N.B. If you are off-campus when you try to access CMU’s electronic library, you will need to do
so via the CMU Cisco portal.
SOME RECOMMENDED BOOKS: If you are serious about practicing evidence-based
management, certain book may be especially valuable for your personal library …
E.A. Locke: The Handbook of Organizational Behavior: Indispensible Knowledge for Evidence-
Based Management. New York: Wiley. 2nd ed. 2009. Our class addresses the process of EBMgt
practice, while the Handbook presents the actual findings (content) that pertinent to common
organizational decisions.
G. P. Latham: Becoming an Evidence-Based Manager: How to Put the Science of Management to
Work for You. Boston: Davies-Black. 2009. A practical treatment of evidence-based principles for
day-to-day management practice.
J.S. Armstrong: Persuasive Advertising: Evidence-Based Principles. New York: Palmgrave
MacMillan, 2010. Comprehensive treatment of the evidence from advertising, marketing, and
social science research—important resource for marketing professionals, consultants, and
managers.
R. Cialdini: Influence: the Psychology of Persuasion, New York: Collins, 2006.Revised edition.
Presents principles of persuasion based on extensive experimental research tied to practical
examples.
GRADING
I. INDIVIDUAL WORK
A. Participation (20 points): Contributions in the form of attendance, constructive input to class
discussions, posting queries and replies to our course BBoard, and turning in “one-pagers” as
requested. A variety of ungraded “one-page” assignments count toward participation credit. If
they are completed, you will be one step further along on your personal journey toward
enlightenment. What an incentive system.
N.B. Talking is not the same as participating, since excessive talking without offering useful
ideas is disruptive.
B. Learning Logs (30 points)—Keep your logs in our course’s Googledocs folder.
A learning log is not so much a record of what you have read. Instead, it contains what you have
learned and critically reflected on. It is unique to you and what you write is neither right nor
wrong. Try to make it an authentic record of your personal learning experiences in this class.
Studies show that ‘good’ learners organize their learning, set their own goals, seek practice
opportunities and monitor and evaluate themselves effectively (Condrey, 1977; Langer, 1989;
Tough, 1971). To develop these strategies, people need to become aware of themselves as
![Page 4: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/4.jpg)
4
learners and of the factors that influence their learning. One way to raise awareness is by keeping
a learning log or diary (Learning How to Study Again, C. Dawson, 2004). It not only encourages
reflection and preserves valuable insights, but can reveal attitudes and beliefs hindering learning.
WHAT TO WRITE?
Be sure to post your learning goals at the top of each diary entry.
What did I read? Do? Observe?
How do I feel about this? What assumptions have I been making that I now realize?
What was my experience with a class exercise or assignment?
How could I put what I learned into practice? How might I use this in the future?
How does these insights or experiences relate to my learning goals?
EXAMPLES OF LEARNING EXPERIENCES YOU MIGHT WRITE ABOUT:
Ideas that came to you while reading course articles
Class discussion points that resonate with you
Playing internet detective—so what evidence have you turned up about what works (or
not)?
Searching for evidence to develop answers to a practice question
Working with your study group
Raising the issue “what’s the evidence” outside of our class—special points for bringing
up in class what happened when you asked this question at work, school, or elsewhere
during our mini term.
Anytime you re-read your previous diary entries and learn something new.
These are just a sample— whenever and however you learn something relevant to EBMgt during
this course, write about it. Frequency of entries and quality of reflections are important.
Document length is not.
II. GROUP WORK (N=2-3 PEOPLE PER GROUP)
CAT: Critically Appraised Topic I & II I Due 11/16 & II Due 12/7 (25 points x 2) In your career
you will face challenging decisions. Important decisions may make it worthwhile to obtain the
best available evidence in determining the proper course of action. Your group will choose a
managerial question about which to gather scientific evidence. Please do so in consultation with
the instructor. (Such a question might be something like these. When are distributed teams more
likely to perform effectively? Would pay-for-performance work in our company? When is
investing in workforce training most likely to be financially beneficial?) You will also be given
examples of real CATs that companies have used to stimulate your thinking.
Your Learning Log will be graded based on:
1. Links made between class experiences and your learning goals
2. Reflections on your assumptions/feelings related to EB practices—do these make EB mgt harder or easier to apply?
3. Ways you might use an EB practice now or in the future
![Page 5: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/5.jpg)
5
Your task is to evaluate relevant, best available management and social science research to
answer your question (3-4 pp.). Sources used should be annotated in an appendix, per examples
given in class. (Appendices do not count toward total length of paper.) Cite all sources you relied
upon in drawing your conclusions and explain your search strategy for finding them.
GRADING YOUR CAT
The grading criterion for this assignment is how effectively you marshal the best evidence from
the array of relevant research. In addition to using an effective search strategy, a quality CAT
integrates the evidence across studies so that you appreciate the big picture regarding what the
evidence supports, what it does not, and aspects of your question for which apparently there is
no evidence. (If your report merely states what each study says, you will lose points for not
integrating the findings into an overall assessment. See the CAT examples provided.)
THE QUALITY OF EVIDENCE IN SCIENTIFIC RESEARCH
(WHEN YOUR QUESTION IS “WHAT WORKS?”
PLEASE USE THIS EVIDENCE HIERARCHY TO EVALUATE
THE STUDIES INCLUDED IN YOUR CAT
A+ BEST QUALITY: 1) Meta-analyses of research studies, 2) Systematic reviews of
research articles
A HIGH QUALITY: 1) Well-controlled longitudinal field studies, 2) randomized controlled
interventions, 3) Multiple quasi-experimental studies
B MODERATE QUALITY: 1) Cross-sectional studies, 2) Controlled case comparisons.
C-D DEPENDS ON USE & STATE OF KNOWLEDGE: Case studies and other descriptive
research lack controls to rule out the effects of other co-occurring factors. Their value depends
on the content/focus of the study relative to the state of knowledge existing at the time.
Descriptive studies can be valuable in uncovering problems (supports, barriers, context) in
implementing organizational practices (cf. in-class discussion of POEMS, that is, Practice-
OrIented Evidence that Matters). Such studies can help identify previously unknown practice
phenomena and form the basis of new theory (e.g., Wresniewski & Dutton’s AMR paper on
job crafting is a nice example). In other situations, case and descriptive research can be
considered lower quality.
F LOWEST QUALITY (NON-EVIDENCE-BASED): 1) Expert opinion (e.g. WSJ, Ladies
Home Journal) or consultant hype, 2) Non-expert opinion including newspaper articles and
other journalistic reports, pop management books (unless adhering to Rousseau’s Rule #1), etc.
and, 3) Standard, so-called “best” or popular practices.
![Page 6: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/6.jpg)
6
CLASS SCHEDULE
October 26: CLASS #1 WHAT IS EBMgt?
ADVANCE READING
Rousseau: “Envisioning Evidence-Based Management”
Course Syllabus
TOPICS
Overview Syllabus/Goals
What is EBMgt?
IN-CLASS
Discuss the reading with respect to these questions:
1) What are the key PRACTICES evidence-based managers use?
2) What kind of EDUCATION (training or learning) do managers need to be able to engage in
evidence-based practice?
3) How are the practices and education of evidence-based managers DIFFERENT from the
norm ("business as usual") today?
-----------------------------------------------------------------------------------------------------------------
HOMEWORK TO PREPARE BEFORE NEXT CLASS…..
I. Go on-line to http://oli.cmu.edu/ and complete Evidence Module 2 (instructions in class)
II. PREPARE ONE-PAGER #1 TO TURN IN CLASS #2: What’s the Evidence for…?
Check out whether scientific evidence exists for the effectiveness of a popular management
practice. We will choose one in class (e.g., Balanced Scorecard, 360 feedback, Lean
management.).
1. Use ABIinform (on-line via Hunt Library).
2. Search only PEER REVIEWED articles (check that box)
3. Try to find at least THREE papers related to the practice.
4. Write up a one-page summary of how you searched, the articles you found, and what
conclusions you draw from their findings. Be sure to indicate your conclusions that is, “Is
there evidence that the practice or model is likely to be effective or useful?” Tell us how
you arrived at this conclusion.
III. BRING YOUR FAVORITE MANAGEMENT BOOK TO CLASS—be ready to tell us how
come it’s your favorite!
![Page 7: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/7.jpg)
7
November 2: CLASS #2 EVIDENCE SOURCES, QUALITY AND THE SEARCH
PROCESS
DUE TODAY: One-Pager #1 and Completion of OLI EBMgt module 2
ADVANCE READINGS
Zanardelli: “At the intersection of the Academy and Practice at Asbury Heights”
Wagner: “Smart people doing dumb things: The case of managerial incompetence”
IN CLASS TASKS:
Syllabus Test
Report--Reflections on Your OLI Module 2 Experience
Report--What you learned from your first evidence search
Case: Riverview Healthcare—reading given in class.
HOMEWORK TO PREPARE BEFORE NEXT CLASS…..
Go on-line to http://oli.cmu.edu/ and complete Evidence Module 3. Note this will take you
approximately 3 hours to complete. Please do take time with it as you will learn a lot and it makes
later issues much easier to understand.
![Page 8: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/8.jpg)
8
November 9 CLASS #3 EVIDENCE QUALITY, THE SEARCH PROCESS—AND YOUR
CAT
DUE TODAY: Completion of OLI EBMgt module 3
ADVANCE READINGS
Barends, Rousseau & Briner: “CEBMa guidelines for critically appraised topics in management
and organizations”
TOPIC CATs
EVIDENCE QUALITY
Evidence of Effect vs No Evidence vs Evidence of No Effect
Research Design Issues: evidence of cause & effect or just relationship?
Searching for Quality Evidence
How do you assess causality without conducting a true experiment?
Strength of effects and consistency across studies
Threats to validity of findings
Confounding (Unmeasured variables/ External trends)
Bias (Recall bias, Lead-time and length bias)
Threats to legitimacy of findings
Publication and reporting bias
Misrepresentation: Misleading for profit/ Misleading for belief
Meta-analyses and Systematic Reviews
IN CLASS TASKS:
Report: Reflection on Your OLI Evidence Module 3
![Page 9: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/9.jpg)
9
November 16: CLASS #4 TURNING ORGANIZATIONAL DATA INTO INFORMATION
AND KNOWLEDGE
DUE TODAY CAT #1
ADVANCE READING
Astor, Morales, Kiefer & Repenning, “What problem are you trying to solve? An introduction to
structured problem solving”
Davenport: “Make better decisions”
Davenport, Harris & Morison: “How to manage your data for more effective general management”
SUPPLEMENTAL READING
Donaldson: EBMgt using organizaitonal facts”
TOPICS
Your CAT process
Business Analytics
Improving Data Quality & Usefulness
Making Decisions Using Organizational Information and Knowledge
How To Evaluate the Quality of Organizational Evidence
IN-CLASS
Feedback on your Learning Logs
Each team reports on the process and findings from CAT
CASE:
RBGlobal (A) -- discussion questions at bottom of case
----------------------------------------------------------------------------------------------------------------
HOMEWORK TO PREPARE FOR NEXT CLASS One-Pager #2
Identify and describe a decision aid or tool that you or someone you know has used. Examples
might include a checklist used to guide action or make a decision, a logic model used to organize
information about a problem, a formula or model used to guide a decision. ettc etc.
1. What’s the purpose of the tool? How is it used?
2. What’s the evidence of the value and validity of the tool?
3. Describe the user, background and training needed to use tool.
4. The strengths and weaknesses of the tool (in the way it is used).
How might use of such a tool be improved?
![Page 10: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/10.jpg)
10
1. November 30: CLASS #5 DECISIONS, TYPES, PROTOCOLS &
ROUTINES
DUE TODAY: One-Pager #2
ADVANCE READING
Yates: “Let’s Go With It: Decision neglect”
Gawande: “Checklist”
Taleb, Goldstein & Spitnagel: “Six mistakes executives make in risk management”
TOPICS
Decision Awareness vs Decision Neglect
Decision Types: Routine, Complicated, Complex
Effective approaches to three different types of decisions
Logic Models and Cardinal Decision Rules
Checklists and logic models for evidence use in decision making
IN-CLASS
Feedback on CAT#1
After Action Review FILM
![Page 11: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/11.jpg)
11
December 7: CLASS #6 BUILDING EBMGT-SUPPORTIVE WORK SETTINGS/
YOUR CAREER AS AN EVIDENCE-BASED MANAGER
DUE TODAY: CAT2
ADVANCE READING
Rousseau & Barends: “Becoming an evidence-based HR manager”
TOPIC
Creating an EBMgt Culture
From Management Evidence to Tools and Practices
Decision Supports: Institutionalizing Evidence-Based Practices
Procedures/Protocols/Tools/Artifacts
TOPICS
Learning how to learn: Debriefing experiences with CATs
Charting Your Route Along the Novice-to-Expert Pathway
Developing Expertise over Your Career…
IN-CLASS
Team Report Out
Assessments of Learning Outcomes
Letter to Self: “Future Me”
EXTRA CREDIT (2 additional points for completing on-line module by December 14)
Analyzing Organizational Data—OLI pilot test (approximately 90 minutes)
FINAL ITERATION OF LEARNING LOG DUE December 14
![Page 12: Evidence-Based Management (Heinz 94-814) Instructor ... · Evidence-Based Management (Heinz 94-814) Fall 2015 Instructor: Professor Denise M. Rousseau denise@cmu.edu Voice 8-8470](https://reader033.vdocuments.mx/reader033/viewer/2022051410/6028809cceeaf9021209a256/html5/thumbnails/12.jpg)
12
REFERENCES
Rousseau’s rule #1: “Never trust truth claims made without references.” This leads directly to the
corollary, “Check at least some of those references.”
Ambrose S. et al., (2010) How learning works: Seven research-based principles for smart teaching. San
Francisco Jossey-Bass.
Armstrong, J. S. & R. Schultz (1993), “Principles involving marketing policies: An empirical assessment,”
Marketing Letters, 253-265.
Armstrong, J.S. & T. Sperry (1994) “Business school prestige: Research versus teaching,” (with
commentary) Interfaces, 24, 13-22.
Bacon, Donald R. and Kim A. Stewart (2006), “How fast do students forget what they learn in consumer
behavior? A longitudinal study,” Journal of Marketing Education, 28 (3), 181-192.
Batson, C. Daniel (1975), “Rational processing or rationalization? The effect of disconfirming evidence
on a stated religious belief,” Journal of Personality and Social Psychology, 32, (1), 176-184.
Clayson, Dennis E. (2009), “Student evaluations of teaching: Are they related to what students learn? A
meta-analysis and review of the literature,” Journal of Marketing Education, 31 (1), 16-30.
Condry, John (1977), “Enemies of exploration: Self-initiated versus other-initiated learning,” Journal of
Personality and Social Psychology, 35, 459-477.
Deci, Edward L., R. Koestner & R. Ryan (1999), “A meta-analytic review of experiments examining the
effects of extrinsic rewards on intrinsic motivation,” Psychological Bulletin, 125, No. 6, 627-668 .
Furnham, Adrian, B. Gunter & A. Green (1990), “Remembering science: The recall of factual
information as a function of the presentation mode,” Applied Cognitive Psychology, 4 (3), 203-
212.
Hunter, John E. & R. F. Hunter (1984), “Validity and utility of alternative predictors of job performance,”
Psychological Bulletin, 96, 72-98.
Langer, E. (1989) The power of mindful learning. New York: Perseus.
Locke, Edwin A. & G. P. Latham, (2002) “Building a practically useful theory of goal setting and task motivation:
A 35-year odyssey,” American Psychologist, 57, 705-717.
March, J. (2010) The ambiguities of experience. Ithaca: Cornell.
Ofir, Chezy & Itamar Simonson (2001), “In search of negative customer feedback: The effect of expecting to
evaluate on satisfaction evaluations,” Journal of Marketing Research, 38, 170-182.
Pfeffer & Sutton (2006) Hard Facts, Dangerous Half-Truths And Total Nonsense: Profiting From
Evidence-Based Management. Boston: Harvard Business School Press.
Raichle, M.E. et al. (1994 ) Practice-related Changes in Human Brain Functional Anatomy during Nonmotor
Learning. Cerebral cortex, 4, 8-26.
Rousseau, D.M. (2006) “Is there such a thing as evidence-based management?” Academy of Management
Review, 31, 256-269.
Roth, Philip L.C. A. Bevier, F. S. Switzer & J. S. Schippmann (1996), “Meta-analyzing the relationship
between grades and job performance,” Journal of Applied Psychology, 81, 548-556.
Tough, Allen (1971), The Adult’s Learning Projects. Toronto: Ontario Institute for Studies in Education.
Wresniewski , A. & Dutton, J.E. (2001) Crafting a job: Revisioning employees as active crafters of their
work. Academy of Management Review, 26:179-201.