© university of california san francisco medical school the educator’s portfolio: creation and...
TRANSCRIPT
© University of California San Francisco Medical School
The Educator’s Portfolio: Creation and Evaluation
Brian Schwartz, MD
David M. Irby, PhD
Kanade Shinkai, MD, PhD
University of California, San Francisco Academy of Medical Educators
© University of California San Francisco Medical School
Creative Commons LicenseAttribution-NonCommercial-Share Alike 3.0 Unported
You are free:• to Share — to copy, distribute and transmit the work • to Remix — to adapt the work Under the following conditions:• Attribution. You must give the original authors credit (but not in any way
that suggests that they endorse you or your use of the work).• Noncommercial. You may not use this work for commercial purposes. • Share Alike. If you alter, transform, or build upon this work, you may
distribute the resulting work only under a license identical to this one.
See http://creativecommons.org/licenses/by-nc-sa/3.0/ for full license.
© University of California San Francisco Medical School
Agenda for the session
• Introduction and overview of EP 2.0 (20 min)• Create an Executive Summary (30 min)• Write Detailed Descriptions (30 min)• Evaluate Detailed Descriptions (30 min)• General discussion (10 min)
© University of California San Francisco Medical School
Purpose of the Educator Portfolio1. Highlight current, best work and impact
– Who are you as an educator?
2. Describe contributions in format for review– Promotions committees– Letter writers– Annual review with supervisor
3. Align with CV in ADVANCE and AME continuation metrics
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
EP 2.0 – how is it different?
1. Quality not quantity!
2. New role; learner assessment
3. Scholarship embedded into all roles
4. 2 components of EP 2.0:–Executive Summary (5)–Detailed Description (1-3 from Exec Sum)
© University of California San Francisco Medical School
What are Educator’s Roles?
Teaching Activities
Curriculum Development
LearnerAssessment
Mentoring & Advising
Educ Leadership & Administration
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Executive Summary
• List up to 5 of your most significant contributions to education in the following roles:
1. Teaching (mandatory)
2. Curriculum Development, Instructional Design/Tech
3. Educational Leadership
4. Mentoring
5. Learner Assessment
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Executive Summary
• List up to 5 of your most significant contributions to education in the following roles:
1. Teaching (mandatory)
2. Curriculum Development, Instructional Design/Tech
3. Educational Leadership
4. Mentoring
5. Learner Assessment
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Executive Summary
• List up to 5 of your most significant contributions to education in the following roles:
1. Teaching (mandatory)
2. Curriculum Development, Instructional Design/Tech
3. Curriculum Development, Instructional Design/Tech
4. Mentoring
5. Learner Assessment
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Executive Summary
• Identify and describe each significant contribution in one sentence. The first contribution must be teaching.
• Using no more than two or three additional sentences under each contribution, explain the activity, your contribution, what was achieved and any impact.
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Executive Summary Example
Vanya Douglas, MD Assistant Clinical Professor of NeurologyMember of the Academy of Medical Educators
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Exercise A
• Use the Executive Summary template– Describe your 1-5 most important
contributions to education at UCSF– Label by educator role (e.g., teaching,
mentoring, leadership, etc.)• Pair and share• Report
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
EP 2.0: Detailed Descriptions
• 1-3 Detailed Descriptions–Select from Executive Summary–2 pages maximum–Templates for all 5 educator roles
• You will be using a teaching role for the workshop
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Template for Detailed Description: Teaching Role
• Your role• Learners and contact• Builds on best evidence/practice• Goals and learning objectives• Methods• Results impact• Dissemination• Reflective critique
© University of California San Francisco Medical School
Exercise B
• Using the template for the “teaching role”, pick one of your important contributions and begin filling out the template for it
• Consult with person next to you
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Development of Criteria
Education as Scholarship
- 1990 Boyer
- 1997 Glassick
- 2000 Fincher
Documentation standards for Educational Scholarship
-2006 Kirkpatrick
-2007 Simpson
Criteria for Evaluating Educational Scholarship
- 2013 Gusic
Criteria for evaluating roles
Advocated for teaching as scholarship, guidelines for evaluation teaching
Defined roles and documentation standards
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Excellence, Scholarly, ScholarshipCriteria Teaching
ExcellenceScholarly Teaching
Scholarship of Teaching
Quantity & Quality
Builds on the Field
Public
Peer Review
Advances the Field
Simpson D, et al. Advancing educators and education by defining the components and evidence associated with educational scholarship. Med Educ. 41:1002–1009, 2007.
© University of California San Francisco Medical School
Exercise C• Apply Criteria
– Use the evaluation criteria to evaluate the sample teaching activity
• Discuss– How do the criteria help you judge the
faculty member’s work? How could it be strengthened?
– How can the criteria help you write your entry?
• Report outPurpose and Educ.
RolesExecutive Summary Detailed
DescriptionsEvaluation Criteria
© University of California San Francisco Medical School
Frequently Asked Questions
• FAQs: http://medschool2.ucsf.edu/academy/Educators_Portfolio/FAQs_EP_2015.pdf
• Templates and instructions: http://medschool2.ucsf.edu/academy/Educators_Portfolio/
Purpose and Educ. Roles
Executive Summary Detailed Descriptions
Evaluation Criteria
© University of California San Francisco Medical School
Summary of Portfolio 2.0
• Executive summary of 1-5 significant contributions to teaching and education (in 1 page)
• 1-3 specific examples of most significant contributions to teaching and education (no more than 2 pages per example)
© University of California San Francisco Medical School
Resources• These Slides
– Will be posted on AME website for reference
• UCSF Academy of Medical Educators Portfolio– http://medschool2.ucsf.edu/academy/
Educators_Portfolio/
• AAMC Toolbox– Gusic M, Amiel J, Baldwin C, Chandran L, Fincher R,
Mavis B, et al. Using the AAMC Toolbox for Evaluating Educators: You be the Judge!. MedEdPORTAL; 2013. Available from: www.mededportal.org/publication/9313.