assessment institute 2010 keynote
DESCRIPTION
TRANSCRIPT
![Page 1: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/1.jpg)
What Culture Do We Want? An Argument for
Deliberative Assessment with Eportfolios
Darren Cambridge October 22, 2010
Assessment Institute
![Page 2: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/2.jpg)
A Disruptive Innovation
E-Portfolio “projects … at their most effective … are (in very good ways) highly disruptive. They throw up needs for organizational change; change in governance; changes in the roles of many [faculty], and the consequent need for [faculty] development, changes in pedagogy, and hence to the nature and shape and form of [majors], and the consequent needs for educational development support; changes to the student’s ‘contract’ with [her institution] … If they are to deliver maximum effect … projects must accept and embrace all of these areas of implication, and no doubt others.”
−David Baume
![Page 3: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/3.jpg)
Don’t do e-portfolio just for the purpose of assessment.
![Page 4: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/4.jpg)
Rethinking Assessment
Assessment means making student learning visible so that it can inform programmatic and curricular innovation and demonstrate effect on learning and identity development
![Page 5: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/5.jpg)
Looking afresh means asking:
• What kinds of learning do we value? • What assessment process do those values
imply? • How does this change how we think about
outcomes and evidence?
![Page 6: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/6.jpg)
Minimum competence versus excellence and opportunity
![Page 7: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/7.jpg)
WHAT DO WE VALUE ABOUT INDIVIDUAL LEARNING AND IDENTITY DEVELOPMENT?
![Page 8: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/8.jpg)
Authenticity
• Finding truth through examination of what is unique about oneself
• Enacting that difference through creative expression
• Protecting choice as a core value
![Page 9: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/9.jpg)
![Page 10: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/10.jpg)
Social Authenticity
Becoming an authentic individual is not a matter of recoiling from society in order to find and express the inner self. What it involves is the ability to be a reflective individual who discerns what is genuinely worth pursuing within the social context in which he or she is situated.
![Page 11: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/11.jpg)
![Page 12: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/12.jpg)
“Finding the Thread in My Life”
![Page 13: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/13.jpg)
Integrity
• Consistency and coherence over time (lifelong)
• Consistency and coherence across roles (lifewide)
• Achieved and asserted through narrative
![Page 14: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/14.jpg)
From Subject to Author
• Ordering role of institutions and traditions shifted to individual
• From being our values, relationships, and experiences to having them
• Overarching principles that mediate competition
• Thinking about the self as a system you compose and conduct
![Page 15: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/15.jpg)
Symphonic Employability
• Career identity integrates– Human capital
(competencies)– Social capital– Adaptability
• Cultivated by narrative- Ashford et.
al.
![Page 16: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/16.jpg)
Social Integrity
![Page 17: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/17.jpg)
Environments for Growth
• In both personal and professional domains– Learning as attitude toward life– Supported by inviting environments
rich in content and people – Technology as a means to guide and
support
• Communicated by the portfolios as a whole
• Can inform her profession
![Page 18: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/18.jpg)
IMPLICATIONS FOR HOW WE DO ASSESSMENT
![Page 19: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/19.jpg)
Three curricula
Kathleen Yancey, Reflection in the Writing Classroom
![Page 20: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/20.jpg)
Competencies
• Communication• Critical Thinking• Strategic Problem Solving• Valuing• Group Interaction
• Global Understanding• Effective Citizenship• Aesthetic Awareness• Information Technology
![Page 21: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/21.jpg)
![Page 22: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/22.jpg)
Rubrics
![Page 23: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/23.jpg)
Liberal Education for America’s Promise• Knowledge of Human Cultures
and the Physical and Natural World– Through study in the sciences
and mathematics, social sciences, humanities, histories, languages, and the arts
• Intellectual and Practical Skills– Inquiry and analysis– Critical and creative thinking– Written and oral
communication– Quantitative literacy– Information literacy– Teamwork and problem solving
• Personal and Social Responsibility– Civic knowledge and
engagement—local and global
– Intercultural knowledge and competence
– Ethical reasoning and action– Foundations and skills for
lifelong learning
• Integrative Learning– Synthesis and advanced
accomplishment across general and specialized studies
![Page 24: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/24.jpg)
VALUE Intercultural Rubric
![Page 25: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/25.jpg)
![Page 26: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/26.jpg)
• Useful • Cost-effective• Reasonably accurate and truthful
– Multiple– Direct
• Planned, organized, systematized and sustained
• Kinds of direct evidence– Portfolios of student work – Student reflections on their values,
attitudes, and beliefs, if developing those are intended outcomes of the course or program
![Page 27: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/27.jpg)
Deliberative Assessment
• Student are privileged informants about their own learning.
• Evidence of learning needs to come from multiple contexts, and the relationships between them need to be articulated.
• Assessment should be a system of deliberative processes inclusive of all stakeholders that makes programs more responsive to them.
![Page 28: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/28.jpg)
A New Role for Competencies
• Standardized– Matching performance to a
pre-defined set of outcomes– Articulating expectations to students
• Deliberative– Capture standards all stakeholders value as enacted in
practice and examining alignment of both student and programmatic performance
– Means for mutually accountable connection between individual and organizational learning
– Boundary objects
![Page 29: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/29.jpg)
Ineffable Essentially Contested
• Ineffable outcomes: Things we all think are important but don’t think we can measure– E.g., ethics, leadership, social responsibility
• Essentially contested concept (Gallie, 1956)
– More optimal development because of contestation
![Page 30: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/30.jpg)
Liberal Education for America’s Promise (LEAP)• Knowledge of Human Cultures
and the Physical and Natural World– Through study in the sciences
and mathematics, social sciences, humanities, histories, languages, and the arts
• Intellectual and Practical Skills– Inquiry and analysis– Critical and creative thinking– Written and oral
communication– Quantitative literacy– Information literacy– Teamwork and problem solving
• Personal and Social Responsibility– Civic knowledge and
engagement—local and global
– Intercultural knowledge and competence
– Ethical reasoning and action– Foundations and skills for
lifelong learning
• Integrative Learning– Synthesis and advanced
accomplishment across general and specialized studies
![Page 31: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/31.jpg)
Eportfolios for Contested Outcomes
• Measurable learning outcome: Ability to articulate a reasoned stance based on evidence
• Makes multiple understandings of outcomes visible
• Requires reasoning to be articulated• Grounds understanding in evidence and
experience• Puts multiple positions into conversation
![Page 32: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/32.jpg)
![Page 33: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/33.jpg)
![Page 34: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/34.jpg)
![Page 35: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/35.jpg)
Deliberative E-Portfolio Assessment
• Assessment as both a social and individual good means moving:
• From measuring outcomes to putting authentic, integral self-representations into conversation
• From consensus to contestation • From proof to inquiry • From authorship to participation with
authenticity and integrity
![Page 36: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/36.jpg)
Inter/National Coalition for Electronic Portfolio Research
• 60 campuses from five countries
• Six three-year cohorts• Individual research questions • Common questions • Bi-annual meetings and online
collaboration
• Demonstrated links to increased student engagement, retention, study skills, course completion, and employability
• Two members received 2010 FIPSE funding for project informed by Coalition work
• AAC&U VALUE project leadership campuses largely drawn from Coalition membership and results frequently cited in their publications
![Page 37: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/37.jpg)
Cohort VI
• Focused on assessment that capitalizes on what is distinctive about e-portfolios
• Non-negotiable core • Capabilities of the digital, networked
environment• Role in accreditation
![Page 38: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/38.jpg)
• Interaction of Pieces of Evidence– For meaningful assessment, interaction of pieces of evidence
within an eportfolio is more important than single pieces of evidence
• Relationship between Evidence and Reflection– Reflection on pieces of evidence within an eportfolio and on
the eportfolio as a whole provides information for assessment that isn’t available by other means
• Meaningful Comparison without Standardization– Eportfolios enable meaningful comparison of student learning
across institutions (and other contexts) without standardization• Material Practices
– The material practice of eportfolio composition generates distinctive knowledge about learning
![Page 39: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/39.jpg)
Meaningful Comparisons without Standardization
Eportfolios enable meaningful comparison of student learning across institutions
without standardization.
![Page 40: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/40.jpg)
Can deliberative assessment scale?
![Page 41: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/41.jpg)
Maximizing return on attention
![Page 42: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/42.jpg)
![Page 43: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/43.jpg)
![Page 44: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/44.jpg)
![Page 45: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/45.jpg)
![Page 46: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/46.jpg)
Capturing the knowledge generated through the deliberative process
![Page 47: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/47.jpg)
![Page 48: Assessment institute 2010 keynote](https://reader033.vdocuments.mx/reader033/viewer/2022061212/5493fa49ac7959182e8b4a56/html5/thumbnails/48.jpg)
Published by Stylus, 2009
ncepr.org/darren (slides here)
Published by Jossey-Bass, 2010