Download - CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
![Page 1: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/1.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
1
Backward (Instructional) Design Updating ID Toolboxes for Personalized, Adaptive, & CBE
CAEL 2015 INTERNATIONAL CONFERENCE, BALTIMORE MD
Jon Mott, PhDChief Learning Officer
MJ Bishop, PhDDirector, Center for Academic Innovation
Cristi Ford, PhDAssistant Vice Provost for
Learning Innovation Initiatives
![Page 2: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/2.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
@drmjbishop@drmotx@jonmott
2
![Page 3: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/3.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Agenda
Welcome & Workshop OutcomesContext: Problem, Opportunity, & DefinitionsCASE STUDIESNew Tools for the ID ToolboxReport Outs & Takeaways
3
![Page 4: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/4.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Welcome & Workshop Outcomes 4
Workshop participants will be able to:
1. Apply working definitions of personalized, adaptive, and CBE in design contexts;
2. Design the right personalized, adaptive, and / or competency-based sequences and workflows for the right contexts using the right tools;
3. Evaluate tools, platforms, and courseware based on updated toolbox (ask "hard" questions about "black boxes");
4. Design personalized, adaptive, and CBE programs and courses utilizing new tools and frameworks
![Page 5: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/5.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
5
CONTEXTProblems
![Page 6: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/6.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Curriculum & courses are (generally): 6
TIMEBOUND LINEAR
TEACHERCENTRIC
ONE-SIZE-FITS-ALL
![Page 7: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/7.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Assessment is frequently:
7
DESIGNEDFOR
SCALABILITY
NORMREFERENCED
DIGITALKINKOS
FORCOURSES
SUPPORTSTAFFFOR
SMEs
IDs are perceived as:
![Page 8: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/8.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
8
CONTEXTOpportunities
![Page 9: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/9.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
9
Learning Design
Alignment
Capabilities
ActivitiesMeasurement
Policies & Assessments
Backward Design
![Page 10: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/10.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
10Criterion-referenced assessment (CBE)● Establish unambiguous,
objective measures of capability
● Hold all learners to same standard
![Page 11: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/11.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
11Authentic learning & assessment● Match learning and
assessment to real-world performance
● Match learning and assessment contexts as closely as possible
![Page 12: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/12.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
12Rethink role of instructional designers ● Professional
peers● Unique expertise
and skillsets ● Equal partners in
process
![Page 13: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/13.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
13
DEFINITIONS
![Page 14: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/14.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
14Personalized learning
PreferencePlacementPathPace
4 Ps of Personalization
![Page 15: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/15.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
15Adaptive learning
PreferencePlacementPathPace
AdaptiveLearning
● Multiple remediation loops
● Pacing / path rules
● Algorithms● Predictive
analytics
![Page 16: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/16.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
16Competency-based education
FORMATIVE
DIAGNOSTIC
SUMMATIVE
CAPABILITY
TRANSCRIPT
KNOWLEDGE, SKILLS, ABILITIES
CAREER & LIFE
GOALS
PLA
LEARNIN
G
ASSESSMEN
TS
PERSONALIZED& ADAPTIVE
LEARNING PLAN
COURSEWARE
ACTIVITIES
SIMULATIONS
PROJECTS
INTERACTIONS
Remedial | O
n track | Advanced
![Page 17: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/17.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
17
CASE STUDIES
![Page 18: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/18.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
18CASE STUDIESINTRO TO ACCOUNTING
● Positioned as “weed out” course
● Wide variability in incoming preparation
● Varied pace of learning
● Sporadic / intermittent demand for remediation
● Instructor burnout
GE COURSE w/ HIGH DFWs
● Required GE course● Negative student
course & faculty ratings
● High enrollments ● Varied approaches
across sections of the course
● Wide variation in preparation and performance
STUDENT TEACHER & MATH
● Student returned to school after 15 years
● Earned teaching degree with a 3.0 GPA
● Proved incapable of calculating fractions when teaching students
![Page 19: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/19.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
19
NEW TOOLS for TOOLBOX
![Page 20: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/20.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
20
Learning Design
Alignment
Capabilities
ActivitiesMeasurement
Policies & Assessments
Backward Design
![Page 21: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/21.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
21Authentic PLA, diagnostics, formative assessment ● What are you
measuring? ● How often will you
measure it? ● Will it be computer or
human graded? ● What is the
relationship between formative & summative assessment?
![Page 22: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/22.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
22Rules & algorithm-based personalization & adaptive
LEARNER
ACTIVITY
ACTIVITYEVALUATION
PERSONALIZATION RULE or
ALGORITHM
UPDATED LEARNING
PLAN
TYPE? NUMBER?
FREQUENCY?
LATENCY?
WHAT RULE(S)?
ALGORITHM(S)?
FREQUENCY?MANNER?
![Page 23: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/23.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Other tools and considerations 23
PROGRAMLEVEL
PERSONALIZATION
DATA, TRACKING & ANALYTICS
CONTENTCREATION
&CURATION
EFFICACYEVALUATION
![Page 24: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/24.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
INTEROPERABILITY! 24
LTI 2.0 ANALYTICS CBE + eT
![Page 25: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/25.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
The right tool for the right context 25
Intensity / frequency of teacher-student interaction
Cognitive complexity of task
Cont
ent
/ act
ivit
y vo
lum
e re
quir
emen
tsM
achi
ne s
cora
ble
/ gui
dabl
e
AdaptiveLearning
Personalized
Learning Program-level
Personalized Learning
Knowledge • Comprehension • Application • Analysis • Synthesis • Evaluation
Adaptive Practice & Test Prep Personalize
courseware & learning sequences
Program mapping,
delivery, & analytics
![Page 26: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/26.jpg)
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
26
REPORT OUTSNEXT STEPS
![Page 27: CAEL 2015 - Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE](https://reader036.vdocuments.mx/reader036/viewer/2022062522/58aa12ac1a28ab8a488b631f/html5/thumbnails/27.jpg)
© 2015 Learning Objects.
non-integratedLMSb
(or faculty website, publisher
course, etc.)
LMSa
27
SIS ProgramSystem of
Record
Personalized & AdaptiveCourseware
CapabilityDashboard
Capability
Transcript
COMPREHENSIVE
PROGRAMPERFORMANCE
DATA
● LMSs● 3rd Party Courseware● Proprietary Learning Tools ● Assessment Tools
GRADES (manual)
COMPREHENSIVE PROGRAM DESIGN & DELIVERY TOOLS & SERVICES
Learning Technology
& Curriculum
Design Services
Learning-centered architecture