dabbagh idd competencies analysis aect 2012
DESCRIPTION
TRANSCRIPT
![Page 1: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/1.jpg)
Using Student Portfolios for Assessment of Instructional Design Competencies in
a Graduate Program
Nada Dabbagh
AECT 2012
Louisville, KY
![Page 2: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/2.jpg)
Presentation Outline
Competency Movement
Portfolio Assessment
IDD Program
Research Questions
Study Design
Study Results
Educational Implications
![Page 3: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/3.jpg)
Competency Movement
![Page 4: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/4.jpg)
Competency Movement
AECT INITIAL STANDARDS
1. Design
2. Development
3. Utilization
4. Management
5. Evaluation
IBSTPI COMPETENCIES
1. Professional Foundations
2. Planning and Analysis
3. Design and Development
4. Implementation and Management
![Page 5: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/5.jpg)
Competency Movement
• “a knowledge, skill, or attitude that enables one to effectively perform activities of a given occupation or function to the standards expected in employment” (Sims & Koszalka, 2008, p. 569)
• Important prerequisite for performance
• Competency-based assessments must be combined with other forms of assessment to increase accountability (Stefanakis, 2002)
![Page 6: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/6.jpg)
![Page 7: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/7.jpg)
Portfolio Assessment
• Self-assessment tool
• Self-evaluation skills
• Students as reflective practitioners
• Ownership of the learning process
• Lifelong learning
• Professional development
![Page 8: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/8.jpg)
Portfolio Assessment
• Basis for evaluation of degree programs
• Summative assessment of student achievement in relation to a program’s goals and competencies
• “purposeful collection of evidence used by students to document and reflect on learning outcomes” (Dannefer & Henson, 2007, p. 495).
![Page 9: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/9.jpg)
IDD Program
• 30 credit masters program
• Designed to be completed on a part time basis
• EDIT 601 IDD Portfolio
• EDIT 701 Advanced IDD Portfolio
• PBA (instructor, self, peer assessment)
• Reflections/personal growth
• Integration of IDD concepts, processes, and competencies
• Evidence and artifacts: depth, breadth, and adaptiveness
![Page 10: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/10.jpg)
http://www.hawk-assoc.com/LindaHawk/index.htm
![Page 11: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/11.jpg)
![Page 12: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/12.jpg)
Research Questions
• Measure students’ perceptions of their proficiency in instructional design competencies in order to evaluate the degree to which a graduate program in instructional design effectively integrated these competencies into its curriculum.
![Page 13: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/13.jpg)
Research Questions• How did students in a graduate instructional design program
perceive their proficiency in ID competencies depicted by AECT standards?
• How did students in a graduate instructional design program perceive their proficiency in ID competencies depicted by IBSTPI standards?
• To what extent were the AECT standards addressed by the courses in this instructional design program as perceived by the students?
• To what extent were the IBSTPI standards addressed by the courses in this instructional design program as perceived by the students?
![Page 14: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/14.jpg)
Study Design
• Participants• 34 students (23 female, 11 male)• 14 participants selected IBSTPI standards• 20 participants selected AECT standards
• Measures• IBSTPI standards• AECT standards• Level of proficiency• Self reported proficiency
![Page 15: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/15.jpg)
AECT ID Competencies
![Page 16: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/16.jpg)
IBSTPI ID Competencies
![Page 17: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/17.jpg)
Results Summary/Questions 1&2
• Participants perceived themselves as mostly proficient (>60%) on AECT competencies• Strongest (83%) on Design• Weakest (62%) on Utilization
• Participants perceived themselves as mostly proficient on IBSTPI competencies• Strongest (79%) on Professional Foundations • Weakest (59%) on Implementation and
Management
![Page 18: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/18.jpg)
AECT Competencies/Course Frequency
![Page 19: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/19.jpg)
IBSTPI Competencies/Course Frequency
![Page 20: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/20.jpg)
Results Summary/Questions 3&4
• Core courses (704, 705, 730, 732, 752) were most frequently mentioned
• AECT Design & Development domains most addressed
• AECT Evaluation domain least addressed• IBSTPI Professional Foundations domain most
addressed• IBSTPI Implementation and Management least
addressed
![Page 21: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/21.jpg)
Implications
• Need to improve ID instruction related to Utilization and Evaluation: • AECT Utilization competence involves “applying principles,
theories, and research related to media utilization, diffusion, implementations, and policy-making”
• AECT Evaluation competence involves “demonstrating knowledge, skills, and dispositions to evaluate the adequacy of instruction and learning by applying principles of theories, and research related to problem analysis, criterion-referenced measurement, formative and summative evaluation, and long-range planning”
![Page 22: Dabbagh IDD Competencies Analysis AECT 2012](https://reader033.vdocuments.mx/reader033/viewer/2022061201/547a66bbb37959652b8b498b/html5/thumbnails/22.jpg)
Implications
• Need to improve ID instruction related to Implementation and Management
• IBSTPI defines Implementation and Management as the ability to:• Plan and manage instructional design projects
• Promote collaboration, partnerships and relationships among the participants in a design project
• Apply business skills to managing instructional design
• Design instructional management systems
• Provide for the effective implementation of instructional products and programs