assessment development: building valid and reliable tests habeeb quadri, m.ed denis jarvinen, ph.d
TRANSCRIPT
![Page 1: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/1.jpg)
ASSESSMENT DEVELOPMENT:BUILDING VALID AND RELIABLE TESTS
Habeeb Quadri, M.Ed
Denis Jarvinen, Ph.D.
![Page 2: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/2.jpg)
Overview
Good and Bad of Standardized Testing in Religious Studies Courses
Review General Test Development Model Purpose and Design Shape Assessments Important Questions to be Asked The Development and Review Process
Making Sense of Data within Islamic Studies Courses
![Page 3: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/3.jpg)
Standardized Testing and Religious Studies
Future of Standardized Testing
- Evaluate curriculum effectiveness
- Evaluate student achievement
- Track student achievement over time
- Ensure transferability of students
- Evaluate instructional methods and best practice
- Market the School
- Muslim Common Core
- Experiential learning can not be measured
- Formal Assessments is one tool to measure student mastery of a concept
![Page 4: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/4.jpg)
General Test Development Sequence
Establish a Clear Purpose for the Assessment
Define the Content for the Assessment
Begin Item Development/Selection
Field Test Items
Implement the Assessment
Step 1
Step 2
Step 3
Step 4
Step 5
![Page 5: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/5.jpg)
Establish a Clear Purpose for the Assessment
Why is the assessment being administered?
What knowledge/skills will be assessed?
Who will take the assessment?
When will the assessment be administered?
How will the assessment be scored?
Information?
How will the assessment data be used? What decisions will be made using the
data (e.g., accountability, curriculum, instruction)?
By whom (e.g., administrators, staff, teachers, students)?
How will information from this assessment be integrated with other schools?
![Page 6: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/6.jpg)
Research Process: Islamic Standards
Selected Panel Members
Experts Revise Standards
Incorporate Feedback
Develop Accepted
Standards
Educators
Researched Textbooks
I Love Islam IQRA’ Good Word
Charted Commonalities
Pilot Test
Textbooks
Approached Major Schools
Gathered Curricula
Charted Commonalities
Schools
![Page 7: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/7.jpg)
Content for Assessment – Comparing Curriculums
![Page 8: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/8.jpg)
ISST Advisory Committee
What item formats will be used
(item specifications)?
How will appropriate test content be determined?
Who will review and approve the specific
learning objectives to be covered (pacing guide)?
Who will create final test specifications
(content/item matrix)?
Meeting with
Panel
![Page 9: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/9.jpg)
![Page 10: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/10.jpg)
Since 2010 Over 27 schools across the U.S. implemented
formal assessments
for Islamic Studies
![Page 11: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/11.jpg)
Implementing the Assessment
How will standards for judging test performance be set?
Who develops/reviews final test administration manuals?
Who set rules for who will be tested and when?
What procedures will be used to monitor implementation process across administration sites?
Which staff will receive training on using the test data?
HOW WILL TEST DATA BE CONNECTED TO CLASSROOM INSTRUCTION?
![Page 12: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/12.jpg)
Making Sense of Data Individual Report
![Page 13: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/13.jpg)
Making Sense of Data Class Report
![Page 14: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/14.jpg)
Making Sense of Data School Report
![Page 15: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/15.jpg)
Sample Items Qur’anic Studies Sirah and Hadith
![Page 16: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/16.jpg)
Sample Item
![Page 17: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/17.jpg)
Sample Item
![Page 18: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/18.jpg)
Sample Item
![Page 19: ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D](https://reader036.vdocuments.mx/reader036/viewer/2022062421/56649c715503460f949227ca/html5/thumbnails/19.jpg)
Sample Item