nocti overview
DESCRIPTION
NOCTI Overview. Amie Birdsall and Patricia Kelley February 23, 2012. Discussion Topics. NOCTI Overview Products and Services Selecting an Assessment CTEDDI Q&A. NOCTI Overview. Over 40 years serving the CTE community Non-profit organization Owned and operated by the 50 states - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/1.jpg)
NOCTI Overview
Amie Birdsall and Patricia KelleyFebruary 23, 2012
![Page 2: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/2.jpg)
Discussion Topics
NOCTI Overview
Products and Services
Selecting an Assessment
CTEDDI
Q&A
![Page 3: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/3.jpg)
NOCTI Overview
Over 40 years serving the CTE community Non-profit organization
Owned and operated by the 50 states
Each state is a member of NOCTI’s Consortium of States
Works with both secondary and post-secondary populations
Nocti Business Solutions (formerly The Whitener Group) provides services to industry
![Page 4: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/4.jpg)
NOCTI Overview - Educational Partners
![Page 5: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/5.jpg)
![Page 6: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/6.jpg)
Over 80 Job Ready tests offered
30 Pathway tests in 10 clusters available
Over 90 private industry employment and/or advancement tests delivered
20 teacher-level assessments
Study guides for all Job Ready and Pathway assessments
Countdown Kits available for all Job Ready assessments
Successful Schools-Successful Programs Guide
Supplemental ProductsAssessments
NOCTI Products & Services
Professional Learning Opportunities Also
Offered!
![Page 7: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/7.jpg)
Selecting an Assessment
Determine purpose of assessment
Determine audience
Determine results desired
Research available options
![Page 8: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/8.jpg)
Selecting an Assessment
![Page 9: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/9.jpg)
Selecting an Assessment
www.nocti.org
Assessment blueprints are available on
NOCTI’s website at no cost!
![Page 10: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/10.jpg)
Assessment Blueprints
• Blueprints include:• Competency
List• Content
Distribution• Sample
items/jobs
![Page 11: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/11.jpg)
Assessment Blueprints
Content distribution for written and performance
Sample multiple-choice questions
Sample performance job
![Page 12: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/12.jpg)
Job Ready Assessments
Assess technical skills at the occupation level (e.g., Accounting, Carpentry, Pre-Engineering)
Measure aspects of occupational competence such as factual and theoretical knowledge
Target secondary and post-secondary program completers
![Page 13: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/13.jpg)
NOCTI Job Ready Assessment Blueprint
Plumbing
Safety
Plumbing Math
General Plumbing Practices
Joining Pipes and Fittings
Drainage
Vent Installation
Water Supply and Distribution
Hot Water Systems
Traps
Installing Fixtures
Plumbing Service and Repair
8%
10%
24%
9%
8%
4%
7%
6%
8%
7%
9%
![Page 14: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/14.jpg)
NOCTI Job Ready Assessment Blueprint
Number of Questions: 222 Areas Covered:
Accounting
![Page 15: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/15.jpg)
NOCTI Pathway Assessment Blueprint
Construction Pathway
General Architecture & Construction Technical Skills
Construction
Academic Foundations
Systems
Ethics and Legal Responsibilities
Communication
Information Technology Applications
Problem Solving, Critical Thinking, and Decision Making
Leadership and Teamwork
Safety, Health, and Environment
Employability and Career Development
15%
15%
15%
6%
6%
8%
5%
7%
6%
8%
9%
![Page 16: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/16.jpg)
Assessment Results
NOCTI’s Standard Score Reporting Package: Individual Score Reports
Group Score Reports
Comparative Data
Other Reports Available: Task-Link Reports
Integrated Academic Reports
![Page 17: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/17.jpg)
What data do I receive from NOCTI?Score Reports
Online Test Administration
Immediate Score Reports
Aggregate Reports: 2 business days after user codes are released from Client Services Center
Paper/Pencil Administration
Aggregate Reports: 10 business days after receipt of correctly completed answer sheets
![Page 18: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/18.jpg)
What data do I receive from NOCTI?Immediate Score Reports
Immediate Student Scores
Displayed to student if option is designated
Emailed to Site Coordinator upon completion of testing (can be forwarded to instructor)
![Page 19: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/19.jpg)
NOCTI Standard Score Reports
Individual Score Reports
• Provided for each test taker
• Scores by duty and total
• Pre-/post-test comparisons
• Comparative data
![Page 20: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/20.jpg)
NOCTI Standard Score Reports
Group Score Report
• Provided for the testing group
• Duty and total scores for each participant
![Page 21: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/21.jpg)
NOCTI Standard Score Reports
Analysis of Scores Report
• Provided for the testing group
• Comparative data• Criterion-
referenced cut score
• Other statistical information
![Page 22: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/22.jpg)
NOCTI Additional Reports:Task-Link Report
Task-Link Report
• Includes:• Number of items
presented for each task
• Average correct by group
• Number correct for each test taker
![Page 23: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/23.jpg)
![Page 24: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/24.jpg)
Project Goals
• Understand data and assessments• Use data effectively• Improve learning and skill acquisition for students• Plan for continuous improvement of learning and
instruction• Share ideas and collaborate with other educators
![Page 25: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/25.jpg)
Instructional Improvement Cycle
![Page 26: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/26.jpg)
A Nursing AssistingClass
Classroom Example
![Page 27: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/27.jpg)
Areas on a Nursing Assisting Test
28%
10%
10%13%
10%
13%
8%
8% Basic Nursing Assisting
Infection Control
Communication Skills
Personal Care Skills
Mental Health/Social Needs
Client’s Rights
Basic Restorative Devices
Employability Skills
![Page 28: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/28.jpg)
Nursing Assistant Pretest Areas Pretest % CorrectStudent 1
Posttest % CorrectStudent 1
Basic Nursing Assisting 54.6 --Infection Control 30.0 --
Communication Skills 41.1 --
Personal Care Skills 36.4 --
Mental Health/Social Needs 53.8 --
Client’s Rights 36.4 --
Basic Restorative Devices 50.0 --
Employability Skills 27.3 --
Total 43.4
Individual Nursing Pretest
![Page 29: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/29.jpg)
Nursing Assistant Pretest Areas
Student 1 % Correct
Student 2 % Correct
Student 3 % Correct
Student 4 % Correct
Student 5 %
Correct
Student 6 %
Correct
Class Average % Correct
Basic Nursing Assisting
54.6 45.5 42.7 27.3 27.3 54.5 41.9
Infection Control 30.0 20.0 10.0 20.0 10.0 30.0 20.0
Communication Skills
41.1 17.6 23.5 23.5 13.2 35.3 25.7
Personal Care Skills 36.4 54.5 45.5 45.5 36.4 54.5 45.5
Mental Health/Social Needs
53.8 38.5 42.3 38.5 20.8 53.8 41.3
Client’s Rights 36.4 36.4 38.3 36.4 22.5 45.5 35.9
Basic Restorative Devices
50.0 60.0 50.0 60.0 30.0 80.0 55.0
Employability Skills 27.3 18.2 18.2 27.3 9.1 27.3 21.2
Total 43.4 38.4 35.9 38.5 22.8 48.8 38.0
Nursing Assisting Pretest
![Page 30: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/30.jpg)
Nursing Assisting Posttest
Nursing Assistant Pretest Areas
Student 1 % Correct
Student 3 % Correct
Student 5 % Correct Group Site State Nation
Basic Nursing Assisting
100.0 92.4 76.2 86.4 79.5 72.5 75.5
Infection Control 91.7 94.5 72.4 79.2 78.2 70.7 70.6
Communication Skills
100.0 100.0 55.3 95.0 83.8 64.3 66.4
Personal Care Skills 92.3 54.5 52.5 69.2 65.8 51.6 52.9
Mental Health/Social Needs
97.4 72.5 60.3 71.8 69.8 63.1 64.1
Client’s Rights 84.8 66.4 44.7 64.6 67.6 58.1 57.8
Basic Restorative Devices
87.5 60.2 45.2 53.1 61.9 55.6 56.5
Employability Skills 87.5 78.5 37.4 79.7 75.6 66.6 67.0
Total 93.9 79.4 58.4 76.8 73.7 64.1 65.2
![Page 31: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/31.jpg)
• Achievement gaps• Differences between subgroups• Trends • Progress
What the Data Reveal
![Page 32: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/32.jpg)
Collecting Data – More Than NOCTI
• Includes process of collecting, analyzing, and interpreting information
• Determines the degree to which students are becoming competent and meeting standards
• Occurs at many levels (e.g., classroom and program assessments to state and national assessments)
![Page 33: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/33.jpg)
• School • Program• Teacher
What Data Exist?
• Class• Student • Standards
• National• State • District/System
![Page 34: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/34.jpg)
Icebergs
What lies beneath the data scores that influence those scores?
![Page 35: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/35.jpg)
• What is the data designed to answer?
• What other data may be needed?
• What roadblocks are there to interpreting the data?
What Questions Can the Data Answer?
![Page 36: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/36.jpg)
Plan for Learning Improvement
• Start with results: Analyze the previous year’s goals, comparing against local unit tests and end-of-course tests, at the student level and classroom level.
• Triangulate: Find relationships between test data and attendance and discipline referrals.
![Page 37: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/37.jpg)
Plan for Learning Improvement
Continued: • Disaggregate data by subgroups (e.g.,
socioeconomic status or those receiving free/reduced lunch, or Individualized Education Program/IEP).
• Use information from advisory groups or parents.• Set goals for the year as well as long-term goals.
![Page 38: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/38.jpg)
Plan for Learning Improvement
Continued: • A common denominator is to improve learning
through teamwork.• Build school department and state data teams.• Review annual assessment data with a faculty
team to isolate achievement gaps or groups of students with high and low performance.
![Page 39: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/39.jpg)
Plan for Learning Improvement
Continued: • Schedule school and department data team
meetings to discuss data and review progress. • Discuss and develop strategies, such as curricular
alignment with academic and industry standards, curricular sequence, timing, and depth of instruction.
![Page 40: NOCTI Overview](https://reader038.vdocuments.mx/reader038/viewer/2022110101/568132aa550346895d995299/html5/thumbnails/40.jpg)
Monitor Student Progress
• Use a progress monitoring system for all students.
• Graph students’ curricula-based scores.
• Identify effective instructional components.