the smarter balanced assessment consortium using the individual contributor and reviewer report
TRANSCRIPT
The Smarter Balanced Assessment Consortium
Using the Individual Contributor and Reviewer Report
Agenda
Page 2
• Log into the Digital Library and navigate to the report.
• Select an SNE member and run a report.
• Understand the results displayed in each section of the report.
Page 3
www.smarterbalancedlibrary.org
Logging into the Digital Library
4
Navigating to the Individual Contributor and Reviewer Report
5
Running a Report – Default Settings
6
Running a Report – Choose a Time Period
7
Running a Report for SNE Gabe Kotter
8
Three Sections – SNE Profile Information
9
Three Sections – Contributed Resources
10
Mathematics of Money
02
Formative Assessment in Mathematics
Three Sections – Resource Reviews
11
Gabe’s SNE Profile
12
Contributed Resources
Page 13
Test Resource 1Mathematics of Money
Formative Assessment in Mathematics
2 0
Understanding Contribution Information
Page 14
The Resources Contributed metric displays the number of resources that Gabe has submitted for review.
2 0
Understanding Contribution Information
Page 15
The Contributed Resources Posted metric displays the number of resources that have passed the Quality Criteria review process and are currently posted to the Digital Library.
2 0
Understanding Contribution Information
Page 16
The Contributed Resources Posted with Distinction metric displays the number of resources that have passed the Quality Criteria review process and are currently posted to the Digital Library with distinction.
2 0
Understanding Contribution Information
Page 17
2 0
Mathematics of Money
Formative Assessment in Mathematics
Post Status
Submitted The resource is awaiting review.
In Review The resource is currently being reviewed.
Posted The resource has been successfully posted to the Digital Library.
Posted with Distinction The resource has been successfully posted to the Digital Library with distinction.
Returned The resource has been returned to the SNE for revisions.
Page 18
Understanding Contribution Information
Page 19
2 0
Mathematics of Money
Formative Assessment in Mathematics
Resource Reviews Tables
Page 20
3 (75%) 1 (25%)
44%3
Understanding Review Information
Page 21
3 (75%) 1 (25%)
Understanding Review Information
Page 22
The Accepted Reviews column displays the number of resources that Gabe passed through the Gate-Keeping review, indicating they met all these criteria.
3 (75%) 1 (25%)
Understanding Review Information
Page 23
The Returned Reviews column displays the number of resources that Gabe did not pass through the Gate-Keeping review, indicating they did not meet all these criteria.
3 (75%) 1 (25%)
Understanding Review Information
Page 24
The Total Reviews column displays a sum of the Accepted Reviews and Returned Reviews.
3 (75%) 1 (25%)
Understanding Review Information
Page 25
3 (75%) 1 (25%)
Understanding Review Information
Accepted Reviews
Returned Reviews
Total Reviews
• SNE completes Gate-Keeping review
• Returns the resource to the contributor
Increases by 1 Increases by 1
• SNE completes Gate-Keeping review
• Accepts the resource and moves it forward
Increases by 1 Increases by 1
Page 26
Understanding Review Information
Page 27
3 (75%) 1 (25%)
Understanding Reviewer Information
Page 28
3 (75%) 1 (25%)
44%3
Understanding Reviewer Information
Page 29
The Reviews in Progress column displays the number of resources for which Gabe is currently conducting Quality Criteria Reviews.
44%3
Understanding Reviewer Information
Page 30
The Completed Reviews column displays the number of resources for which Gabe has completed Quality Criteria Reviews.
44%3
Understanding Reviewer Information
Page 31
The Average Consistency Rate for All Completed Reviews column shows the average recommendation consistency rate for all resources reviewed in the selected time period.
44%3
Understanding Reviewer Information
Page 32
Reviews in Progress
Completed Reviews
SNE starts a new Quality Criteria review
Increases by 1
SNE cancels that same Quality Criteria review
Decreases by 1
SNE completes that same Quality Criteria review and makes a recommendation
Decreases by 1 Increases by 1
Understanding Reviewer Information
Page 33
3 44%
Understanding Reviewer Information
Page 34
Understanding Reviewer Information
Page 35
R+ (Recommend with Distinction)R (Recommend)R- (Recommend with Revisions)NR (Do Not Recommend)
Understanding Reviewer Information
Page 36
Consistency Rate Calculation Example
Recommend (R) Recommend with Distinction (R+)
GabeMariaTony
Do Not Recommend (NR)
Recommend with Revisions (R-)
Consistency Rate Calculation Example
Recommend (R) Recommend with Distinction (R+)
GabeMariaTony
Do Not Recommend (NR)
Recommend with Revisions (R-)
NR = 1 R- = 2 R = 3 R + = 4
Numerical ValuesDo Not Recommend (NR) = 1Recommend with Revisions (R-) = 2Recommend (R) = 3Recommend with Distinction (R+) = 4
Consistency Rate Calculation Example
Recommend with Distinction (R+)
GabeMariaTony
Do Not Recommend (NR)
Recommend with Revisions (R-)
Difference of 2
Difference of 1
Numerical ValuesDo Not Recommend (NR) = 1Recommend with Revisions (R-) = 2Recommend (R) = 3Recommend with Distinction (R+) = 4
NR = 1 R- = 2 R = 3 R + = 4
Recommend (R)
Consistency Rate Calculation Example
Reviewer Rating
Divergence from Gabe
Divergence from Tony
Divergence from Maria
Total Divergence from Other Reviewers
Gabe R = 3 0 2 1 3
Reviewer B NR = 1 2 0 1 3
Reviewer C R- = 2 1 1 0 2
3Recommend (R)
4Recommend with Distinction (R+)
GabeMariaTony
1Do Not
Recommend (NR)
2Recommend with
Revisions (R-)
Difference of 2
Difference of 1
Consistency Rate Calculation
100% –Total Divergence from Other Reviewers
Maximum Possible Divergence from Other Reviewers
( )
Consistency Rate Calculation
100% –
Total Divergence from Other Reviewers = 3
Maximum Possible Divergence from Other Reviewers = 6
( )
Reviewer Rating
Divergence from Gabe
Divergence from Reviewer B
Divergence from Reviewer C
Total Divergence from Other Reviewers
Gabe R (3) 0 2 1 3
Reviewer B NR (1) 2 0 1 3
Reviewer C R- (2) 1 1 0 2
= 50%
Consistency Rate
Page 43
Consistency Rate Explanation
100% The review is highly aligned with the other two SNE reviewers.83%
67% The review is somewhat aligned with the other two SNE reviewers.
50% The review is not very aligned with the other two SNE reviewers.33%
17%
0% The review is not at all aligned with the other two SNE reviewers.
Understanding Reviewer Information
Page 44
Understanding Reviewer Information
Page 45
Understanding Reviewer Information
Page 46
Understanding Reviewer Information
Page 47
Looking at SNE Reviewers’ Comments
Page 48
Looking at SNE Reviewers’ Comments
Page 49
Looking at SNE Reviewers’ Comments
Page 50
Looking at SNE Reviewers’ Comments
Page 51
Reflecting on the Learning
Page 52
• Log into the Digital Library and navigate to the report.
• Select an SNE member and run a report.
• Understand the results displayed in each section of the report.
Congratulations!
You have completed the tutorial for using the Individual Contributor and
Reviewer Reports.
Page 53
Please contact the Help Desk, if you have any questions.
Monday-Friday7:00am-7:00pm (EST)
855-657-8587 (toll free)