wow! i did not know i could do that; tricks for configuring smartermeasure & analyzing data
TRANSCRIPT
![Page 1: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/1.jpg)
WOW, I Did Not Know I Could Do That!Tricks for configuring and
analyzing SmarterMeasure Data
Cynthia Pascal, Northern Virginia Community CollegeLou Ann Martin, Tri-County Technical CollegeCourtney Tillett, Tri-County Technical CollegeDr. Mac Adkins, President, SmarterServices
![Page 2: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/2.jpg)
All attendee lines are muted. Please submit questions via chat. Q & A at the end. The session is being recorded and an archive
will be available.
Housekeeping
![Page 3: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/3.jpg)
Introduction – Making Sense of your Data Northern Virginia Community College Tri-County Technical College Five C’s to Maximize SmarterMeasure
Agenda
![Page 4: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/4.jpg)
Level One – Students learn about themselves• Aha moment• The tiger looking in the mirror
Level Two – Schools learn how to best support students • Integration into orientation courses, first year experience
programs• Recommendation of appropriate remedial / support resourcesLevel Three – Leaders learn how to maximize data• Computing retention gains, comparing populations• Fulfilling accreditation requirements, justifying costs
Levels of Benefit
![Page 5: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/5.jpg)
Level One – Students learn about themselves• Aha moment• The tiger looking in the mirror
Level Two – Schools learn how to best support students • Integration into orientation courses, first year experience
programs• Recommendation of appropriate remedial / support resourcesLevel Three – Leaders learn how to maximize data• Computing retention gains, comparing populations• Fulfilling accreditation requirements, justifying costs
Levels of Benefit
![Page 6: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/6.jpg)
Which level would you say best describes the highest level of how your school is using SmarterMeasue?
Level One – Using it as a student serviceLevel Two – Integrated into your software and processesLevel Three – Conducting statistical analysis of your data
Poll
![Page 7: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/7.jpg)
Progression of SmarterMeasure Data Utilization
Predictive
Correlation
Comparison
Descriptive
Student Service Metrics
![Page 8: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/8.jpg)
Approaches to Research Projects
Internally
Conducted
Company
Assisted
Professionall
y Assist
ed
![Page 9: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/9.jpg)
Cynthia Pascal Coordinator of Academic Advising & Retention
Northern Virginia Community College
![Page 10: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/10.jpg)
Northern Virginia Community College
Northern Virginia Community College’s Extended Learning Institute
Current Use of
SmarterMeasure
• Website• Orientation• Welcome
Messages• Student Planners• Embedded in Bb• Freshman
Seminar/ College Skills Assignment
• Advising partner colleges of students’ “goodness of fit”
![Page 11: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/11.jpg)
Northern Virginia Community College
Tool to assess incoming students
Northern Virginia Community College’s Extended Learning
Institute
![Page 12: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/12.jpg)
Northern Virginia Community College
Northern Virginia Community College’s Extended Learning Institute
Data used to have conversations with students
who are on academic probation or taking a class
for the third time.
Data used to have conversations with
students who are on academic probation or
repeating a class for the third time.
![Page 13: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/13.jpg)
Northern Virginia Community College
Northern Virginia Community College’s Extended Learning Institute
![Page 14: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/14.jpg)
Lou Ann Martin – Title III Activity Director for the Academic Support Network
Courtney Tillett – Information Tech-instruction-applications Analyst
Tri-County Technical College
![Page 15: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/15.jpg)
Current use Completed voluntarily by incoming students
Completion encouraged through acceptance letter Results captured in Banner Results reviewed briefly with students by advisors
Students enrolled in Freshman Seminar/College Skills classes use results as springboard for discussions and journal entries
Goal Would like to be able to identify students at-risk due to
non-academic issues Initial research found no specific correlations Tried different approach after consulting with
SmarterMeasure Preliminary results are promising and suggest the need
to tweak our readiness ranges
SmarterMeasure Results at TCTC
![Page 16: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/16.jpg)
Acceptance Letter
![Page 17: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/17.jpg)
Results in Banner
![Page 18: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/18.jpg)
Readiness Ranges Analysis
Default Cut
Points
N
p-value
F
Adjusted Cut Points
p-
value
F
MeanGPA
PersonalAttribute
s
70 / 85 1,457 0.2723 1.30 80 /90 0.2327
1.46 Fail: 2.15Question: 2.30Pass: 2.34
LifeFactors
70 / 85 1,482 0.2453 1.41 80 / 90 0.1217
2.11 Fail: 2.21Question: 2.24Pass: 2.56
Reading Recall
30 / 65 1,380 0.1237 2.09 70 / 90 0.0002
8.52 Fail: 2.21 Question: 2.24Pass: 2.56
Technical
Competency
80 / 90 1,362 0.0011 6.82 90 / 100 0.0367
3.31 Fail: 1.84Question: 2.26Pass: 2.34
Technical
Knowledge
50 / 75 1,352 0.0039 5.56 70 / 80 0.0057
5.18 Fail: 2.03Question: 2.26Pass: 2.45
TypingRate
21 / 31 1,346 0.0303 3.51 25 / 40 0.1226
2.10 Fail: 2.17Question: 2.36Pass: 2.36
![Page 19: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/19.jpg)
Notes: Based on “Making SmarterMeasure a Strong Predictor of
Academic Success” Used ANOVA to determine the strength of the relationships
between the readiness ranges and first-semester GPA 6,931 FTPS students from the fall and spring semesters of the last
three academic years (2011-2012 – 2013-2014) 1,593 matched to SmarterMeasure results Any test taken after the first day of class for each semester was
excluded from the analyses
Readiness Ranges Analysis
![Page 20: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/20.jpg)
How can the ranges for Personal Attributes and Life Factors be adjusted? Would any of the individual subscales in either
section be more predictive? What is the practical significance of the
findings?
Questions Raised
![Page 21: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/21.jpg)
Configure the assessment engine Control for self-selection bias Consider adding your own questions Classify using your own demographic factors Create a sanitized data set
Five C’s to Maximize SmarterMeasure
![Page 22: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/22.jpg)
Your Account Manager is eager to train you on any of these configuration options.
Configure the Assessment Engine
Julie Owen Tara McLaughlin
![Page 23: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/23.jpg)
Login Tutorial Video
Add Google Analytics
Integrate into LMS or SIS
Require student email
Turn on/off demographics
School Level
![Page 24: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/24.jpg)
More demographics
Adjust time zone
Custom Remedial Resources
Custom Remedial Text
Require student email
Renewal alert
School Level
![Page 25: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/25.jpg)
Integrate into third party software such as an LMS, SIS or Advising suite.
Single Sign On
Automated data transfer
Gradebook integration
School Level
![Page 26: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/26.jpg)
Re-order sections
Skip sections
Add Math and Writing
Adjust Readiness Ranges
Select Versions
Group Level
![Page 27: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/27.jpg)
Change scoring type – 4 point or percentage
Assessment Mode – Sequential or Disaggregate
Show National Averages
Results options – Report, Custom Text or URL
Group Level
![Page 28: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/28.jpg)
Custom Interface
Text
![Page 29: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/29.jpg)
Select each of the ways that your school has configured SmarterMeasure.Re-order or delete sections LMS integrationAdding custom questionsCustom introductory or score report textAdjusting Readiness Ranges
Poll
![Page 30: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/30.jpg)
Control for Self-Selection Bias
![Page 31: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/31.jpg)
Consider Adding Your Own Questions
![Page 32: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/32.jpg)
Classify Using Your Own Demographic Factors
![Page 33: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/33.jpg)
Create a Sanitized Data Set
![Page 34: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/34.jpg)
Based on the webinar today how likely is your school to enhance the way it uses SmarterMeasure?Very likely – I learned some actionable ideas.Likely – This has me thinking.Not likely – This is interesting but there is no need to change what we are doing.
Poll
![Page 36: Wow! I Did Not Know I Could Do That; Tricks for Configuring SmarterMeasure & Analyzing Data](https://reader036.vdocuments.mx/reader036/viewer/2022062513/555c0c70d8b42ad27e8b49e7/html5/thumbnails/36.jpg)
Please Give Us Your Feedback
You will receive a post-webinar email with a link to the survey.