assessing scientific reasoning assessment day 2011
TRANSCRIPT
Assessing Scientific Reasoning
Assessment Day 2011
Scientific Reasoning Objective Questions
Model in Practice: Scientific Reasoning
• General Education Program Learning Outcome: Students will be able to use processes, procedures, data or evidence to solve problems and make effective decisions.
• Target Courses: All General Education Science Courses
• Course Level Performance Indicator:Students will be able to assess scientific reasoning in current (~2 years) science news stories.
Scientific Reasoning Objective Questions
Blue Handout
Model in Practice: Scientific Reasoning
All Gen. Education Science Courses (2009-2011)
• College-wide assessment available to all students enrolled – Spring term Gen. Ed. Science courses (8574 students/150
course sections)– ClassClimate Survey Tool using scanable paper and online
response options– 1950 students participated (onsite)
Q1 Q2 Q3 Q4
A 0.210688591983556 0.369016984045291 0.148662551440329 0.233264675592173
B 0.131551901336074 0.191456510550695 0.154835390946502 0.249227600411946
C 0.184994861253854 0.275347400926403 0.159465020576132 0.517507723995881
D 0.472764645426516 0.164179104477612 0.537037037037037 0
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
Anwser Distribution for All Surveys Combined
EC OC WC WP
A 0.211800302571861 0.223618090452261 0.20863309352518 0.132075471698113
B 0.136157337367625 0.092964824120603 0.149880095923261 0.0754716981132075
C 0.195158850226929 0.203517587939698 0.163069544364508 0.264150943396226
D 0.456883509833586 0.479899497487437 0.47841726618705 0.528301886792453
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
Q1 Answer Distribution (by Campus)
EC OC WC WP
A 0.35249621785174 0.382871536523929 0.372596153846154 0.415094339622642
B 0.196671709531014 0.163727959697733 0.205528846153846 0.113207547169811
C 0.26928895612708 0.279596977329975 0.271634615384615 0.377358490566038
D 0.181543116490166 0.173803526448363 0.150240384615385 0.0943396226415094
2.5%
7.5%
12.5%
17.5%
22.5%
27.5%
32.5%
37.5%
42.5%
Q2 Answer Distribution (by Campus)
EC OC WC WP
A 0.158850226928896 0.143576826196474 0.141656662665066 0.169811320754717
B 0.151285930408472 0.133501259445844 0.165666266506603 0.188679245283019
C 0.170953101361573 0.153652392947103 0.153661464585834 0.150943396226415
D 0.518910741301059 0.569269521410579 0.539015606242497 0.490566037735849
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
Q3 Answer Distribution (by Campus)
EC OC WC WP
A 0.21092564491654 0.214105793450882 0.255702280912365 0.30188679245283
B 0.264036418816388 0.267002518891688 0.235294117647059 0.150943396226415
C 0.525037936267071 0.518891687657431 0.509003601440576 0.547169811320755
D 0 0 0 0
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
Q4 Answer Distribution (by Campus)
AST BOT BSC CHM ESC GLY MCB MET OCE
A 0.153846153846154
0.125 0.215126050420168
0.246428571428571
0.168831168831169
0 0.184549356223176
0.223684210526316
0.0909090909090909
B 0.0769230769230769
0.0416666666666667
0.134453781512605
0.146428571428571
0.12987012987013
0 0.103004291845494
0.197368421052632
0.0909090909090909
C 0.173076923076923
0.166666666666667
0.201680672268908
0.171428571428571
0.25974025974026
0 0.124463519313305
0.105263157894737
0.181818181818182
D 0.596153846153846
0.666666666666667
0.448739495798319
0.435714285714286
0.441558441558442
1 0.587982832618026
0.473684210526316
0.636363636363636
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
65.0%
75.0%
85.0%
95.0%
Q1 Answer Distribution (by Discipline)
AST BOT BSC CHM ESC GLY MCB MET OCE
A 0.384615384615385
0.333333333333333
0.335016835016835
0.408602150537634
0.376623376623377
0 0.489270386266094
0.368421052631579
0.545454545454545
B 0.173076923076923
0.125 0.206228956228956
0.225806451612903
0.142857142857143
0.333333333333333
0.124463519313305
0.118421052631579
0.181818181818182
C 0.288461538461538
0.333333333333333
0.282828282828283
0.229390681003584
0.324675324675325
0.666666666666667
0.244635193133047
0.355263157894737
0.0909090909090909
D 0.153846153846154
0.208333333333333
0.175925925925926
0.136200716845878
0.155844155844156
0 0.141630901287554
0.157894736842105
0.181818181818182
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
65.0%
Q2 Answer Distribution (by Discipline)
AST BOT BSC CHM ESC GLY MCB MET OCE
A 0.173076923076923
0.0416666666666667
0.15993265993266
0.153571428571429
0.12987012987013
0 0.142857142857143
0.131578947368421
0.0909090909090909
B 0.134615384615385
0.125 0.154040404040404
0.167857142857143
0.194805194805195
0.333333333333333
0.194805194805195
0.144736842105263
0.0909090909090909
C 0.134615384615385
0.25 0.164141414141414
0.153571428571429
0.0909090909090909
0.333333333333333
0.519480519480519
0.197368421052632
0.272727272727273
D 0.557692307692308
0.583333333333333
0.521885521885522
0.525 0.584415584415584
0.333333333333333
0.142857142857143
0.526315789473684
0.545454545454545
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
Q3 Answer Distribution (by Discipline)
AST BOT BSC CHM ESC GLY MCB MET OCE
A 0.131578947368421
0.0416666666666667
0.25273799494524
0.148459383753501
0.275 0.333333333333333
0.185344827586207
0.252873563218391
0.0909090909090909
B 0.118421052631579
0.208333333333333
0.269587194608256
0.198879551820728
0.225 0 0.176724137931034
0.218390804597701
0.0909090909090909
C 0.43421052631579
0.75 0.477674810446504
0.436974789915966
0.4625 0.666666666666667
0.637931034482759
0.402298850574713
0.272727272727273
D 0.315789473684211
0 0 0.215686274509804
0.0375 0 0 0.126436781609195
0.545454545454545
5.0%
15.0%
25.0%
35.0%
45.0%
55.0%
65.0%
75.0%
Q4 Answer Distribution (by Discipline)