architectural inefficiencies and educational outcomes in stem dan sturtevant massachusetts institute...
TRANSCRIPT
![Page 1: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/1.jpg)
Architectural Inefficiencies and Educational Outcomes in STEM
Dan SturtevantMassachusetts Institute of Technology
Engineering Systems [email protected]
![Page 2: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/2.jpg)
Question
• Christensen, Horn, & Johnson assert that a technology enabled transformation will occur in education in the next ten years.
• Such a transformation could change the very character of how the educational function is performed.
• One potential benefit could be the elimination of the “common pace requirement” within classrooms.
What are the potential benefits of removing the common pacing requirement on societal production of scientists,
technologists, mathematicians, and engineers?
![Page 3: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/3.jpg)
![Page 4: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/4.jpg)
![Page 5: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/5.jpg)
Simulate one cohort of students under different education architectures
![Page 6: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/6.jpg)
Movement through the pipeline• Give each between 0 and 1 ‘unit’ of knowledge• Every year (repeat until graduation):
– Move students up one grade.– Assign students to the appropriate schools based on geographic
district.– Assign students to a classroom within that school.– Administrators set expectations and teachers adapt to skills of
students they have in the class.– Teaching and learning for one year. Goal is to gain 1 unit of
knowledge per year.
After 16 years, one may hope that each studentwill contain 16 additional units of knowledge.
![Page 7: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/7.jpg)
Schools and Classrooms
![Page 8: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/8.jpg)
Test impact of:
Pace setting policiesVariation in student and teacher abilityStudent tracking policies
![Page 9: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/9.jpg)
Rules for setting class Start Point (SP):
Fixed Common Standards
Floating Teacher chooses the mean student as the point at which instruction begins.
HalfFixedFloat Teacher feels pressure to account for both factors.
![Page 10: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/10.jpg)
Rules for setting variation in student ability and teacher quality:
NoIndividualVariationTQ = teacher quality.SA = student ability.
TQ = 1 for all teachers.SA = 1 for all students.
TeacherQualityVariation TQ is a random Normal variable with mean 1 and standard deviation 0.1.SA = 1 for all students.
StudentAbilityVariation TQ = 1 for all teachers.SA is a random Normal variable with mean 1 and standard deviation 0.1.
TeacherAndStudentVariation Both TQ and SA are random Normal variables with mean 1 and standard deviation 0.1.
![Page 11: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/11.jpg)
Rules for assigning students to classrooms:
RandomAssignment Every year, students within a school at the same grade level are randomly assigned to classrooms within that school.
TrackingAssignment Every year, students are sorted by their total knowledge to that point (TK) and then assigned to classrooms with other similar students. Note that this assignment is not based on student ability (SA). This assignment scheme serves to reduce variability within each classroom.
![Page 12: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/12.jpg)
Rules for imposing learning penalty to student based on pacing requirement:
PacingPenaltyOnCSP = class start point.TK = student’s total knowledge at the beginning of the year.
PacingPenaltyModifier =
This function peaks at 1 when the student is at the start point and decays exponentially as the distance increases. The function also has the property that SSP + PacingPenaltyModifier is monotonically increasing. This function was chosen because of some of its useful properties.
PacingPenaltyOff PacingPenaltyModifier = 1.
![Page 13: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/13.jpg)
StudentYearlyProgress =
TecherQuality * StudentAbility * PacingPenaltyModifier
![Page 14: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/14.jpg)
Six Simulation Tests
SP = Floating NoIndividualVariation RandomAssignment PacingPenaltyOn
SP = Floating TeacherAndStudentVariation RandomAssignment PacingPenaltyOn
SP = Fixed TeacherAndStudentVariation RandomAssignment PacingPenaltyOn
SP = HalfFixedFloat TeacherAndStudentVariation TrackedAssignment PacingPenaltyOn
SP = Float TeacherAndStudentVariation TrackedAssignment PacingPenaltyOn
TeacherAndStudentVariation RandomAssignment PacingPenaltyOff
![Page 15: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/15.jpg)
Results
![Page 16: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/16.jpg)
Simulation 1
SP = Floating NoIndividualVariation RandomAssignment PacingPenaltyOn
![Page 17: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/17.jpg)
Simulation 1
SP = Floating NoIndividualVariation RandomAssignment PacingPenaltyOn
![Page 18: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/18.jpg)
Simulation 1
SP = Floating NoIndividualVariation RandomAssignment PacingPenaltyOn
![Page 19: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/19.jpg)
Simulation 2
SP = Floating TeacherAndStudentVariation RandomAssignment PacingPenaltyOn
![Page 20: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/20.jpg)
Simulation 2SP = Floating TeacherAndStudentVariation RandomAssignment PacingPenaltyOn
![Page 21: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/21.jpg)
Simulation 2SP = Floating TeacherAndStudentVariation RandomAssignment PacingPenaltyOn
![Page 22: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/22.jpg)
Simulation 3
SP = Fixed TeacherAndStudentVariation RandomAssignment PacingPenaltyOn
![Page 23: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/23.jpg)
Simulation 3
SP = Fixed TeacherAndStudentVariation RandomAssignment PacingPenaltyOn
![Page 24: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/24.jpg)
Simulation 4
SP = HalfFixedFloat TeacherAndStudentVariation TrackedAssignment PacingPenaltyOn
![Page 25: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/25.jpg)
Simulation 5
SP = Float TeacherAndStudentVariation TrackedAssignment PacingPenaltyOn
![Page 26: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/26.jpg)
Simulation 5
SP = Float TeacherAndStudentVariation TrackedAssignment PacingPenaltyOn
![Page 27: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/27.jpg)
Simulation 6
TeacherAndStudentVariation RandomAssignment PacingPenaltyOff
![Page 28: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/28.jpg)
![Page 29: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/29.jpg)
NAEP Scores 2005Mathematics4th 200 220 239 258 2738th 231 255 280 304 324
Reading4th 171 196 221 244 2638th 216 240 265 286 30512th 235 262 288 313 333
Percentiles 10th 25th 50th 75th 90th
![Page 30: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/30.jpg)
NAEP Scores 2005Mathematics4th 200 220 239 258 2738th 231 255 280 304 324
Reading4th 171 196 221 244 2638th 216 240 265 286 30512th 235 262 288 313 333
Percentiles 10th 25th 50th 75th 90th
![Page 31: Architectural Inefficiencies and Educational Outcomes in STEM Dan Sturtevant Massachusetts Institute of Technology Engineering Systems Division dan.sturtevant@sloan.mit.edu](https://reader030.vdocuments.mx/reader030/viewer/2022032414/56649eef5503460f94bfed3a/html5/thumbnails/31.jpg)
Final Thoughts• Lots of attention in education research is placed on relating
individual attributes (student ability, teacher quality, socioeconomic status) to social outcomes.
• Increased focus on system architecture and the way structure leads to behavior might provide insights of significant value.
• Technology enabled education represents a fundamental change (from cellular to network centric)in the very nature of the education system.
• Simulation modeling can be used to explore potential benefits and costs of alternative architectures in a risk free environment.