talking talons youth leadership evaluation talking talons youth leadership evaluation report school

Download Talking Talons Youth Leadership Evaluation Talking Talons Youth Leadership Evaluation Report School

Post on 23-Mar-2020

0 views

Category:

Documents

0 download

Embed Size (px)

TRANSCRIPT

  • LEIDEN LLC

    Talking Talons Youth Leadership Evaluation

    Report School Year 2015

    Dr. Carmen Sorge

    csorge@unm.edu

  • 1

    Table of Contents

    Guide to basic interpretation ........................................................................................................... 7

    Summary of results ......................................................................................................................... 7

    Data Collection and Research ....................................................................................................... 10

    Research Design ........................................................................................................................ 10

    Composite instrument ............................................................................................................ 10

    The Composite instrument scoring .................................................................................... 12

    Reliability of the instrument .............................................................................................. 13

    Quizzes .................................................................................................................................. 14

    Reliability and Scale development..................................................................................... 15

    Talking Talons Quiz Knowledge ....................................................................................... 16

    Talking Talons Quiz Attitudes ........................................................................................... 17

    Teacher Feedback Form ........................................................................................................ 19

    Qualitative Data Collection ................................................................................................... 19

    Participants ................................................................................................................................ 19

    Explanation of GLM Repeated Measures ................................................................................. 21

    Examples ............................................................................................................................ 23

    Science Attitudes .......................................................................................................................... 27

    Research on Science Attitudes .................................................................................................. 27

    Science attitude change during program for participants .......................................................... 29

    Science Attitude change from pretest to posttest by group ....................................................... 32

    Student Qualitative Feedback on Science Attitudes ................................................................. 37

    Classroom Teacher feedback about science Attitudes .............................................................. 40

    Hands on science experiments and Animals in the classroom ..................................................... 40

    Research on Hands on Science and Animals in classroom ....................................................... 40

    Classroom Teacher feedback .................................................................................................... 42

    Student Feedback on Animals in classroom and Hands on science .......................................... 42

    Buddy class ................................................................................................................................... 46

    Research on peer tutoring .......................................................................................................... 46

  • 2

    Classroom teacher assessment of Buddy class .......................................................................... 48

    Student feedback on Buddy class .............................................................................................. 49

    Role Model for younger students .......................................................................................... 53

    Science Knowledge ....................................................................................................................... 54

    Change in Science Knowledge by Group ................................................................................. 54

    Quiz Knowledge ........................................................................................................................ 57

    Self-perceived science grade in school ..................................................................................... 65

    Quiz Attitude subscales ............................................................................................................. 68

    Feedback on Educator ................................................................................................................... 70

    Student Quantitative Feedback.................................................................................................. 70

    Student Qualitative Feedback.................................................................................................... 74

    Classroom teacher feedback for Educator ................................................................................. 75

    Classroom teacher feedback for Talking Talons Program ............................................................ 78

    Teacher Attitude ........................................................................................................................ 78

    Effectiveness by student ability: feedback by classroom teachers .......................................... 79

    Classroom teacher subscales ..................................................................................................... 81

    Other Results ................................................................................................................................. 83

    Significant changes in pre posttest Composite .......................................................................... 83

    Moral Attitude ........................................................................................................................... 83

    Research on Moral Attitude ................................................................................................... 83

    Overall significant Composite results ....................................................................................... 87

    Overall Non significant composite results ................................................................................ 90

    Summary ..................................................................................................................................... 101

    References ................................................................................................................................... 103

  • 3

    Tables

    Table 1 Pretest and Posttest Cronbach’s alpha for subscales ....................................................... 13

    Table 2 Participants by Group ...................................................................................................... 20

    Table 3 Participants by Gender .................................................................................................... 20

    Table 4 Group by Class................................................................................................................. 21

    Table 5 Science Attitude Change over Time ................................................................................ 30

    Table 6 Science Attitude Change over Time Multivariate Tests .................................................. 30

    Table 7 Science Attitude Change over Time within Subjects Effects .......................................... 30

    Table 8 Science Attitude Change over Time Within subjects Contrasts ...................................... 31

    Table 9 Science Attitude Change over Time between Subject Effects ........................................ 32

    Table 10 Change in Science Attitude by Group ........................................................................... 33

    Table 11 Change in Science Attitude by Group Multivariate Tests ............................................. 34

    Table 12 Change in Science Attitude by Group Within subjects Effects ..................................... 34

    Table 13 Change in Science Attitude by Group within Subjects Contrasts ................................. 35

    Table 14 Change in Science Attitude by Group between Subject Effects .................................... 36

    Table 15 Change in Science Attitude by Group Estimated Means ............................................... 36

    Table 16 Difference Change in Science Attitude by Group ........................................................ 37

    Table 17 Attitude toward Science from Quizzes Mean ............................................................... 37

    Table 18 Classroom Teacher assessment of Science Attitude change ......................................... 40

    Table 19 Classroom teacher assessment of program components ................................................ 42

    Table 20 Classroom teac

Recommended

View more >