d2 d evaluation overview 2013 4 30-13
TRANSCRIPT
1
© 2011 Regents of the University of Minnesota. All rights reserved.
11
Enabling Youth Inquiry through Citizen Science
EVALUATION/RESEARCH OVERVIEW
May 2013University of Minnesota, Cedar Creek Ecosystem Science Reserve
Evaluation Team: Kim Kies, Nathan Meyer, Pam Larson Nippolt, Siri Scott, Andrea Lorek Strauss, Katie Smiley
AcknowledgmentsThe Driven to Discover project is supported, in part, by a grant from the National Science Foundation.
3
© 2011 Regents of the University of Minnesota. All rights reserved.
AGENDA
►Research purpose/evaluation approach►Snapshot of evaluation results to date ►Discuss instruments/procedures
4
© 2011 Regents of the University of Minnesota. All rights reserved.
OVERARCHING GOALSTo engage individuals working with youth in Informal Science Education settings in Citizen Science, AND to encourage authentic inquiry in this engagement.
Oberhauser 2010
5
© 2011 Regents of the University of Minnesota. All rights reserved.
2 PHASES1. Youth leader/youth/scientist research
teams engage in youth-initiated research based on involvement in CS programs focused on monarch butterflies or birds.
2. Disseminate model to broader audiences of youth leaders and citizen science practitioners.
Oberhauser 2010
6
© 2011 Regents of the University of Minnesota. All rights reserved.
3 PREMISES1. Engagement in authentic inquiry leads to
important science education outcomes.
2. Citizen Science is an engaging, effective setting for learning science content & methods (~40% of Monarch Larvae Monitoring Program volunteers monitor with youth).
3. Integrating authentic inquiry into Citizen Science programs will benefit the practice of Citizen Science and Informal Science Education in general.
Oberhauser 2010
7
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH CHARACTERISTICS:
8
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH GENDER
29%
71%Male Female
39%
61%
Male Female
2010 2011 2012
Male 20 43 55
Female 48 67 70
• Percentage of male participants increased slightly each year
44%
56%
Male Female
9
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH AGE• The largest proportion of youth are between the ages of 9 and 13.• 28% of Year 2 youth and 23% of Year 3 youth were returning
participants
5 6 7 8 9 10 11 12 13 14 15 16 170
5
10
15
20
25
30
35
201020112012
Age
Number
The Number of Youth by Age and Year
10
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH ATTITUDES (2012) 73% of youth coming into the program agree
that they can contribute to a citizen science project, but only 56% say they consider themselves a citizen scientist.
78% of youth coming into the program are interested in answering their own questions about nature.
33% had participated in a citizen science project before. Of those, 26% participated through prior D2D involvement and 7% another project.
11
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH ATTENDANCE AND EXPERIENCE (2012)
Youth Attendance Ratings % Youth
All of the time. I was at every meeting. 44%
More than half of the time. I missed a few meetings. 49%
About half of the time. I missed about half of the meetings. 3%
Less than half of the time. I missed more than half of the meetings.
4%
• 73% of youth would like to participate in the research club again, 26% were unsure and 1% did not want to participate again.
• 74% said they enjoyed the program a lot; 23% a moderate amount; and 3% said a little.
12
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH KNOWLEDGE (2012 PRE-POST PROGRAM COMPARISON)
0.0%20.0%40.0%60.0%80.0%
100.0%
43.0%
90.0%
59.0%80.0%
93.0%74.0%
PrePost
13
© 2011 Regents of the University of Minnesota. All rights reserved.
How often do you watch birds or butterflies?
Almost
neve
r
Once
in a
while
Modera
tely
often
Very o
ften
0.0%5.0%
10.0%15.0%20.0%25.0%30.0%35.0%40.0%45.0%50.0%
Prepost
How often do you try to identify the bird or butterflies you see outdoors?
Almost
neve
r
Once
in a
while
Modera
tely
often
Very o
ften
0.0%
5.0%
10.0%
15.0%
20.0%
25.0%
30.0%
35.0%
40.0%
PrePost
YOUTH 2012 PRE AND POST PROGRAM BEHAVIORS
14
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 PRE PROGRAM
Finding organisms and their habitats
Observing organisms and their habitats
Identifying organisms
Using scientific instruments
Using a field guide
Filling out data sheets
0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0%
Very skilled Moderately skilledA little skilled Not skilled
15
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 POST PROGRAM
Finding organisms and their habitats
Observing organisms and their habitats
Identifying organisms
Using scientific instruments
Using a field guide
Filling out data sheets
0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0%
Very skilled Moderately skilledA little skilled Not skilled
16
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 PRE PROGRAM
Asking a question that can be answered by collecting data.
Developing testable hypotheses.
Designing a scientific procedure to answer a question.
Creating graphs that help me and others understand my data.
creating a display to communicate my data and observations.
Analyzing the results of a scientific investigation.
Using the results of my investigation to answer the question that I asked.
0% 10% 20% 30% 40% 50%
Very skilled Moderately skilledA little skilled Not skilled
17
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH RATED SKILLS: 2012 POST PROGRAM
Asking a question that can be answered by collecting data.
Developing testable hypotheses.
Designing a scientific procedure to answer a question.
Creating graphs that help me and others understand my data.
creating a display to communicate my data and observations.
Analyzing the results of a scientific investigation.
Using the results of my investigation to answer the question that I asked.
0% 10% 20% 30% 40% 50% 60%
Very skilled Moderately skilledA little skilled Not skilled
18
© 2011 Regents of the University of Minnesota. All rights reserved.
EVALUATION PROCEDURES
19
© 2011 Regents of the University of Minnesota. All rights reserved.
OVERVIEW We will ask you to complete / participate in…
– Assessments / Surveys– Group phone / conference calls – Attendance forms– Observations with selected teams– Focus Groups with adult leaders
We will ask for your help…– Youth enrollment / consents– Youth assessments
20
© 2011 Regents of the University of Minnesota. All rights reserved.
EVALUATION STEPS OVERVIEW1. Complete and send the consent forms to Grant Bowers (D2D
Program Coordinator).
2. Complete and send youths’ completed pre-assessments and reporting sheet.
3. Have fun! Do your projects! / Complete Attendance sheet. / Participate in phone conference calls.
4. Complete and send youths’ completed post-assessments, reporting sheet, and attendance sheet.
5. Attend the D2D summit / Adult leader focus groups.
6. Complete troop leader surveys.
21
© 2011 Regents of the University of Minnesota. All rights reserved.
PARENT/YOUTH CONSENT1. Parents complete enrollment/consent
forms (Voluntary)
2. Inform youth about the research/evaluation process
3. Youth complete consent forms (Voluntary)
4. Youth complete code sheet
22
© 2011 Regents of the University of Minnesota. All rights reserved.
PARENT/YOUTH CONSENT Send the consent forms and youth code sheets in the
pre-stamped and addressed envelope to:
Grant Bowers
University of Minnesota
1980 Folwell Ave
200 Hodson Hall
St. Paul, MN 55108
P: 612.625.8304
F: 612.625.5299
23
© 2011 Regents of the University of Minnesota. All rights reserved.
ADULT LEADER ASSESSMENTS
Pre-program adult leader assessments: will be administered through SurveyMonkey. A link will only be sent to new leaders.
Post-training assessments: if attending, will be completed on paper directly after the training.)
Post-program adult leader assessments will be administered through SurveyMonkey. A link will be sent to your email after we receive the youth assessments or after the summit if you plan to attend.)
24
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH ASSESSMENTS First and last meeting; dedicate 30 minutes Give plenty of time Provide a comfortable space for writing Let youth know that there are no correct / incorrect
answers Encourage them to fill it out completely (especially open-
ended questions) Make sure the youth complete the questions on their
own. Complete the survey at the meeting. Do not send the
surveys home with the youth to complete.
25
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH PRE-ASSESSMENTS Administer prior to or at the first meeting before you
begin your activities. Put all the youth pre-assessment material into the self-
addressed stamped envelope provided in your evaluation packet. Be sure to include the following:– Reporting Sheet– Youth Pre-Assessments
Seal the envelope and put it where you will remember to send it in the mail the next day.
Send the assessment in the mail the day after your meeting.
26
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH PRE PROGRAM REPORTING SHEET
27
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH PRE ASSESSMENT
28
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH POST-ASSESSMENTS Administer after your team activities are completed. Put all the youth post-assessment material into the self-
addressed stamped envelope provided in your evaluation packet. Be sure to include the following:– Reporting Sheet– Youth Post-Assessments– Attendance forms
Seal the envelope and put it where you will remember to send it in the mail the next day.
Send the assessment in the mail the day after your meeting.
29
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH POST ASSESSMENT REPORTING SHEET
30
© 2011 Regents of the University of Minnesota. All rights reserved.
YOUTH POST ASSESSMENT
31
© 2011 Regents of the University of Minnesota. All rights reserved.
ATTENDANCE FORM
32
© 2011 Regents of the University of Minnesota. All rights reserved.
ADULT LEADER GROUP PHONE / CONFERENCE CALLS
The program will offer Bi-weekly conference calls for adult leaders to connect and discuss various items. Conference call information will be shared in bi-weekly E-zines. The calls offer the means: To disseminate useful information For adult leaders to ask questions For seasoned adult leaders to offer insight For adult leaders to share successes
33
© 2011 Regents of the University of Minnesota. All rights reserved.
ADULT FOCUS GROUPS
Adult leader focus groups will be scheduled the first evening of the D2D Summit / Insect Fair (November or December 2013 -date to be decided).
34
© 2011 Regents of the University of Minnesota. All rights reserved.
QUESTIONS?