Thinking out of the box score

Evaluation MethodsThinking out of the box score

Evaluation MethodsBen Silliman, Youth Development Specialist

NC 4-H

What to look forWhat to look for

• Quantitative: By the numbers…• The box score is what matters

• Qualitative: Behind the numbers…• How and why things

are working matters

BigTime U recruited the bestFreshman class and has been putting up big numbers this season…

…but MidMajor U has some clever strategies and plays with a lot of heart

How to find itHow to find it

• Quantitative• Census or enrollment data• Tests and Surveys; Performance Records

• Qualitative• Observations, Focus Groups, Interviews• Case Studies, Concept Maps• Content Analysis, Portfolios

Time Out: What are their options?

Quantitative Methods:Performance Records

Quantitative Methods:Performance Records

Weight Room• Static and Dynamic Strength, Flexibility• Heart rate, breathing, skin response

OK, Hi. Trainer Bob here at MidMajor U and my guys are not outworked by anybody, see. Dr. Strong, who started this fitness program got all the stats on what it takesto run flat-out for 40 minutes. I only wish he had the same figures on passing college classes.

Quantitative Methods:Passing the Test

Quantitative Methods:Passing the Test

• Playbook: Offense & Defense(Ours and Theirs)

Joe Assistant Coach here. When your weight trainingis done, take this Playbookand study it like your lifedepended on it…and it mightconsidering what studentsthrow from the stands!

Quantitative Methods:The Box Score

Quantitative Methods:The Box Score

• Before the GameTeam A• Center 7’2” Senior• Forward 22 PPG• Forward 8 RPG• Guard 34” vertical

leap• Guard 90% FT avg.Team B• Season Record: 8-2

Hot Shot Hawkins here…our GIANTS on Team A have their conference tune-up against a fiesty Team B…

Quantitative Methods:The Box Score

Quantitative Methods:The Box Score

• Before the GameTeam A• Center 7’2” Senior• Forward 22 PPG• Forward 8 RPG• Guard 34” vertical leap• Guard 90% FT avg.Team B• Season Record: 8-2

• After the GameTeam A• C: 6 P, 10 Reb, 5 PF, 24 m• F: 23 P, 7 R, 3 PF, 37 m• F: 9 P, 2 R, 4 PF, 35 m• G: 14 P, 3 R, 2 PF, 36 m• G: 5 P, 1 R, 5 PF, 31 mP = Points; R = Rebounds; PF = Personal Fouls; m = Minutes Played

Team B 63, Team A 57

What happened?

Quantitative Methods:The Box Score

Quantitative Methods:The Box Score

• Before the GameTeam A (RPI = .45)• Center 7’2” Senior• Forward 22 PPG• Forward 8 RPG• Guard 34” vertical leap• Guard 90% FT avg.Team B (RPI = .59)• Season Record: 8-2

• After the GameTeam A• C: 6 P, 10 Reb, 5 PF, 24 m• F: 23 P, 7 R, 3 PF, 37 m• F: 9 P, 2 R, 4 PF, 35 m• G: 14 P, 3 R, 2 PF, 36 m• G: 5 P, 1 R, 5 PF, 31 mP = Points; R = Rebounds; PF = Personal Fouls; m = Minutes Played

Team B 63, Team A 57(Team A revenue: $30,000)

OK, so I knew all along thatTeam A was not that good, even if they were BIG.

Evaluating on the RunEvaluating on the Run

What if we looked at how points were scored, (or not) not just how many points were scored?

Evaluating on the RunEvaluating on the Run

What if we looked not at how each player performed, but at how they played together?(How ‘bout them ‘Cats!)

Qualitative Methods:Observation Strategies

Qualitative Methods:Observation Strategies

• Man-on-Man or Zone

• Matchups and Switch-offs (individual, team)

Oh, Baby! You gotta recognize that Defense!

Qualitative Methods:Observation Strategies

Qualitative Methods:Observation Strategies

• Moving without the ball

• Pick and Roll

Those Senior guards see the opportunity, Baby!

Qualitative Methods:Focus the Strategy

Qualitative Methods:Focus the Strategy

• Focus groups: • Assistant coaches• Experienced players• Spotters

Key improvement needed on offense Key improvement for defense Critical change in pace of the game

The Coach is sayin’ ,“What are you thinking our there? Let’s get focused!

Later on that same season…Later on that same season…

Qualitative Methods:Case Study

Qualitative Methods:Case Study

How can we beat #1?• Case Study

OK, team, these girls may have won 70 games in a row,but here’s what the films of their past games tell us:• When they play best…so here’s how we start…• When they play worst…so here’s how we continue…

Qualitative Methods:Concept Mapping

Qualitative Methods:Concept Mapping

How do we manage the tournament?• Concept Mapping

OK, team, let’s look at the kinds of defenses we will face:• What are the strengths of the 2-1-2 zone?• What are the weaknesses of the man-on-man … where can we create a mismatch with this team?

Grounding EvaluationGrounding Evaluation

• Validity: Does it measure what it claims?• Reliability: How consistent are measures?

Diversifying EvaluationDiversifying Evaluation

• Triangulation: Multiple/Mixed Measures• Longitudinal Tracking: Results over time

• Principles and Performance: Does anything count but the numbers?