analyzing big data: the ri referee ranking system
TRANSCRIPT
Analyzing Big Data: The RI Referee Ranking
SystemSteve Mauricio, SRA
Brian Sperlongano, SYRAMarch 22, 2014
Session ObjectivesLearn how big data can improve your referee
programLearn how standard software can be easily
usedLearn the benefits realized by Rhode Island’s
pilot programTo State Referee AssociationsTo AssignorsTo Referees
Discuss the challenges in developing and maintaining a program
Why We turned to Big Data
Our ChallengesReferee identification
Who do we have?How good are they?Who is next for State Cup, Regional, etc… ?
Change the CultureAssignor barriersReferee motivation & self-improvementAwareness of leagues & tournaments
Solution: Referee RankingsDeveloped an identification committee tasked
with creating a ranking processCreated a “Top 100” ranking database
Specific to Grade 8 referees under age 25Uses weekly assignment dataAssigned numeric values to each League, Age
Group, and Referee positionPublish public list on our web site!Keep internal statistics on all assignments
and all referees
How We Create the ListRegional
Assignments
Adult Assignments
Premier Assignments
Competitive Assignments
Fitness TestResults
Formula Examples
5 points=
663 points=
Final
2x
Travel League
1x1
U10
x5
Assistant Referee
3.9
State Cup
x8.5
U18
x10
Referee
Promoting Fitness at Grade 8!
% bonus for passing the fitness test
Bigger bonus for exceeding minimums
Fitness test used as an identification event
Challenges5 assignment systems in use statewide
Different report formatsThe “John Smith” effect
Pen-and-paper assignorsVolunteers with technical skills
There are engineers & computer scientists in your community
Use standard tools, Microsoft Excel, Access, etc.
Frequent updates are important but require labor
Outcomes
Opportunities to Educate Referees
“Brian, ###### is so upset. How is this ranking done? What are the qualifications? He is trying like crazy to be a great ref, but it seems he almost never gets ref assignments, simply ARs. He will be taking the fitness test and the ODP ref class. I understand there is a RI Ref Academy; could you tell us about it?”
Opportunities to Educate Assignors
“Could you please give me some info on how the referee raking is compiled? I have some referees that I feel should be able to make the list.
I was looking at the link you sent out to the refs of the top 100 under 25 years old and I see that ranked 47th you have ###### from Pawtucket and I am wondering how he made the ranking seeing how he just got certified for the first time this year and he has never refereed a game until this weekend.”
OutcomesFilling open games / assignment opportunitiesReferee awareness of higher leaguesRemove perception of favoritismCreate competition between refereesReferees more willing to reach out to assignorsLeagues WANT to be included / builds unityFuture GameOfficials & US Soccer
collaboration?Objective annual award decisions
Grade 7 Enrollment2015 Grade 7 class
will double the population of high grade referees!
High Ranking = Motivation to upgrade
2011 2012 2013 2014 20150.0%
1.0%
2.0%
3.0%
4.0%
5.0%
6.0%
7.0%
Referee Population: Grade 7+
Gender / Assignment Disparity
Assignment data can reveal other trends!Below U12, males & females assigned at same
ratioAbove U12, assignments to females decrease
Gender disparity a 2014 focus areaCan’t fix what you don’t know about!
RefereePopulation
AssignmentsBelow U12 U12/U13 U14+
Male 67% 67% 73% 80%Femal
e33% 33% 27% 20%
Questions & Answers
Thank you!