power in unity: forming teams in large-scale community systems
DESCRIPTION
Aris Anagnostopoulos, Carlos Castillo, Aristides Gionis, Luca Becchetti, Stefano Leonardi: "Power in Unity: Forming Teams in Large-Scale Community Systems". Proc. of CIKM 2010, pp. 599-608.Toronto, Canada. ACM Press.TRANSCRIPT
![Page 1: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/1.jpg)
Power in Unity:Forming Teams in Large-Scale
Community Systems
Aris AnagnostopoulosS, Luca BecchettiS,Carlos CastilloY, Aris GionisY, Stefano LeonardiS
YYahoo! Research – SSapienza University of Rome
![Page 2: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/2.jpg)
2 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Outline
• Motivation
• Problem definition
• Algorithms
• Experiments
![Page 4: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/4.jpg)
4 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Do you have ...?
• ... too many papers/proposals to review?
• ... too many interviews to do?
Review workload forlast year: ~60 papers
![Page 5: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/5.jpg)
5 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Motivation
• Staff of people with different skills
• Stream of tasks arriving online
• Create teams on-the-fly for each task
– Teams should be fit for the tasks– Allocation should be fair to people
![Page 6: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/6.jpg)
6 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Criteria
• Fitness
– e.g. if fitness is success rate, maximize expected number of successful tasks
• Fairness
– everybody should be involved in roughly the same number of tasks
Trade-offs may appear: do you see how?
![Page 7: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/7.jpg)
7 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Framework
Jobs/Tasks k
People n
Skills m
Teams k
Score/fitness
Load
![Page 8: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/8.jpg)
8 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Properties
• Pareto-dominant profiles
• Non decreasing performance
• Job monotonicity
• Non-increasing marginal utility
![Page 9: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/9.jpg)
9 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Properties (cont.)
• Non decreasing performance
– c.f. Brooks' Law: “adding manpower to a late software project makes it later”
• Job monotonicity
– May not hold e.g. start from unfeasible task
• Non-increasing marginal utility
– May not hold e.g. if all skills are required
![Page 10: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/10.jpg)
10 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Team profiles
• Maximum skill
• Additive skills
• Multiplicative skills
• Binary profiles
– All of the above are equivalent
![Page 11: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/11.jpg)
11 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Score functions
• Fraction of skills possessed
• is sub-modular: greedy method provides an approximation within a constant factor
• In other applications e.g. Ocean's 11, all skills are required: covering problem
![Page 12: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/12.jpg)
12 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Balanced task covering
• Cover all the tasks
• Objective
• NP-hard problem even with k = 2
– Reduction from MSAT• People = variables; Skills = clauses;
• People in team 1: TRUE, People in team 2: FALSE
• Maximum load of 1 is achieved if clauses satisfied
• Offline setting has a randomized approx. algo. that succeeds with prob 1-± with ratio
![Page 13: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/13.jpg)
13 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Balanced task covering - Online
• Evaluate by competitive ratio
– Compare with optimal offline assignment
• Basic algorithms
– Assemble the team of minimum size– Assemble the team that keeps the maximum
load of a person low
• Competitive ratios are bad:
![Page 14: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/14.jpg)
14 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Weighted set cover
• Weight each set by
– Competitive ratio
• Weight each set by
– Competitive ratio
![Page 15: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/15.jpg)
Experiments
![Page 16: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/16.jpg)
16 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Datasets
Mapping of data to problem instances
Summary statistics
![Page 17: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/17.jpg)
17 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Results (center)
![Page 18: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/18.jpg)
18 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Results (center)
![Page 19: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/19.jpg)
19 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Results (most loaded users)
![Page 20: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/20.jpg)
20 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Results (most loaded users)
![Page 21: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/21.jpg)
21 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Related works
• Lots of works on matching and scheduling problems
• Lots of works on finding one expert
– IR-style and SN-style
• T. Lappas, K. Liu, E. Terzi. Finding a team of experts in social networks, KDD'09.
– Focuses on communication costs
![Page 22: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/22.jpg)
22 Power in Unity – Anagnostopoulos, Becchetti, Castillo, Gionis, Leonardi
Future works
• Building, retrieving and ranking complex information elements
– document/answer sets, photo sets, geo points, RDF sub-graphs, etc.
• Algorithms to support massive collaboration
– decisions, coordination, awareness, etc.
![Page 23: Power in Unity: Forming Teams in Large-Scale Community Systems](https://reader034.vdocuments.mx/reader034/viewer/2022052315/554d3e96b4c90537678b4e14/html5/thumbnails/23.jpg)
Buddy Venturanza @ Flickr (Creative Commons)
Thank you!