how big is big – tall, grande, venti data?
DESCRIPTION
Apache has a wide range of Big Data projects, some suitable for smaller problem sets, some which scale to huge problems. Today though, that one label "Big Data" can cause confusion for new users, as they may struggle to pick the right project for the right scale for their problem. Do we need new titles for different kinds of Big Data? Does the buzz and VC funding cause confusion? Is the humble requirement dead? Or can we help new users better find the right Apache project for them?TRANSCRIPT
How Big is Big?
Tall, Grande, Venti Data?
How Big is Big?
Tall, Grande, Venti Data?
Nick Burch
@Gagravarr
Nick Burch
@Gagravarr
Tall, Grande, Venti?Tall, Grande, Venti?
Different Ideas of Big
• Few machines?• Few racks?• Few datacentres?• Few continents?• 10 servers that fit in a shoebox?• Something that's too big for Excel?
“It's all just hype and buzz”“It's all just hype and buzz”
“It's all the fault of VCs”“It's all the fault of VCs”
Small Data vs On-Demand Big Data systems?Small Data vs On-Demand Big Data systems?
Who wants to be small?
• Reluctance to order a “small” coffee?• Who wants to go to a senior management
meeting, and say “we're not big data after all”?
• Different people, different sizes• Naming is important!
“It's all the fault of sales people”“It's all the fault of sales people”
Requirements!Requirements!
Requirements
• What kind of data?• What kind of queries?• How fast does it change?• How quickly do you need changes?• What scale?• What support?
Can we come up with names to help people?Can we come up with names to help people?
