how open source cloud platforms can solve big data needs in a location-aware, socially connected app...
DESCRIPTION
The explosion of data generated by location-based and real-time applications has created new problems for application developers. Data has been fragmented in silos, stored and duplicated across multiple locations, which is difficult to access, ineffective and expensive. There is a large opportunity to harness this distributed data by building a common storage platform with shared access and costs. In this session, Bret Piatt will lay out a vision of common storage platform, including how the cloud, specifically an open cloud framework, is the best place to bring this data together. He will also discuss the value and risk to application developers, real-world use cases and even societal implications on how we are able to gather, process and access data across multiple locations in real-time.TRANSCRIPT
Community StackerBret Piatt
Web 2.0 Expo 2010How Open Source Cloud Platforms Can Solve Big Data Needs in a Location-Aware, Socially Connected App World
&Twitter: @bpiatt
OBLIGATORY
“WHAT IS THE CLOUD?”
GLOBAL
ON DEMAND
INFRASTRUCTURE
OBLIGATORY
“WHAT IS THE WEB?”
GLOBAL
ON DEMAND
APPLICATIONS
OBLIGATORY
“WHAT IS THE SOCIAL WEB?”
GLOBAL
ON DEMAND
PERSONAL
HOW ABOUT NOW..
“..YOU TALK ABOUT SOMETHING REAL?”
WEB SCALE DATA
TERABYTES PETABYTES OF DATA
MILLIONS BILLIONS OF WRITES EACH DAY
BLOGS, FEEDS, CHAT – ALL IN SILOS
DATA OWNED AND CONTROLLED BY PROVIDERS
ACCESSIBLE ONLY UNDER THEIR TERMS
THE OPPORTUNITY
COMMUNITY DATA STORES
COMMON SCHEMAS
AGGREGATED INFORMATION
SHARE THE FOUNDATION
PAY FOR WHAT IS UNIQUE TO YOU
COMPUTABLE OBJECT STORE
COMMON STORAGE
ACCESS VIA API
SHARED ACCESS
SHARED COSTS
ORGANIZED AS A COMMUNITY
WHY COMPUTE MOVES TO DATA
1 PETABTYE OF DATA TAKES OVER 10 DAYS TO MOVE..
NOT
..ON A 10 GIGABIT NETWORK!
WHY OPEN MATTERS
LOCK-IN IS A REAL CONCERN IN THE CLOUD
OPEN SOURCE / DATA MAKES IT ACCESSIBLE TO YOU
GAIN THE KNOWLEDGE OF A COMMUNITY
SHARE YOUR KNOWLEDGE WITH EVERYONE
TURNS COMPETITION INTO COOPERATION
THE VALUE
MORE ACCURATE
MORE RAPID DEVELOPMENT
MORE USER TRUST
MORE OPPORTUNITY FOR PARTNERSHIPS
THE RISKS
HOMOGINIZATION / GROUP THINK
MALICIOUS CHANGES
LACK OF COMMUNITY SUPPORT
PERFORMANCE / AVAILABILITY
EARLY EXAMPLES
OKFN.ORG
CKAN.ORG
DATAMOB.ORG
OPENSTREETMAP.ORG
TREESNEARYOU.ORG
REAL-TIME COLLABORATION
WHERE WE ARE TODAY
PRIVATE DATA DOMINATES
PUBLIC DATA SETS EMERGING
COMMUNITIES ARE DIFFICULT TO FORM
NEED TO BROADEN AWARENESS
NEED TO STANDARDIZE ACCESS
