nyc big data meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfmeetup bloomberg 5/21/2012...
TRANSCRIPT
![Page 1: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/1.jpg)
TheNewSQLdatabaseforhighvelocityapplica9ons
NYCBigDataMeetup
Bloomberg5/21/2012
![Page 2: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/2.jpg)
Value of Individual Data Item
Aggregate Data Value
DataValueChain
Interac9ve Real9meAnaly9cs RecordLookup HistoricalAnaly9cs ExploratoryAnaly9cs
Milliseconds Hundredthsofseconds Second(s) Minutes Hours
.Placetrade
.Servead
.Enrichstream
.Examinepacket
.Approvetrans.
.Calculaterisk
.Leaderboard
.Aggregate
.Count
.Retrieveclickstream
.Showorders.Backtestalgo.BI.Dailyreports
.Algodiscovery
.Loganalysis
.FraudpaKernmatch
AgeofData
DataValue
Source:VoltDB,Inc.
![Page 3: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/3.jpg)
Tradi9onalRDBMS
MarketLandscape
Interac;ve Real;meAnaly;cs RecordLookup HistoricalAnaly;cs ExploratoryAnaly;cs
SimpleSlowSmall
FastComplexLarge
App
lica9
onCom
plexity
Hadoop,etc.
DataWarehouse
Transac9onal Analy9c
Value of Individual Data Item
Aggregate Data Value
NewSQL
DataValue
NoSQLVoltDB
![Page 4: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/4.jpg)
TheClosed‐Loop‐Big‐Data‐Dream
• Makethebestdecisionevery9methereisaninterac9on
• Real‐9medecisionsareinformedbyopera9onalanaly9cs&pastknowledge
• Some9mescalledOLTP
“itisnotenoughtocapturemassiveamountsofdata;organiza9onsmustalsosiVthroughthedata,extractinforma9onandtransformitintoac;onableknowledge.”
Real‐9meDecisionMaking
Reports&Analy9cs
ExploratoryAnalysis
Who: AutomatedWhat: Transact, Opera9onalAnaly9cs
Who: AnalystWhat: Reports,Drilldown,…
Who: DataScien9stWhat:Discovertrends,rules,…
Knowledge
Knowledge
![Page 5: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/5.jpg)
Real‐9medecisionmakingUseCases
• Highthroughput,relentlessdatafeeds
• Fastopera9onsonhighvaluedata
• Real‐9me,opera9onalanaly9cspresentimmediatevisibility
Real‐9meAnaly9cs
DeepAnaly9cs
Warehouse/Hadoop
Real‐9meOpera9ons
HighVelocityData
Sources
Real‐9meAnaly9csReal‐9meOpera9onsData Feed
NetworkTrafficMonitoring NetworkpacketsExaminepacketbysource/des9na9on
Iden9fybandwidthoutliers
FinancialTradeSupport Marketorders IngesttradedataRecallposttradeordergroupings
Sensortracking&analy9cs Sensorposi9onfeedIden9fica9onandcleansingoftaginfo
No9fica9onandgroupings
MobileGaming OnlinegameGamestateupdatesandusagepaKerns
Leaderboardlookups
DigitalAdTech Adbid/clickstream Bid,op9mizecontentReportadperformance
![Page 6: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/6.jpg)
TheVoltDBDatabase
• High‐performanceRDBMS
• In‐memorydatabase
• Automa9cscale‐outoncommodityservers
• Built‐inhighavailability
• Rela9onalstructures,ACIDandSQL
CostDisrup9on
Ex.Tradi9onalRDBMS VoltDB
SystemSPARCSuperCluster/
Oracle11g18,8‐coreIntelservers
Price/tpmC $1.01 $0.012
VoltDBPerformanceAdvantage
TPC‐Csinglenode(Oracle) 45X
TPC‐Csinglenode(MySQL) 100X
![Page 7: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/7.jpg)
Rela9onshipofthe3V’s
• Uniqueop9miza9onsforeach• Naturalpartnershipsacross• Coretechnologybarriers
• Lookforrighttool,polyglotandpartners!
“Theleadingedgeofbigdataisstreamingdata.”‐TDWI
• UnstructuredData• R&W• Flexibility
Variety
• StructuredData• R&W• Transac;onal
Velocity• Structured&Unstructured• ReadHeavy• Analy;cs
Volume
DW
NoSQL
Hadoop
![Page 8: NYC Big Data Meetupmattturck.com/wp-content/uploads/2012/05/volt-db.pdfMeetup Bloomberg 5/21/2012 Value of Individual Data Item Aggregate Data Value Data Value Chain ... . Fraud paern](https://reader036.vdocuments.mx/reader036/viewer/2022071403/60f77d8648a8b440be4256ea/html5/thumbnails/8.jpg)
MarketDisrup9onfromDataCrea9on
Tradi9onaldatabasearchitecturescan’tkeepup
MacroTrend
s
• Creation:EndpointsXprocessingXnetwork• Data:Perceivedascompe99veweapon
• Speed:Valueradicallyincreasesasyouapproachreal‐9medecisioning
• Eco-system:Datastoreintegra9ons
Every60seconds…168millionemailssent694,445searchqueries98,000Tweets695,000+Facebookupdates13,000+iPhoneappsdownloaded
EndPointProlifera;on