building personalized applications with hbase
DESCRIPTION
TRANSCRIPT
Developed By:
: Building Personalized Applications with HBase
Odiago, Inc.
Aaron Kimball – CTO
Garrett Wu – Director of Engineering
Developed By:
helps you…
Developed By:
Who uses WibiData?
Easy Integration with Existing Analysis / BI Tools
Backend Infrastructure for Web and Mobile Apps
[engineer] [analyst]
[data scientist] part engineer, part analyst
Powerful Libraries for Data Mining Applications
Developed By:
WibiData applies to…
Developed By:
Example App: Mobile
Developed By:
Developed By:
Developed By:
Libraries Device and User Analysis
Workflow and Data Integration
Reporting
Personalized Recommendations
Analysis
Developed By:
www.fonedoktor.com Get FoneDoktor for your Android today!
Developed By:
The rest of this talk…
• Wibi architecture at a glance
• Under the hood
• Integrating with external systems
• Conclusions
Developed By:
architecture
Certified Technology product
Developed By:
Machine learning building blocks
• Production-quality algorithms included in Wibi
– Recommendation
– Classification
– Clustering…
• Helps data teams get started more quickly
• Lowers end-user requirements
Developed By:
WibiData: Technical Dive Garrett Wu, Director of Engineering
Developed By:
An extended data model
• Column families are a logical concept
• Data is physically arranged in locality groups
Developed By:
An extended data model
• Wibi uses 3-d storage
• Data is often sorted by timestamp
Developed By:
An extended data model
• Columns or whole families have common Avro schemas for evolvable storage and retrieval
<column>
<name>email</name>
<description>Email address</description>
<schema>"string"</schema>
</column>
Developed By:
Producers and gatherers
• Producers create derived column values
• Gatherers aggregate data across all rows
– e.g., for classifier training
Developed By:
Interactive access: REST API
• REST API provides interactive access
• Producers can be triggered “on demand” to create fresh recommendations
GET request PUT request
Developed By:
Tools and Integration
Developed By:
Tools for all users
Developed By:
Data integration:
Developed By:
Data integration:
Developed By:
Self-service analyst workflow
Existing databases
Developed By:
Conclusions
• WibiData is a new platform for user data management and analysis
• The WibiData programming model enables rapid application development
• …and its libraries lower the barrier to entry
• Wibi UI and export tools integrate with existing analytic systems
Developed By:
We have some great customers…
Developed By:
And we’d like you to join us!
• Sign up for the private beta today:
www.wibidata.com
• If you have a compelling use case, we’d like to let you try WibiData
Developed By:
www.wibidata.com / @wibidata Aaron Kimball – [email protected]
Garrett Wu – [email protected]