Creating a Rainbow of BI
Solutions in the Cloud
Pradeep Ananthapadmanabhan
CTO, Vivaki
Sunday, Dec. 2, 2012
Who is Vivaki • Addressable Trading Desk Unit of Publicis Groupe
2
Our Business : Data-driven Marketing
3
Challenges : Unprecedented Volume
4
Challenges : Unprecedented Velocity
5
Challenges : Unprecedented Variety
6
Data Source Data Format
Advertising Cookie Data Text Files with customer
information delivered via FTP
Periodic database dumps
from Advertising platform
provider
XML files delivered via FTP
Facebook data JSON Files pulled in via API
calls
Competitive search data HTML Files directly scraped
from the web.
Brief history… • Portfolio of analytic solutions assembled from various
acquisitions
– Version 1.0 typically built for a single agency
– Challenge in scaling to a broader solution
• 1st generation of solutions to be in the cloud
– Migrated from diverse data center locations
– Cloud migration beginnings in 2008
7
Picking the Right Cloud Vendor Business Considerations Technical Considerations
1. Industry-leading platform
2. Continuous Innovation
3. Competitive pricing
1. Breadth of Solution Offerings
2. Robust eco-system of tools and
technologies
3. Access to development resources
4. Global footprint
5. Commitment to highest-levels of
industry security
8
Variety of Data Analytics Solutions
9
Data
Solutions Planning
Solutions
Insights
Solutions Workflow
Solutions
Diverse Software Stack
10
Broad Cloud Toolset
11
6. Identity & Access
Management
7. Simple Email Service
8. Simple Notification Service
9. Simple Queue Service
10. CloudWatch
1. Elastic Cloud Computing
2. Simple Storage Service
3. Elastic Map Reduce
4. Elastic Beanstalk
5. Relational Database Service
6. SimpleDB
7. DynamoDB
8. Virtual Private Cloud
9. Route 53
Cloud by Numbers…
12
Big Data Processing in the Cloud
13
( 3.5 Billion records, 71 million unique cookies a day)
100-600 Machine
cluster created on
demand
EMR S3
( 180 days = ½
Trillion ICA
records )
Complexity in the Cloud
14
Working with Cloud-Friendly Partners
15
Challenges in Going Cloud 1. Ensuring security mis-conceptions are addressed squarely
2. Putting cloud costs in perspective
– Training your employees to be more resource-conscious
3. Adapting IT processes to the cloud
– Custom-developed API based resource provisioning to enforce
standard policies
– Password Management
– Virtual Private Cloud
16
17
Contact Information • If you have further questions or comments:
Pradeep Ananthapadmanabhan
CTO, Vivaki