using pivotal cloud foundry with google’s bigquery and cloud vision api
TRANSCRIPT
Using Pivotal Cloud Foundry with Google BigQuery and Vision APIJoshua McKenty, Pivotal
Tino Tereshko, GoogleMichael Goddard, Pivotal
We believe transforming how the world builds software will shapethe future of our world
2
“A company’s core advantage is in the applications it builds.”
Diane Greene, GoogleInfoworld Q&A, May 23, 2016
Both speed and safety are required
• Addressing customer needs faster, with less downtime retains your customers
• Protecting market share from disruptors or something unforeseen
• Being able to make quick experiments (that aren’t destabilizing) gives you more chances at success
• The first to successfully rollout the innovation tends to win, defines the category
Enterprise Pattern: Cloud Native
Cloud Native
DevOps ContinuousDelivery
ContainersMicro services
Why Go Cloud Native?
▪ Cloud Portability▪ Operational Efficiencies▪ Autoscaling▪ Automated Patching & Upgrading▪ Standardization of Tooling & Platform-Provided Services▪ Management & Monitoring through the platform▪ Runtime consolidation ▪ Reduction of multiple vendors
Cloud Native • Microservices architecture• API-first design
• Fault-tolerant and resilient design• Cloud-agnostic runtime implementation• Bundled metrics and monitoring• Proactive failure testing
Cloud Resilient
Cloud Friendly
Cloud Ready• No permanent disk access• Self-contained application• Platform-managed ports and networking• Consumes platform-managed backing services
• 12 Factor App methodology• Horizontally scalable• Leverages platform for high availability
A Cloud Application Maturity Model
Cloud native and microservice models are moving into the Fortune 500
“Two people built an app and got it into the App Store in five weeks”
“I said to my vendors, I don’t want five years ago. I want five years from now.
“The adopters we speak to today, like GE, HP, Equinix, PayPal, Capital One, Goldman Sachs, Airbnb, Medallia, Square, and Xoom say that microservices are well worth the tradeoffs.”
Application Framework
Infrastructure Automation
Platform Runtime
Language framework for microservice-based architectures including components for service discovery, metrics, and circuit breakers.
Application container runtime with attachable backing services, automated CI/CD, routing, health management and logging.
A single deployment API for provisioning for bit-for-bit, consistent, self-healing deployments across any private or public cloud.
Dev
Dev Ops
Ops
SpringCloud
SpringBoot
BOSH
Cloud FoundryPivotal
Cloud FoundryPivotal
Contract: 12 Factor Application
Contract: BOSH Release
Cloud Native with Pivotal
Connect to Data-Driven Business Apps with theservice broker for GCP:
• Cloud SQL
• BigQuery
• Cloud PubSub
• Google Cloud Storage
• Vision API
• Speech API
• Natural Language API
• Translate API
Service Broker
Pivotal Cloud Foundry with GCP Services
Enterprise Pattern: Extending Cloud Native with Data & Analytics
Google Cloud Platform Services
VIRTUAL NETWORK
LOAD BALANCING
CDN
DNS
INTERCONNECT
Management Compute Storage Networking Data Machine Learning
STACKDRIVER
IDENTITY AND ACCESS
MANAGEMENT
CLOUD ML
SPEECH API
VISION API
TRANSLATE API
NATURAL LANGUAGE API
Google Cloud Platform Services
VIRTUAL NETWORK
LOAD BALANCING
CDN
DNS
INTERCONNECT
Management Compute Storage Networking Data Machine Learning
STACKDRIVER
IDENTITY AND ACCESS
MANAGEMENT
CLOUD ML
SPEECH API
VISION API
TRANSLATE API
NATURAL LANGUAGE API
Google BigQuery
1616
Demo
Most importantly, complexity is hidden from end user
We only paid $20
We just rented ~3000 cores from Google for ~20 seconds1
2
3
BigQuery - explained @thetinot
18
What is BigQuery?
Durable and Highly Available
Convenience of SQL
Petabyte-Scale and Fast
Fully Managed, No-Ops Data Warehouse
19
BigQuery: 5 years of seamless innovation2010 2011 2012 2013 2014
Public launch
Large query results
2015 2016
900
300
0
1,200
Code Submits
Beta Release at Google I/O
Dremel X
Big JOIN support
Dynamic Execution
Capacitor
Faster shuffle
100k qps streaming
User-defined functions
BigQuery - The Database is The Data Center(s)@thetinot
Machine Learning for Everyone
22
AndroidAppsGmailMapsPhotosSpeechSearchTranslationYouTubeand many others ...
Used across products:
2012 2013 2014 2015
1500
1000
500
0
Number of directories containing model description files
Rapidly accelerating use of deep learning at Google
Google confidential | Do not distribute
Applications that can see, hear and understand
Google Cloud Platform 24
AlphaBeta
Cloud Natural Language
Pre-Trained Machine Learning Models
BetaGAGA
Cloud Speech
Cloud Translate
Cloud Vision CloudML
Fully trained ML models from Google that allow a developer to easily take advantage of rich machine learning capabilities.
Custom ML
Managed TensorFlow service to train and predict custom models on customer-provided datasets.
Sample App: Landmark Vanguard
App
Data & Analytics
Platform
Infrastructure
Sample App: Landmark Vanguard
Demo
Thanks - Questions?Overview of PCF on GCP
http://www.pivotal.io/google Download a trial of PCF for GCP
https://network.pivotal.io/products/ops-manager GCP Service Broker for PCF
https://network.pivotal.io/products/gcp-service-broker/ Free trial of Pivotal Web Services
http://run.pivotal.io Landmark Vanguard Sample App
https://github.com/cf-platform-eng/gcp-ml-sentimentImage resizing service
https://github.com/cf-platform-eng/image-resizing-service
30