nervana ai overview deck april 2016
TRANSCRIPT
Proprietary and confidential. Do not distribute.
Overview
April 2016
MAKING MACHINES SMARTER.™
Proprietary and confidential. Do not distribute.
nervana is …
2
Artificial Intelligence
ON DEMAND
Proprietary and confidential. Do not distribute.
World class team and investors
3
…as well as leading research labs
Exceptional talent
Drawing from experience at world class technology companies…
Steve Jurvetson Matt Ocko Naveen Rao Amir Khosrowshahi
Experienced investors & board
Experienced board members
Elite investors behind industry-shaping companies
Proprietary and confidential. Do not distribute.
nervana is built on state of the art deep learning
4
• Features are discovered from data
• Performance improves with more data
Extract features at multiple levels of abstraction
• High degree of representational power
Proprietary and confidential. Do not distribute.
Deep learning techniques
Deep learning has significantly improved accuracy
5
Source: ImageNet1: ImageNet top 5 error rate
Error rate1
human performance
Proprietary and confidential. Do not distribute.
Implementing deep learning at scale is hard and expensive
6
Pre-process training data
Augment data
Design model
Perform hyperparameter
search
• Team of data scientists with deep learning expertise
• Enormous compute (CPUs /GPUs) and engineering resources
Proprietary and confidential. Do not distribute.
The nervana platform - a full stack solution
7
neon deep learning framework
nervana cloud
import train build deploy
Proprietary and confidential. Do not distribute.
A new processor technology …
8
• Training and inference
• Scalable distributed architecture
• Memory near computation
• Power efficient
• Unprecedented compute density
Proprietary and confidential. Do not distribute.
… will provide 10 to 100x gain in speed
9
ImageNet training
1: Standard Nvidia TitanX GPU 2: TitanX GPU optimized with Nervana software 3: Distributed training across multiple NervanaGPUs 4: Custom Nervana deep learning processor
Trai
n t
ime (
hours
)
0
500
1,000
1,500
2,000
CPU Single GPU NervanaGPU Multi NervanaGPU Nervana Engine
11033100
2,000
2 3 41
Proprietary and confidential. Do not distribute.
nervana solutions
nervana implementation libraries (MOP layer)
nervana deep learning functionscustomer algorithms
customer models nervana models
customer solution
Our software stack is easy to use and extend
10
customer data
Out of the box solutions that are easy to extend
Standard deep networks definitions
Rapid model prototyping and exploration. Model training and hyperparameter search.
Integration with H/W for training & deployment • Fastest GPU implementations • Seamless access to cloud or local CPU/GPU
HARDWARE AGNOSTIC
• Video activity recognition • Speech recognition • Time-series prediction
• Object localizer • Image classifier • Semantic parsing • Easy data ingestion
• Curated state of the art models
• Flexible deployment
• REST API for training, inference
Proprietary and confidential. Do not distribute.
Create solutions that are trained on YOUR data
11
neon deep learning
framework
nervana cloud
Solutions
Images
Text
Tabular
Speech
Time series
Video
Proprietary and confidential. Do not distribute.
Image classification and video activity detection
12
Deep learning model Potential applications
• Trained on a public dataset1 of 13K videos in 100 categories
• Training was approximately 3 times faster than competitive framework
• Can be extended to perform scene and object detection, action similarity labeling, video retrieval, anomaly detection
1: UCF101 dataset: http://crcv.ucf.edu/data/UCF101.php
• Activity detection and monitoring for security
• Drone detection and tracking for air traffic mgmt.
• Facial recognition and image based retrieval
• Sense and avoid systems for autonomous driving
• Baggage screening at airports and other public venueshttps://www.youtube.com/watch?v=ydnpgUOpdBw
Proprietary and confidential. Do not distribute.
Speech to text conversion
13
1: LibriSpeech: http://www.openslr.org/12/
Deep learning model Potential applications
• Trained on a public dataset2 of 1,000 hours of English speech
• Trained in 5 days (vs. the normal 70 days) on nervana’s mGPU system
• Can be easily extended to support other languages, detect sentiment, etc.
• Speech recognition for command and control systems
• Speech to text conversion for audio surveillance
• Speech recognition and automated response for radio communication
https://youtu.be/NaqZkV_fBIM
Proprietary and confidential. Do not distribute.
14
Deep learning model Potential applications
• Includes 20 Q&A types1 ranging from single supporting facts to positional reasoning and agent motivation
• Can be extended to more complex text analysis apps like theme identification and sentiment analysis
1: Facebook GRU/LSTM: https://research.facebook.com/researchers/1543934539189348
• Summarization and Identification of themes in documents, financial reports or news articles
• Q&A system for querying any large corpus of text
• Social media monitoring and sentiment analysis for intelligence and security
Natural language processing
Proprietary and confidential. Do not distribute.
Why nervana?
15
Fast Easy to use Scalable
Bring your own data Cloud vs. on-premise Professional services
Proprietary and confidential. Do not distribute.
Why nervana?
16
Fastest deep learning framework
Fast
Wide array of out of the box DL solutions
Easy to use
Scale based on training and inference needs
Scalable
Solutions are optimized for your specific use case
Bring your own data
Available either via :
cloud service or
on-premise appliance
Cloud vs. on-premise
Industry leading in-house team
Professional services
Proprietary and confidential. Do not distribute.
Two distinct engagement models
17
ScopeNervana
HWNervana
SWNervana DL Team
Nervana Cloud
• Access to out of the box solutions, industry leading Nervana framework and hardware infrastructure
Full engagement
Nervana Cloud plus:
• Data science support
• Fully optimized deep learning solution
Proprietary and confidential. Do not distribute.
Sample Engagements
18
Description
NON-EXHAUSTIVE
Identification and measurement of crops to drive decisions for precision agriculture
Description
Analysis of speech samples from in-vehicle communications system
Applying video activity detection techniques to analyze urban surveillance data
Analysis of uploaded images to detect fraudulent activity
NLP analysis of financial documents, analyst and industry reports
Helping predict the occurrence and severity of storms in climate simulations
Transcription and analysis of customer sales calls to predict outcomes
Predicting performance of hybrid seeds from genetic, phenotype, environmental data
Enhancing exchange-traded products and detecting anomalous patterns in order books
Using NLP techniques to analyze RFPs and generate recommendations
Precision Agriculture
Asset Management
Enterprise Infrastructure
Genomics
Financial Services
Security
Sales Automation
Automotive
Online Services
Climate Science
Proprietary and confidential. Do not distribute.
Localize weather phenomena
TMQ
T500
T200
19
Proprietary and confidential. Do not distribute.
Tumor detection
Positive:
Negative:
20
Proprietary and confidential. Do not distribute.
Find fault lines for oil & gas exploration
21
Proprietary and confidential. Do not distribute.
Identify and count corn stalks
22
Positive:
Negative:
NERVANA
Proprietary and confidential. Do not distribute.
nervana has the fastest library
24
neon benchmarks
1: Developed by Facebook and Nvidia 2: Developed by Google SOURCE: Soumith Chintala; http://github.com/soumith/convnet-benchmarks
1
1
2
Proprietary and confidential. Do not distribute.
25
SOURCE: Compiled by Baidu: http://svail.github.io/
nervana has the fastest libraryneon benchmarks
NERVANA