driverless ai for gpus - nvidia...afrihost-dynamic ainet telekommunikations-netzwerk betriebs air...

14
Driverless AI for GPUs H2O.ai Interpretability , Accuracy, Speed Sri Ambati, Arno Candel GTC 2017

Upload: others

Post on 17-Oct-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

Driverless AI for GPUs

H2O.ai

Interpretability, Accuracy, Speed

Sri Ambati, Arno Candel GTC 2017

Page 2: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I
Page 3: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

https://github.com/h2oai/perf/tree/master/gtc

https://www.youtube.com/watch?v=LOJbM0aXZp0

Then and Now…Pit Stops, 1960 to 2013

Time is the Only Non-Renewable Resource

https://www.youtube.com/watch?v=LrC3mBNG7WU

World's Fastest GPU Machine Learning in H2O

Page 4: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

https://www.youtube.com/watch?v=4RKSXNfreLE

36x speedup on DGX-1 vs dual-Xeon

Page 5: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

150x speedup on DGX-1

47x speedup on dual Xeon vs TensorFlow on GPU

Page 6: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

H2O.ai Machine Learning Performance

https://www.youtube.com/watch?v=NkeSDrifJdg

16x speedup on DGX-1 vs dual-Xeon

Page 7: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

Driverless AI for the Digital Brain — Enabled by Fast Model Training

Data

Visual Model Interpretation

Driverless AIPipeline

Distributed Multi-CPU Multi-GPU

Model Repository

Feature Engine Deploy

Model Fitness

Auto MLDeep LearningAlgorithmsData Prep

H2O Kaggle Grandmasters

H2O Systems Engineers

H2O Customers Business Leaders

H2O PhDs & Professors

Page 8: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

Preview: R’s data.table coming to Python and GPUs to power Driverless AI

https://youtu.be/1yTHSxJ4KL8

Page 9: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

Driverless AI for GPUs

H2O.ai

Preview: Driverless AI Cockpit

Page 10: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

H2O Community & Fortune 100 customersA.C. Nielsen A1 Telekom Austria AAPTAbovenet CommunicationsAcademic Administrative and Research NetworkAcademic Computer Centre Cyfronet H Accelerated Data WorksAccenture Accenture ServicesAce Ina HoldingsAce International Ace TelecomActon Acxiom Oration Adamo Telecom Iberia Administracion Nacional De TelecomunicacionesAdmiral Objekt Waesche & Arbeitskleidung Adobe SystemsAdobe Systems India Adsl Maroc TelecomAdvanced Cable CommunicationsAdvanced Computer SolutionsAffecto Afrihost-DynamicAinet Telekommunikations-Netzwerk BetriebsAir Bank A.S.Air Liquide Sa Airess Cesko Akamai TechnologiesAktia Saastopankki OyAktiv-I Szolgaltato Al-Shahad Information TechnologyAlbert Einstein College of Medicine of Yeshiva

Bell Canada BeltelecomBeyond The Network America Bezeq International-Bh - TecBharti Airtel Bibliotheque Nationale De France Big Fish GamesBigleaf NetworksBiglobe BilinkBimeh Dormitory Sharif University of TechnologyBio-Rad LaboratoriesBiocontrol Bisiness Network JvBite CommunicationsBiznetBiznet MetronetBlekinge Institute of TechnologyBlue Line Infotech BlueconnectBoingo WirelessBol.Com BvBoots UK Retail BoranetBorlange Energi Boston Scientific Oration Bouygues Telecom Division Mobile Bouygues Telecom Sa Brain Telecommunication Bright House NetworksBrighthouse Networks Cfl Division

Case Western Reserve UniversityCatalina Marketing Catalina Marketing Oration Cect-Chinacomm CommunicationsCedars-Sinai Health SystemsCelgene Oration Center For Governmental Research CenterbeamCentral Telegraph Public Joint-StockCentre De Calcul El-Khawarizmi - CckCentre For Advanced Computing Centro De Tecnologia Da Informa O Renato ArcherCeom Israel CerfnetCerner Oration Certara USACeu Cgi Group Champaign Telephone Charles UniversityCharlesbrauerCharter CommunicationsChegg Chengdu West Dimension Digital TechnologyCheonanjeonhwakukjang Chico Board of Trade China Digital Kingdom TechnologyChina Education and Research NetworkChinatelecom Group Beijing Co Chongqing Times Newper Office Chs - Bna Lan Chunghwa Telecom Data Communication

Delft University of Technology NetworkDelhi Technical University(Dce)Deloitte Deloitte ServicesDeloitte Touche Tohmatsu ServicesDeloitte and Touch Regional Consulting ServicesDelphon IndustriesDelta Dental Plan of Michigan Delta Leasedline NetworkDeluxe Oration Den NetworksDena Deutsche TelekomDeutsches Reisebuero Develon Dhirubhai Ambani Institute of Information Dialog Axiata Digi Tavkozlesi Es Szolgaltato Digia Digital EntertainmentDigital Hosting TechnologyDigital Network Associates - Franchisee Digital Ocean Digital RealmDigital RiverDigital-Entertainment-Industry-Development-Co--Zhongshan Zho Digitalocean Cloud Direct SupplyDiscoveries In SightDishnet WirelessDistributel CommunicationsDisy Informationssysteme Diverge Consulting

Enbridge PipelinesEncy For Science Technology and Research End-User Numericable Energy Sciences NetworkEnom Orporated Ensync Business Solutions PtyEntanet International Enterprise Teaming Enzu Eotvos Lorand University of SciencesEpam SystemsEpm Telecomunicaciones E.S.P.Epsilon Data Manement Dba EquantEquinox Consulting Erasmus McErasmus University RotterdamEricsson Business CommunicationsEricsson Network SystemsEscout Consulting Espn Estate Valuations and Pricing SystemsEtapa Ep Etex CommunicationsEtheric NetworksEthio TelecomEthz Swiss Federal Institute of Technology Zurich Etisalat Lanka (Private)European Bioinformatics Institute EvergyExcell Media

Companies Using H2O.ai

2015

2016 Now

2017

Goal

13,000

9,760

6,427

3,810

H2O.ai Users

2015

2016 Now

2017

Goal

110,000

91,464

54,163

38,257

“Overall customer satisfaction is very high.” - Gartner

Select Reference Customers:

Page 11: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

AI in Financial Services

Wholesale / Commercial Banking• Know Your Customers (KYC) • Anti-Money Laundering

(AML)

Card/Payments Business• Transaction Frauds • Real-time Targeting • Credit Risk Scoring • In-Context Promotion

Retail Banking• Deposit Fraud • Customer Churn Prediction • Auto-Loan

IT Infrastructure

• Security Cyberlake • DoS Detection and Protection • Master Data Management

Page 12: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

AI in Healthcare

Flu Season Prediction

Personalized Drug Matching

Medical Claim Fraud Detection

Emergency Room and Hospital Management

Drug Discovery

Remote Patient Monitoring

Early Cancer Detection / Oncology

Medical Imaging and Diagnostics

Product Recommendation

*AI Healthcare Map from CBInsights

Page 13: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

FEATURE GTC Q2 2017 Q3 2017 Q4 2017GLM (Single GPU)Python API for training & scoringPython .whl installation fileGBM (Single GPU)Inference on GPU (GLM)GLM (Multi GPU - Multiple Models in Parallel)GBM (Multi GPU - Multiple Models in Parallel)Inference on GPU (GBM)k-Means Clustering, Nearest Neighbors - Single GPUPCA (Single GPU)Quantiles (Single GPU)GLM (Multi GPU - Single Model)Sort (Single GPU)GBM (Multi GPU - Single Model)

Random Forest (Multi GPU - Single Model)Kalman FiltersSort, Quantiles (Multi GPU)SVM (Single GPU)Connectors to GPU Open AI Data Frames

H2O GPU Roadmap

Page 14: Driverless AI for GPUs - NVIDIA...Afrihost-Dynamic Ainet Telekommunikations-Netzwerk Betriebs Air Bank A.S. Air Liquide Sa Airess Cesko Akamai Technologies Aktia Saastopankki Oy Aktiv-I

Want to jump into the deep end?

Train Deep Learning Models Using

H2O Deep Water

Thursday, May 11th 2:00 – 4:00 PM

Room LL21A

Magnus Stensmo, Wen Phan & Arno Candel