surgical:ai - nvidiaon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · surgical:ai ai...
TRANSCRIPT
![Page 1: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/1.jpg)
SURGICAL:AIAI Democratise Computer Aided Surgery
![Page 2: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/2.jpg)
WHY NOT GOOGLE MAPAMAZONUBERFACEBOOKALPHAGOFOR SURGERY
![Page 3: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/3.jpg)
SURGERY CRISIS
Healthcare Cost $30 Trillions
(US 23% GDP)
Surgery Cost 40%
($12 Trillion)
5 Billion have no Access to Surgery
OA Affects 1 in 5 (US),
1 in 6 (China)
OA cost 1%-2.5% GDP,
Second cause of disability
Surgery serves Only 5% patients (US), 0.5% (China)
![Page 4: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/4.jpg)
SURGICAL AUTONOMY
AI and Robotics 50% , worth $6 Trillion
Narrow AI
Highly Controlled Environment
Human Support
Cost Insensitive
Ethical , Risk and Regulation
![Page 5: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/5.jpg)
DO SURGEON REALLY NEEDS AUTONOMY
ProBot Full Autonomous, 1997
Da Vinci, No Autonomy, 2000
ACRobot/Mako/Stryker Cooperative, 2012
BrainLab, Navigation
Sedasys
Robotic Drill
![Page 6: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/6.jpg)
THE BARRIERS (T,C,S,A)
Time (prepare)
Time(OR)
Capability
Safety Affordability
Manual 10 minutes 2 hour 100experts
50% success
+0
Robot +1 Day 4 hour 1,000 experts
90% success
+$500,00-$2,00,000
Navigation +1 Day 3 hour 300 experts
75%success
+$100,000-300,00
PSI +1 Month 1 hour 1,000experts
90%success
+$1,000
SurgicalAI 10 minutes 1 hour 1000 experts
95% success
+$500SURGICAL:AI
![Page 7: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/7.jpg)
AUTONOMOUS PSI DESIGN BY AI
Design in Less in 10 seconds, Deliver in 4 hours
Web base Mixture Reality Interface
Deep Morphology Engine Planning And Design Engine
TensorLab: Big Data WarehouseAnd Autonomous Machine Learning System
![Page 8: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/8.jpg)
SHOULDER PSI EXAMPLE (CAOS 2016) (FULLY AUTONOMOUS)
![Page 9: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/9.jpg)
Deep Morphology Engine
1 Data Scarcity: 30 Volumes vs 2 Millions
2 Memory Consumption3D volume vs 1 D signal
3 No Explanation and No Confidence4 Flexible Workflow…..5 Not Cooperative
Traditional Deep Learning for Medical Images processingWishing A baby will becoming a greatdoctor by showing him lots of scans without going to school
= + +
Neural Poincare Engine
Deep Poincare Map (https://arxiv.org/pdf/1703.09200.pdf)
It works like Surgeon, It has memory, knows where to attend its focus
Speed: 0.2 Seconds for Segmentation one bone from a volumeData Efficiently: trained 5 volume we achieve accuracy close to humanMemory Efficient: Needs about 500MB memory, It can run on your mobile phoneFlexible:Parts scan or arbitrary posture.Error Estimation:We know when it fails.
![Page 10: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/10.jpg)
![Page 11: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/11.jpg)
SURGICAL DB
Medical Image and Processed ImagesPSI ModelsImplantsThe Surgery Plan
NoSQL and Map Reduce Search Engine Solution
Find me all the pre and after surgery CT scans of all the patients using Company A implants on the third Spine Joint
The only Question Surgeons Care but No existing PACS or EHR system can Answer
![Page 12: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/12.jpg)
TensorLab for Autonomous Continuous Learning
Heart Failure
AccIoU
Time
Recruitment by Search Engine
The Principal: 1) Everything is Data. 2) Everything is Identified by Query. 3) Pulling based Stream Processing
Images and Sematic Labels
Model Versions and Performance Metrics
Left Volume
Model Architecture
Search Engine is usedas the Router for Data
Job1 Job 2 Job3 Job4 Job5 Job6
Builder Analyser Validator Builder Analyser Builder Analyser Validator
Job Queue
Job Query as Load Balancer
Build Job
Data:Heart with Tumour
Arch:Best Segmenation Model
Input Version:Most Accurate Version
Output Version:Heart Tumour Detection
![Page 13: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/13.jpg)
CLINICAL RESULTS:
Save 40 minutes in OR,1000GBP for 1 procedure
![Page 14: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/14.jpg)
PATIENT SPECIFIC OSTEOTOMY
Guide was designed, printed and sterilized
Guide was fixed to the unique position on the bone
Bone was resected following the guidance of the guide
15° wedge was resected and removed
Wedge was closed and bone was fixed
![Page 15: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/15.jpg)
OTHER PROCEDURES
![Page 16: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/16.jpg)
APPLICATIONS
1) Surgery Planning
2) Patient Specific Guide Device
4) Implants Registration and Management
3) Surgical Workflow Management
![Page 17: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/17.jpg)
A TEAM OF WORLD LEADING EXPERTS
Professor Anan Shetty
(Chief Medical Scientist)Dr Fangde Liu (CEO &CRO)
The best Surgeon in the UKShetty-Kim Technique InventorThe Surgeon of 2017 by Royal College of SurgeonProudest Award for UK, the Hunterian ProfessorAdvisor of NICE ( National Institute of Clinical Excellence)
Chief Architecture of Several Flagship Surgical Robots,Pharmacovigilance for multinationAutonomous CMR Analysis System and DiagnosisSenior Associate ofRoyal Society of Medicine
Dr Hao Dong (Engineering VP)
PhD at Imperial College, Data Science InstituteDeep Learning Engineering ExpertThe Creator of TensorLayerMost Popular DL Framework in China
Yinna Bu (Client and BD Manager in China)MSc from UCLCEO of two start-ups
![Page 18: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/18.jpg)
Prof Yike Guo (Advisor)
Prof Ferdinando Rodriguez y Baena (Advisor)
Dr Joshua Giles (Advisor)
Dr Jianmo Li (Advisor)
Full Professor of Medical Robots at IC, World First Orthopaedics Surgical RobotsSold For Stryker 1.67 Billion DollarsTeam Leader of Biggest Surgical Robots ProjectIn European UnionChair of World Computer Aided Orthopaedics
Full Professor of Data Science at Imperial CollegeChairman of TranSmart FoundationWorld Standard Platform for Translation and Clinical MedicineAdopted by all the major Pham Company in the worldIncluding J&J, Merkek, Roche, Sanophie.
PostDoc at Imperial CollegeInventor of Should PSI
PhD Prof Andrew AmisPostdoc at Imperial CollegeInventor of Knee PSI
Mr Saif AhmedConsultant SurgeonProfessor of AnatomyExpert on 3D Printing and Surgical RobotsExecutive Comminute of Computer Aided Orthopaedics' UK
![Page 19: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/19.jpg)
Kent Institute of Medicine & Surgery
• KIMS is the largest Independenthospital in SouthEast England andKent.
• No.1 patient satisfaction (92%)against other 92 independent hospitalin the UK
• The hospital is equipped with state-of-the-art technology and innovativediagnostic services
• Wide range of treatment – coveringall the orthopedic area and jointreplacement
![Page 20: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/20.jpg)
AI Democratise Computer Aided Surgery
Autonomous Surgery is FeasibleThe barrier is Human Machine CooperationFor Surgery, Not Just AI, Vehicle MattersProvides the tool, not solutionGPU plays crucial by breaking the time barrier
![Page 21: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/21.jpg)
CAOS 2016, Japan Osaka IDEALondon, 2016
Daily Mail, 2016
Re.Work Deep Learning in Healthcare Summit, 2017
GTC 2017
![Page 22: SURGICAL:AI - NVIDIAon-demand.gputechconf.com/gtc/2017/...surgical-ai.pdf · SURGICAL:AI AI Democratise Computer Aided Surgery. WHY NOT GOOGLE MAP AMAZON UBER FACEBOOK ALPHAGO FOR](https://reader030.vdocuments.mx/reader030/viewer/2022041015/5ec604775638540e6d6ee419/html5/thumbnails/22.jpg)
Surgical AI:Bring Big Data and AI into Operating Theatre
Thank You