tackling the challenges of next generation … … · tackling the challenges of next generation...
TRANSCRIPT
![Page 1: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/1.jpg)
TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEAFausto Milletari, Senior Deep Learning Solution Architect Healthcare NALA
![Page 2: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/2.jpg)
2
INTRODUCTIONPart of the global NVIDIA Healthcare team
● Senior Solution Architects @ NVIDIA
● Certified Deep Learning Institute Instructors
![Page 3: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/3.jpg)
3
MEDICAL IMAGINGIS A COMPUTATIONALPROBLEM
Medical imaging is a difficult computational
problem, which GPUs have been already
solving for the past 10 years. As newer
computational platforms become available,
novel imaging techniques and improved
algorithms can be developed.
![Page 4: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/4.jpg)
4
10 YEARS OF INNOVATION IN HEALTHCARE
![Page 5: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/5.jpg)
5
COMPUTATION IN IMAGINGEverywhere!
ReconstructionComputed Tomography
Magnetic Resonance ImagingUltrasound
Visualization2D / 3D VisualizationMedical Simulation
Cinematic Rendering
Analysis / PlanningComputer-aided Diagnosis
Radiotherapy PlanningQuantification
5
![Page 6: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/6.jpg)
6
MEDICAL IMAGING IS COMPUTATIONAL
70% MEDICAL IMAGING PAPERS
USING DEEP LEARNING
10x COMPUTE REQUIRED
IN 6 YEARS
TFlo
ps
![Page 7: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/7.jpg)
7
“ If there is a chance that computer
scientists may have the best skill
set to fight cancer today, as
moral people, aren’t we obligated
to try?”Prof. David Andrew Patterson, New York Times, Dec 2011
Reference: https://www.nytimes.com/2011/12/06/science/david-patterson-enlist-
computer-scientists-in-cancer-fight.html
![Page 8: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/8.jpg)
8
HEALTHCARE IS CHANGINGDevelopments
Advanced visualisation More sensors Big Data
New Modalities Artificial Intelligence Precision Medicine
Digitalization Genomics AI for Drug Discovery
![Page 9: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/9.jpg)
9
HEALTHCARE IS CHANGINGFrom Interventions...
ENDOSCOPY ROBOTIC SURGERY MICROSURGERY
![Page 10: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/10.jpg)
10
HEALTHCARE IS CHANGING… To Next-generation interventions
![Page 11: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/11.jpg)
11
CHALLENGES AND REQUIREMENTSMedical Imaging is complex
Reliability Data Size Compatibility
Safety Edge Computing / Cloud Workflow Enhancement
Privacy Latency ...
![Page 12: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/12.jpg)
12
CHALLENGE OF MEDICAL IMAGINGMedical Imaging Instruments and Analysis
10-1000 GBit/sec 5-50 TFLOPS
1-12 GPUs per instrument
50-1,800W
High Speed IO
Sensor ProcessingReconstruction AI & Image Processing Visualization
![Page 13: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/13.jpg)
13
NVIDIA CLARA PLATFORM
Clara AGXNext Generation Instruments
Clara SDKUpgrade Instrument Install Base
Clara Developers1000s of Instrument Applications
https://developer.nvidia.com/clara
![Page 14: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/14.jpg)
14
TRADITIONAL INSTRUMENT ARCHITECTURE
High Speed IO
Sensor ProcessingReconstruction AI & Image Processing Visualization
10-1000 GBit/sec 5-50 TFLOPS
1-12 GPUs per instrument
50-1,800W
Custom FPGA for
BUS communication
and computations
GPUs integrated in
instrument and non-
upgradable
Custom, monolithic
software
![Page 15: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/15.jpg)
15
TRADITIONAL INSTRUMENT ARCHITECTURE
High Speed IO
Sensor ProcessingReconstruction AI & Image Processing Visualization
10-1000 GBit/sec 5-50 TFLOPS
1-12 GPUs per instrument
50-1,800W
![Page 16: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/16.jpg)
16
NEXT GENERATIONINTELLIGENT INSTRUMENTS
System on a chip. Volta GPU architecture
16 GB on-board memory
540 CUDA cores with Tensor Cores
30 W power envelope
PCIe interface Gen 4
JETSON AGX XAVIERNVIDIA XAVIER
https://www.nvidia.com/en-us/deep-learning-ai/products/agx-systems
![Page 17: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/17.jpg)
17
CUDA, AI, Graphics
Rich High-Speed Sensor IO
Scalable Compute with Turing GPU
Intelligent with Tensor Cores
NEXT GENERATIONINTELLIGENT INSTRUMENTS
CLARA AGX XAVIERNVIDIA XAVIER + TURING
https://www.nvidia.com/en-us/deep-learning-ai/products/agx-systems
Single Chip Medical Instrument,
Imaging, CV, AI, Visualization
on One Chip
30 TOPS DL Processing
Scale up to 200 TOPS DL
Processing
8 GIGA Rays
200W
![Page 18: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/18.jpg)
18
Discrete GPUsAvailable via retail in
200+ countries
DGX FamilyThe HPC appliance for instant productivity
NVIDIA TESLAServers in every shape and size
CLOUDEverywhere
NVIDIA PLATFORM
![Page 19: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/19.jpg)
19
Compatible with raw and DICOM Data
Supports standalone apps & microservices
Built on NVDocker & Kubernetes for scalability
Accelerated libraries, apps & imaging workflows
SERVICE ORIENTED ARCHITECTURE FOR HEALTHCARE
NVIDIA CLARA SDKSDK for Development & Deployment
https://developer.nvidia.com/clara
CUDA
KUBERNETES - NVDOCKER
NPP TRT RTX NVJPEG
SUPRA ASTRACINEMATIC
RENDERVOLUME
RENDER
WEB
UI
FREE
HAND USSubtleMR RECON
3D
SEG
IMAGE
REG
![Page 20: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/20.jpg)
20
ULTRASOUND IMAGING ON GPU
RAW
data
BMode
images
Transmit
Beamforming
CPU
Receive
Beamforming
GPU
Transmit &
Receive
Ultrasound
Hardware
Envelope
Detection
Log-
Compression
Scan-
Conversion
GPUGPU GPU
BMode
scan
lines
Adaptive Beamforming is computational
● real-time, end-to-end imaging
● CUDA accelerated
● supports any probe geometry
● hardware agnostic
● advanced processing schemes
CUDA CuBLAS
![Page 21: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/21.jpg)
21
ASTRA CT Reconstruction toolbox
● Advanced reconstruction algorithms
● CUDA accelerated
● Supports different scan patterns
● FBP, SIRT, SART, CGSL algorithms
BETTER IMAGES AT A LOWER DOSE
CUDA CuFFT CuBLAS
![Page 22: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/22.jpg)
22
MRI reconstruction algorithm with AI
● 100x faster reconstruction
● 5 x higher accuracy
● Works with any acquisition pattern
● Works with heavily downsampled/
aliased signal
AI IMPROVES IMAGING SPEED AND ACCURACY
TRT-ISTRT CUDA CuDNN
![Page 23: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/23.jpg)
23
BRAIN TUMOR SEGMENTATION
TRT TRT-ISCUDANVJPEG CuDNN
Encoder - Decoder Architecture with
additional VAE branch
● 1st Place
● Training:
○ 1 GPU, V100-32GB,
300 epoch training ~ 2days
○ NVIDIA DGX-1 server,
300 epoch training ~ 6h
● Inference: 0.4 s
![Page 24: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/24.jpg)
24
● high memory requirement!
NVJPEG
DIGITAL PATHOLOGY
CUDATRT TRT-IS
CuDNN
Gland Segmentation
● Very large images:
180 K x 90 K Image
● Labels often apply to whole image
● high memory requirement!
![Page 25: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/25.jpg)
25
NEXT GENERATION VISUALIZATION
RTXCINEMATIC
RENDER
VOLUME
RENDERWebUI
Cinematic rendering
● photorealistic imaging
● offers additional diagnostic insights
● highly computational
● real-time on our platform
![Page 26: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/26.jpg)
26
CLARA DEVELOPMENT PARTNERS
![Page 27: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/27.jpg)
27
CLARA AGX FOR ULTRASOUNDPlatform of choice for next generation products
![Page 28: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/28.jpg)
28
NVIDIA CLARA AND IMFUSIONProject Clara for next generation ultrasound
![Page 29: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/29.jpg)
29
NVIDIA CLARA AND SUBTLE MEDICALProject Clara to improve PET and MRI imaging
*Disclaimer: SubtlePET is pending FDA clearance. SubtleGAD and SubtleMRI is pre-FDA submission. Not available for commercial sale.
![Page 30: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/30.jpg)
30
NVIDIA CLARA PLATFORM
Clara AGXNext Generation Instruments
Clara SDKUpgrade Instrument Install Base
Clara Developers1000s of Instrument Applications
https://developer.nvidia.com/clara
![Page 31: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/31.jpg)
31
NVIDIA AI PLATFORM - HEALTHCARE
NVIDIA GPU Cloud
GPU-Optimized
Containers
Tesla V100
32GB
DGX Systems
V100 32GB
DGX-2
NVIDIA AI Inference
PLASTER and Project
CLARA
CLARA
NVIDIA DLI
Deep Learning Institute
NVIDIA DIGITS
For fast model
prototyping
![Page 32: TACKLING THE CHALLENGES OF NEXT GENERATION … … · TACKLING THE CHALLENGES OF NEXT GENERATION HEALTHCARE Nicola Rieke, Senior Deep Learning Solution Architect Healthcare EMEA Fausto](https://reader035.vdocuments.mx/reader035/viewer/2022070903/5f5d57866669bd663840abf7/html5/thumbnails/32.jpg)
Thank you!