presentation title goes here reza bacchus … · presentation title goes herereza bacchus hewlett...
TRANSCRIPT
![Page 1: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/1.jpg)
PRESENTATION TITLE GOES HERE Reza Bacchus Hewlett Packard
Options Chief Technologist NVDIMM: Super-Charging the Data Center
JANUARY 20, 2015, SAN JOSE, CA
![Page 2: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/2.jpg)
Agenda
Memory Hierarchy Latency trends NVDIMM Types Accelerating Applications The Evolution of NVDIMMs
2
![Page 3: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/3.jpg)
Memory Hierarchy
3
NVM
NAND Flash
Magnetic
DRAM
Registers
Cache
CPU
Longest Latency,Lowest Cost
Shortest Latency,Highest Cost
Load/Store (Application Direct Access)
Block (Application Indirect Access)
MB
GB
TB
Each level is an accelerator for the next lower level
![Page 4: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/4.jpg)
Latency Trends
4
1987 2000 2010 2018
4 ms HDD
0.05 ms SSD
15x faster in 20 years 10 -2
10 -3
10 -4
10 -8
10 -7
10 -6
10 -5
10 -1 60 ms HDD Storage technology trajectory
Memory technology trajectory NVM
0.5 us NVM
Timing is everything – Invest Now!
100k x faster in 5 years
![Page 5: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/5.jpg)
NVDIMM Types
5
DR
AM
NA
ND
Event Triggered
Type 1 (NVDIMM-N)
RA
M
Buf
fer
NAND Async Block
Non-NAND
Access Methods -> Load/Store, Emulated Block Capacity = DRAM (10’s GB) Latency = DRAM (10’s of nanoseconds) Energy source for backup
Supported -> Emulated Block Capacity = NAND (100’s GB – 1’s TB) Latency = NAND (10’s of microseconds)
Supported -> Load/Store, Emulated Block Capacity = NVM (100’s GB – 1’s TB) Latency = NVM (100’s of nanoseconds)
Type 3 (NVDIMM-F)
Type 4
DDR3/DDR4
DDR3/DDR4
DDR4 Sync
![Page 6: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/6.jpg)
6
Customer Value by Workload
In Memory Database: Journaling, reduced recovery time, Ex-large tables
Traditional Database: Log acceleration by write combining and caching
Enterprise Storage: Tiering and caching without an auxiliary power source
Virtualization: Higher VM consolidation with greater memory density
High-Performance Computing: Check point acceleration and/or elimination
Other: Object stores, unstructured data management, Genomics, archiving
Low Cost High Capacity Persistency
NVDIMMs Accelerate a Rainbow of Applications
![Page 7: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/7.jpg)
NVDIMM Acceleration
7
Baseline: MySQL on FusionIO Non-optimized: Baseline + HP NVDIMM + FusionIO + standard MySQL Optimized: Non-optimized + Flash-Aware MySQL
4x Acceleration in Throughput and Latency
![Page 8: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/8.jpg)
The Evolution of NVDIMMs
Origin as accelerator for cache on storage array controllers Battery backed
Type-1 accelerating database and HPC Eliminating bottlenecks in journaling
Type-3 accelerating High Frequency Trading High IOPs
Type-4 accelerating search, data manipulation, initialization MicroController on NVDIMM
And Beyond! FPGA on NVDIMM Programmable on-the-fly Accelerate dynamically changing workloads
8 NVDIMMs Accelerating Applications in the Future
![Page 9: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/9.jpg)
Thank You!
9
![Page 10: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/10.jpg)
RAM DISK Block IO Performance
Eden Kim, CEO Calypso Systems, Inc.
Measured to the SNIA PTS
NVM Summit January 20, 2015
St. Claire Hotel, San Jose CA
![Page 11: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/11.jpg)
1/27/2015 11
RAM Disk Block IO Performance Non Volatile Memory – being advanced by NVMP TWG / NVDIMM SIG
• Memory Mapped Load/Store • NVDIMM Block IO Type N / Type F • Faster than NAND Flash Based SSDs
In Memory Block IO Storage – data on a Linux RAM Disk • RAM Disk performance shows top end of Type N NVDIMM • RAM Disk Block IO performance is sensitive to settings • NVDIMM Block IO may approach RAM Disk performance
Linux RAM Disk is compared to Traditional Classes of NAND Flash SSD
![Page 12: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/12.jpg)
1/27/2015 12
Test Set Up Hardware: PTS Reference Test Platform
• Intel S2600 COE Gen 3 • Dual Xeon 8 core, 3.2Ghz E5 2687W • 32 GB (4GB x 8) DDR3 1600 ECC
Software: • OS – CentOS 6.5 • Linux RAM Disk Block IO Driver 2.6.32-431.11.2.EL6.x86_64 • Test Software - Calypso CTS BE 1.9.216-eL6
Test Methodology: SNIA SSS Performance Test Specification v 1.1.1
![Page 13: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/13.jpg)
1/27/2015 13
Pick up a copy of
this chart
![Page 14: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/14.jpg)
1/27/2015 14
![Page 15: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/15.jpg)
1/27/2015 15
![Page 16: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/16.jpg)
1/27/2015 16
![Page 17: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/17.jpg)
1/27/2015 17
RAM Disk Application Demand Intensity Effects on Performance Measurement
• NAND Flash: Pre Conditioning, Steady State, Write History • RAM Disk: Outstanding IO, CPU cores, Memory Channels
Mapping RAM disks for Outstanding IOs (OIO) by Application Workload • Vary Thread Count and Queue Depth • Measure OIO by Response Time and IOPS (Demand Intensity)
Confidence Level Plot Compare (CLPC)
• Optimal OIO – Performance at different Thread Count x Queue Depth • IOPS • Response Time Quality of Service (QoS) – “5 9s” percentile response times • Response Time Ceiling – Maximum response time allowed by application
![Page 18: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/18.jpg)
1/27/2015 18
Demand Intensity – RAM Disk: OIO x ART & IOPS
IOPS
![Page 19: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/19.jpg)
1/27/2015 19
CLPC ‘QoS’ for a Single RAM Disk – RND 4KIB 100% Reads
T1Q1 = OIO 1 T8Q1 = OIO 8 T16Q4 = OIO 64 Demand Intensity – Total Outstanding IOs
![Page 20: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/20.jpg)
1/27/2015 20
Comparison db OLTP: RAM Disk – PCIe x8 – SAS 12Gb/s
RAM Disk T32Q16 = OIO 512
PCIe 8 T16Q8 = OIO 128
SAS 12Gb/s T16Q2 = OIO 32
![Page 21: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/21.jpg)
1/27/2015 Confidential 21
TAKE AWAYS
RAM Disk Block IO Performance is much higher than NAND Flash
NVDIMM RAM Block IO can approach the level of RAM Disk Block IO
RAM Disk Block IO Performance Depends on Settings
Applications can run much faster with RAM Disk and/or NVDIMM SSD
RAM Disk / NVDIMM SSD offer new Storage Tiering Opportunities
![Page 22: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/22.jpg)
For more information, contact Calypso Systems, Inc.
[email protected] www.calypsotesters.com
22
Flash Memory Summit 2014 Santa
![Page 23: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/23.jpg)
Calypso Systems, Inc. 2255 Martin Ave., ste H Santa Clara, CA 95050 408.982.9955
1/27/2015 23
![Page 24: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/24.jpg)
NVDIMMS in Enterprise Storage Arrays drive performance
Tom McKnight, Vice President of Hardware Platform @ Nimble Storage
![Page 25: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/25.jpg)
Preface
NVDIMMs combined with PCIe NTB’s have enabled Integrated Enterprise Storage Platforms to achieve significant performance improvements ( > 4X Write IOP latency improvement !! )
Background:
– An Integrated Enterprise / Fault Tolerant Storage Platform that implements software based RAID must preserve transient write data in the event of a power failure or hardware component failure. Data loss is NOT acceptable.
– To insure fault tolerance the transient data must be replicated to the peer / standby controller before the write operation can be acknowledged. This inherent mirroring latency will heavily impact the systems maximum write performance ( typically measured in IOPS ).
![Page 26: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/26.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
![Page 27: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/27.jpg)
Next Generation Integrated Enterprise Storage Array – Mirror NVData to / from NVDIMM via PCIe NTB
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVDIMM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVDIMM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
NTB NTB
PCIe
PCIe
PCIe x8
SAS SAS
PCIe
PCIe
SAS SAS
PCIe x8
![Page 28: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/28.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
Write External
Host
Action: External data write operation lands in Active DRAM buffer.
![Page 29: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/29.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
Write External
Host
Action: Copy data to local pcie NVRAM card.
![Page 30: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/30.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
Write External
Host
Action: Send data via ethernet to standby controller.
![Page 31: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/31.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
Write External
Host
Action: Standy controller copy’s data to it’s PCIe NVRAM card.
![Page 32: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/32.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
Write External
Host
Action: Standby sends “Ack” to Active controller via ethernet.
![Page 33: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/33.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
Write External
Host
ACK
Action: Acknowledge the Host Write operation. Write is complete.
![Page 34: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/34.jpg)
Legacy Integrated Enterprise Storage Array – Mirror NVData with Ethernet & PCIe NVRAM Cards
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVRAM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVRAM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
Int NIC
Int NIC
PCIe
PCIe
10Gb
SAS SAS
PCIe
PCIe
SAS SAS
10Gb
Write External
Host
ACK
Action: Write operation Acknowledged. IOP complete.
![Page 35: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/35.jpg)
Next Generation Integrated Enterprise Storage Array – Mirror NVData to / from NVDIMM via PCIe NTB
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVDIMM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVDIMM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
NTB NTB
PCIe
PCIe
PCIe x8
SAS SAS
PCIe
PCIe
SAS SAS
PCIe x8
Write External
Host
Action: External data write operation lands in Active DRAM buffer.
![Page 36: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/36.jpg)
Next Generation Integrated Enterprise Storage Array – Mirror NVData to / from NVDIMM via PCIe NTB
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVDIMM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVDIMM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
NTB NTB
PCIe
PCIe
PCIe x8
SAS SAS
PCIe
PCIe
SAS SAS
PCIe x8
Write External
Host
Action: Memcopy data to NVDIMM from DRAM buffer.
![Page 37: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/37.jpg)
Next Generation Integrated Enterprise Storage Array – Mirror NVData to / from NVDIMM via PCIe NTB
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVDIMM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVDIMM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
NTB NTB
PCIe
PCIe
PCIe x8
SAS SAS
PCIe
PCIe
SAS SAS
PCIe x8
Write External
Host
Action: Active DMA transfer directly to Standby NVDIMM via PCIe NTB
![Page 38: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/38.jpg)
Next Generation Integrated Enterprise Storage Array – Mirror NVData to / from NVDIMM via PCIe NTB
SATA HDD SAS
HDD
Intrps
SATA SSD
Intrps
Passive Backplane
Exp
SAS HBA
Exp NVDIMM
BMC/ IPMI
DRAM
CPU SAS HBA CPU
DRAM
NVDIMM
BMC/ IPMI
External NIC External NIC Ext SAS
Ext SAS
NTB NTB
PCIe
PCIe
PCIe x8
SAS SAS
PCIe
PCIe
SAS SAS
PCIe x8
Write External
Host
ACK
Action: Write operation Acknowledged. IOP complete.
![Page 39: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/39.jpg)
Conclusion
NVDIMMs combined with PCIe NTB’s have enabled Integrated Enterprise Storage Platforms to achieve significant performance improvements ( > 4X Write IOP latency improvement !! )
![Page 40: PRESENTATION TITLE GOES HERE Reza Bacchus … · PRESENTATION TITLE GOES HEREReza Bacchus Hewlett Packard Options Chief Technologist NVDIMM: Super-Charging the Data Center JANUARY](https://reader038.vdocuments.mx/reader038/viewer/2022110300/5b86dd8d7f8b9a1f248b8c4f/html5/thumbnails/40.jpg)
And That’s All Folks…..
Thank You!