www.openfabrics.org ofed interoperability neteffect april 30, 2007 sonoma workshop presentation
TRANSCRIPT
www.openfabrics.org
OFED Interoperability OFED Interoperability
NetEffect
April 30, 2007Sonoma Workshop Presentation
2www.openfabrics.org
Overview
iWARP fulfills OpenFabrics vision of multiple fabrics supporting same RDMA enabled Verbs API
3www.openfabrics.org
iWARP Plugfest
UNH-IOL multi-vendor interoperability plugfest
Participants included: Adapters Vendors – NetEffect & Chelsio Network Test Equipment – Finisar & Anue Test Company – Lamprey Networks Network Vendors – HP ProCurve & Fulcrum Microsystems
10 Gb iWARP Ethernet - plugged and played Across multiple adapter and switch vendors
4www.openfabrics.org
NetEffect Roadmap
1Q 2Q 1Q 2Q3Q 4Q 3Q
NE020 ECAEnhanced performance for ECA
2006 2007
Ports: 1 @ 10 GbE (CX4/XAUI) or 1 @ 1 GbE (GMII)
Host I/F: PCI-X (64/133)
Services: clustering, networking
NE010x ECAFull iWARP implementation
Ports: 2 @ 10 GbE (CX4/XAUI) or 4 @ 1 GbE (SGMII)
Host I/F: PCIe x8
Services: clustering, networking, block & file storage
Ports: 1 @ 10 GbE (CX4/XAUI) or
1 @ 1 GbE (GMII)
Host I/F: PCIe (x8)
Services: clustering, networking
NE010e ECAFull iWARP implementation
Double performance, half latency, low power, low cost
5www.openfabrics.org
Latency in Multi-Processor/Multi-CoreSystems
Number of Connections Managed by an Adapter
• P2(S-1)
• P => # of Processes per Server
• S => # of Servers
Number of Servers
Processors per server
Cores per processor
Conections per adapter
4 2 2 48 8 2 1 28 8 2 2 112 8 4 2 448 8 4 4 1,792
16 2 4 960 32 2 4 1,984 32 4 4 7,936 64 2 4 4,032
128 2 4 8,128 256 2 4 16,320 512 2 4 32,704
1024 2 2 16,368 1024 2 4 65,472 1024 4 4 261,888
Cummulative Half Round Trip Time for Multiple Connections
0
5
10
15
20
25
30
35
40
45
50
1 2 4 8 16 32 64
Number of Connections
us
NE010 16B Write
NE020 16B Write
6www.openfabrics.org
NE010/020 Ethernet Throughput
1 Connection Uni-directional Write Bandwidth
0
200
400
600
800
1000
1200
1400
128 256 512 1024 2048 4096 8192
Message Size
MB
/s
NE010 NE020
7www.openfabrics.org
Industry Leading Bandwidth
8 Connection Uni-directional Write Bandwidth
0
200
400
600
800
1000
1200
1400
1600
128 256 512 1024 2048 4096 8192
Message Size
MB
/s
NE010
NE020
NE020 Dual Port (est)
8www.openfabrics.org
NetEffect’s OFED Status
Participated in the OFA Interoperability Plugfest Successful plugfest with NetEffect and Chelsio
NetEffect’s OFED 1.2 Compatible Drivers Development -- Complete QA -- In Progress Customer Deployment -- In Progress Source Code Posting -- June 2007
9www.openfabrics.org
10 Gb iWARP Ethernet Infrastructure
Switches – Tested with 10 GbE iWARP Cisco Force10 Networks Foundry Networks Fujitsu Fulcrum Microsystems HP ProCurve Quadrics
10www.openfabrics.org
10 Gb iWARP Ethernet Infrastructure
Powered CX4 Support in place for powered CX4 – up to 100 m
MPI Support OpenMPI needs to add iWARP support
Open Sourced RDMA Enabled Sockets Broad application deployment means Sockets
11www.openfabrics.org
Summary
OFED 1.2 – NetEffect deploying drivers to customers
10 Gb iWARP Ethernet is Ethernet Adapters and switches just Plug and Play
The 10 GbE infrastructure – adapter vendors, switches, and cables are ready
12www.openfabrics.org
Additional Resources
Web Resources: NetEffect, Inc.: www.neteffect.com UNH iWARP Consortium:
www.iol.unh.edu/consortiums/iwarp
[email protected] OpenFabrics Alliance: www.openfabrics.org
Specs: RDMA Consortium: www.rdmaconsortium.org