ip over p2p: enabling self-configuring virtual ip networks for grid computing
DESCRIPTION
IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing. Arijit Ganguly , Abhishek Agrawal, P. Oscar Boykin, Renato Figueiredo. University of Florida IPDPS 2006. What is the talk about?. Convergence of Grid and P2P technologies 1 Context of network virtualization. - PowerPoint PPT PresentationTRANSCRIPT
Advanced Computing and Information Systems laboratory
IP over P2P: Enabling Self-configuring Virtual IP Networks
forGrid Computing
Arijit Ganguly, Abhishek Agrawal, P. Oscar Boykin, Renato Figueiredo
University of FloridaIPDPS 2006
Advanced Computing and Information Systems laboratory 2
What is the talk about?
Convergence of Grid and P2P technologies1
Context of network virtualization
1 On death, taxes, and the convergence of peer-to-peer andGrid Computing. Foster et al. IPTPS 2003
Advanced Computing and Information Systems laboratory 3
Outline
Virtual networking and Grid Computing Related work Our approach – IP over P2P Experimental evaluation Conclusion and Future work
Advanced Computing and Information Systems laboratory 4
Internet access
Internet
Background - Virtual Private Networks
Files, emails,compute cycles
printers
VPN gateway
Rhodes, Greece
User insideACIS privatenetwork
Install Cisco VPN client Connect to VPN gateway
router
NAT/Firewall
Tunnel
Advanced Computing and Information Systems laboratory 5
Grid scenario
Internetrouter
routerrouter
router
NAT
FirewallNAT/Firewall
Purdue
Florida Northwestern
LSU
Grid user
SSH only
Internetrouter
router
router
router
Purdue
Florida Northwestern
LSU
Grid user
SSH only
Issues:
Network Address Translation
Idiosyncrasies of heterogeneous access
Traffic generated by untrusted code from Grid users – DoS attacks, viruses
NAT
FirewallNAT/Firewall
Advanced Computing and Information Systems laboratory 6
Virtual network of Grid resources
Internetrouter
routerrouter
router
NAT
FirewallNAT/Firewall
Purdue
Florida Northwestern
LSU
Grid user
SSH only
Virtual Network
Advanced Computing and Information Systems laboratory 7
Virtual networking for Grids
VNET (Northwestern University)• Bridge a remote Virtual Machine (VM) to a
client network
VIOLIN (Purdue University) • Virtualized network components
• Isolated from real physical network
ViNe (University of Florida)• Virtual IP network of Grid resources
• To be presented on Friday (Session 32)Common technology: Overlay tunnelingWhat differentiates us: P2P routing
Advanced Computing and Information Systems laboratory 8
Motivations for P2P
Scalability and Self-configurability
• Manual effort required to add a new node constant
• Independent of size of the network Resiliency
• Robust P2P routing Accessibility
• Ability to traverse NAT
• Hole punching1
1 RFC 3489 - STUN - Simple traversal of UserDatagram Protocol through Network Address Translators
Advanced Computing and Information Systems laboratory 9
Our approach – IP- over-P2P (IPOP)
Isolation• Virtual address space decoupled from Internet
address space Self-configurability
• Automatic setup of routes and topologies• Decentralized
• No global state
• No central points of failure
• VM mobility
Decentralized NAT traversal• No changes to NAT configuration
• No globally deployed STUN servers
#affiliationcondor_wow#transportudp#port15000#number of remote TAs2#list of TAsbrunet.udp://planetlab-01.bu.edu:15000brunet.udp://planetlab1.cs.purdue.edu:15000#virtual interfacetap0#virtual IP address of tap0172.16.1.5#MAC address of tap0CB:DF:E7:20:60:35
Advanced Computing and Information Systems laboratory 10
IPOP - Architecture Overview
IP tunneling over P2P overlay networks• UDP, TCP
Virtual IP packet capture and injection through tap interface
Builds upon Brunet P2P library
Advanced Computing and Information Systems laboratory 11
IPOP – Packet capture and routing
applicationapplication
NodeY
IPOP
eth0
IPOP
NodeX
eth0
Socket s = new Socket(“172.16.0.10:3000”);s.connect();
ServerSocket serv = new ServerSocket(“172.16.0.10,3000);serv.accept()
X
Y
Extract IP from Ethernet Encapsulate IP inside P2P
Extract IP from P2P Encapsulate in Ethernet
tap0(172.16.0.10)
tap0
(172.16.0.9)
Advanced Computing and Information Systems laboratory 12
XY
Brunet P2P architecture Ring-structured overlay network topology
• Nodes ordered on 160-bit addresses Overlay link:
• Near: neighbor connections
• Far: connections across ring
Near connection
Far connection
Multi-hop pathbetween X and Y
U
V
Advanced Computing and Information Systems laboratory 13
Brunet P2P architecture (2)
Routing
• Constant number of connections
•O(log2(n)) overlay hops
• O(log(n)) connections
•O(log(n)) overlay hops
• n connections •1-hop
C# library, supports:
• Connection setup and maintenance
• NAT traversal
Advanced Computing and Information Systems laboratory 14
Network Address Translation (NAT)
Host A NATPublic host
128.227.56.83
Sends packet:Src = 10.5.144.69:5000Dst = 216.239.37.99:80
Sends packet:Src = 216.239.37.99:80Dst = 128.227.56.83:5126
216.239.37.9910.5.144.69
Translated:Src = 128.227.56.83:5126Dst = 216.239.37.99:80
10.5.144.69:5000 128.227.56.83:5126Outgoing packet to 128.227.56.83:5126
NAT Tables
Sends packet:Src = 216.239.37.99:80Dst = 10.5.144.69:5000
Applications on NATed hosts can learntheir NAT assigned IP:port
Advanced Computing and Information Systems laboratory 15
NAT traversal – Behind NATs
Src = R:ADst = N:Y
Src = N:YDst = M:X
R:A M:X N:Y S:B
Outgoing packet to M:X(hole punched)
Src = S:BDst = M:X
Src = M:XDst = N:Y
Outgoing packet to N:Y(hole punched)
Src = M:XDst = S:B
Exchange each other’s NAT assigned IP:port
M:X N:Y
NAT N128.139.156.90
NAT M128.227.56.83
S:BR:A Allow
Dropped
Advanced Computing and Information Systems laboratory 16
Experiments
Latency overhead and throughput of single overlay link• LAN and WAN
MPI application over IPOP• Light Scattering Spectroscopy (LSS)
Multi-hop routing experiments• More than 100 node network on PlanetLab
Advanced Computing and Information Systems laboratory 17
Latency (single IPOP link)
Two IPOP nodes separated by single overlay hopACIS – ACIS for LANACIS – VIMS for WAN
Ping times between two nodes
6ms-11ms overhead per packet for ICMP ping Relative overhead is smaller in Wide-Area
ACIS: Florida VIMS: Virginia
Advanced Computing and Information Systems laboratory 18
Latency overhead - analysis
Reasons for high LAN overhead:• Double traversal of kernel stack
• C# runtime
• User-level overlay – context switches
• Other user-level overlays (VNET, Violin) report few-ms latency overheads
Advanced Computing and Information Systems laboratory 19
Throughput (single IPOP link)
Two IPOP nodes separated by single overlay hopACIS – ACIS for LANACIS – VIMS for WAN
“ttcp” file transfer sizes (13.09 MB, 92.97 MB)
1.9MB/s LAN bandwidth (20% of physical 9.4 MB/s)
1.2MB/s WAN bandwidth (80% of physical 1.5 MB/s)
ACIS: Florida VIMS: Virginia
Advanced Computing and Information Systems laboratory 20
Real Application – Parallel LSS MPI + NFS + SSH11
1 Support for Data-Intensive, Variable-Granularity Grid Applications viaDistributed File System Virtualization - A Case Study of Light ScatteringSpectroscopy. Figueiredo et al. CLADE 2004
Internet
router
router
router
VIMS
LSU
Firewall
NAT
NAT/Firewall
NAT/Firewall
Florida
Advanced Computing and Information Systems laboratory 21
Real Application – Parallel LSS
With IPOP, could run “parallel LSS” unmodified No changes to NAT/Firewall rules
Achieve parallel speedup
Advanced Computing and Information Systems laboratory 22
PlanetLab experiments
Demonstrate ease of adding a new node and achieving IP routability in WAN environment
118 node TCP-based overlay on PlanetLab
Connect two IPOP nodes in ACIS lab to PlanetLab network
Measure ping times between nodes• Average: 1617 ms; Std Dev: 2098 ms
Advanced Computing and Information Systems laboratory 23
Planetlab experiments (analysis)
Issues:• High-load (>10) on nodes in routing path
• Geographically unaware p2p routing • Packets between machines in Florida routed
through machines in California
Improvements:• Direct overlay link setup between
communicating nodes• No concerns of load and inefficient p2p routing
Advanced Computing and Information Systems laboratory 24
Conclusion
Our contribution:
• Novel virtual IP network based on P2P overlay
•Scalable and Self-configurable
•Resilient
•NAT traversal
• Experiments showed feasibility of using P2P approach for virtual networking
Advanced Computing and Information Systems laboratory 25
Future work
Overhead of TCP or UDP• Raw sockets or Ethernet-based
overlay edges
Kernel level extensions
• Tap module with encapsulation and bridging
• Reduce context switches
Advanced Computing and Information Systems laboratory 26
Related Work
Virtual Networking• VIOLIN
• VNET
• ViNe (Session 32) Internet Indirection Infrastructure (i3)
• Support for mobility, multicast, anycast
• Decouples packet sending from receiving
• Based on Chord p2p protocol IPv6 tunneling
• IPv6 over UDP (Teredo protocol)
• IPv6 over P2P (P6P)
Advanced Computing and Information Systems laboratory 27
Acknowledgments
In-VIGO team at UFL National Science Foundation
• Middleware Initiative (http://www.nsf-middleware.org)
• Research Resources Program
• nCn center Resources
• Peter Dinda (Northwestern University)
• SURA/SCOOP
IBM Shared University Research
Questions?
Advanced Computing and Information Systems laboratory 28
Thank You