PlanetLabオーバーレイネットワークプラットフォーム
情報通信研究機構
新世代ネットワーク研究センター
中内清秀,中尾彰宏
NWGN推進フォーラム テストベッドNW推進WG #42009年6月29日
光パス
管理仮想ルータドメインA
管理仮想ルータドメインB
管理仮想ルータドメインC
管理仮想ルータドメインD
仮想化ストレージ
オーバレイネットワークA
P2P/オーバレイ技術
オーバレイネットワークB
仮想ネットワーク実験環境A
管理仮想化ルータ・ネットワーク
WDM/光SW WDM/光SW WDM/光SW WDM/光SW
DCNドメイン/DCN-Interドメインコントローラ
DCN:Dynamic Circuit Network
NW制御技術
計測実行/データ収集
サービス/トポロジー検索
perfSONAR
計測技術
コンソール(NW可視化、コントロール)
仮想ネットワーク実験環境B仮想ネットワーク技術
光スイッチネットワーク
JGN2plusサービスプラットフォーム
K. Nakauchi, NICT 22009/6/29
3
PlanetLab: 分散アプリケーションプラットフォーム(Public PlanetLab)
The largest and most popular overlay network test-bed Operated by Princeton Univ. and PlanetLab Consortium Currently consists of 900+ nodes at 450+ sites 800+ Projects/ 1000+ Researchers
180+ high-level academic publications enabled
2009/6/29 K. Nakauchi, NICT
PlanetLab Model: VM and Slice VM: Each node can serve multiple VMs (Virtual Machines)
Linux Vserver Slice: A set of VMs is allocated to a user (experimenter)
A user can build his own experimental environment on socket API
2009/6/29 K. Nakauchi, NICT 4
PlanetLab nodes w/ wired connection
PlanetLab nodes w/ wireless connection
Slice
VM
eth0
eth0
ath0
Log in via ssh
Slice
VM VMManagement Server
Request
2009/6/29 5K. Nakauchi, NICT
PlanetLab ApplicationsCoMon: monitoring slice-level statistics
2008/05/16 K.NAKAUCHI, NICT 5
http://summer.cs.princeton.edu/status/index_slice.html
Over 400 nodes
PlanetLab-related Activities in NICT
2009/6/29 K. Nakauchi, NICT 6
Sendai
Tsukuba
Tokyo
NaganoKanazawa
Nagoya
Osaka Keihanna
Kochi
Okayama
Kitakyushu
Fukuoka
Sapporo
USAChicago
Kyutech
Hiroshima U.
Kochi-techOsaka U. NICT Koganei
NICT Otemachi
U. Tokyo
Tohoku U.
Sapporo Medical U.
NII
• Operate public PlanetLab• Federate with PLC/PLE
• Nation-wide private PlanetLab• JGN2plus’s official service• Boost PlanetLab community
(1) PlanetLab Japan (Public PL) (2) J-Lab (Private PL)
(3) CoreLab(Research ) • Network virtualization research
• Prototype of virtual routers• Will be open for R&D community
J-Lab: Private PlanetLab for JGN2plus Trial Service
2009/6/29 K. Nakauchi, NICT 7
…
- Official trial service on JGN2plus- 1Gbps throughput for each peering- IP: 202.180.37.64/27 (Global)- 12 sites, 24 nodes
…
- Closed for NICT internal researches- Spans several Ases- IP: Depends on the site- 12 sites, 12 nodes
J-Lab Research J-Lab Trial
…
Operated by JGN2plus and NVLabOperated by NVLab
PLC
Goal: Boost PlanetLab community in Japan Open for roughly 100 user projects on JGN2plus Sandbox for new functions and applications Currently vanilla PlanetLab (MyPLC4.2 on Fedora8)
J-Lab Trial: Overview
8
Kyutech
Sendai
Tsukuba
Tokyo
NaganoKanazawa
Nagoya
Osaka Keihanna
Kochi
Okayama
KitakyushuFukuoka
Sapporo
Hiroshima U.
Kurashiki U. of Science and Arts
Osaka U.
NICT Koganei
NICT Otemachi
NICT Hakusan
Tohoku U.
Sapporo Medical U.
U. Tokyo
JAIST
Nagoya U.
https://www-jlab.planet-lab.jp/
2009/6/29 K. Nakauchi, NICT
Sendai
TsukubaTok
yo
Nagano
Kanazawa
Nagoya
Osaka
Keihanna
Kochi
Okayam
aKitakyushuFuk
uoka
Sapporo
Overlay HDV Distribution on J-Lab
2009/6/29 K. Nakauchi, NICT 9
IEEE1394
Sender(Win)
IEEE1394
Decoder
HD/SD Monitor
Receiver (Win)
Splitter(running on J-Lab node)
IP
J-Lab Trial (Private PlanetLab)
HDV/DV video distribution (~30Mbps) over JGN2plus Overlay multicast: split a video stream with reasonable CPU load Windows media, FEC, UDP/TCP, and CLI/GUI are also supported Centralized topology management with web interface
Topology managementServer
JGN2plusトライアルサービスのメリット
メリット:
Princeton大学との利用契約締結が不要( Public PlanetLabの場合,民間企業は有料)
JGN2plusのコア網に直収されるため,広帯域アプリケーションで利用可能
デメリット:
単一L2セグメント内への展開なので,「広域」「超分散」「多様性(heterogeneity)」などを目的とした実験には適さない
→ 本サービスの試用後にPublic PlanetLabに移行を促進
2009/6/29 K. Nakauchi, NICT 10
CoreLab: Highly Flexible Overlay Platform Achieves flexibility and code-reusability
Arbitrary kernel/network stacks/resources Catch up with the latest technology and minimize engineering effort
Sliver VEE: Hosted Virtual Machine Monitor (KVM) VM Disk Image Transfer: Embedded BitTorrent client Network Configuration: IP & Ports are managed
2009/6/29 K. Nakauchi, NICT 11
PlanetLab CoreLabSliver Resource Container Hosted VMMKernel Shared SeparatedGuest OS Various Linux Distros Any OSesIP & Port Shared Shared (managed)Privileged System Calls Shared Isolated
Aki Nakao, et al, “CoreLab: An Emerging Network Test-bed Employing Hosted Virtual Machine Monitor”, ROADS’08
CoreLab : In Action…
2009/6/29 12K. Nakauchi, NICT
CoreLab Network Configuration
2009/6/29 K. Nakauchi, NICT 13
PlanetLab Model CoreLab Model
CoreLab/J-Lab Deployment
J-Lab 12sites, 36 nodes H/W: HP DL320G4 トライアルサービス中
CoreLab 12 sites, 12 nodes Multi-homing
JGN2plus, SINET
H/W Spec
2009/6/29 K. Nakauchi, NICT 14
HP DL 580 (4U)Intel Xeon 16-core (quad 4-core)128GB (Max 256GB) memory300GB RAID5(accommodate up to 254 slices)
Federation Overview Split PlanetLab
Several regional PlanetLabswith original policy
Interconnection Share node resources among
PlanetLabs
2009/6/29 K. Nakauchi, NICT 15
PLC
PLC
PLC
PlanetLab(Princeton U)
PlanetLab-EU
PlanetLab-JP
VMM
NodeMgr VM1 VM2 VMn
VMM
NodeMgr VM1 VM2 VMn
Trade
Internet
Multi-party Federation
16
MyPLC1 MyPLC2
Admin (MyPLC1)
MyPLC2MyPLC3
(1) AddPeer(MyPLC2, cacert, gpg)-> create a local cache of the master DB
(2) RefreshPeer(MyPLC2)-> sync the local cache and the master DB
MyPLC1MyPLC3
XML-RPC/HTTPS
2009/6/29 K. Nakauchi, NICT
Create Sync
MyPLC3
DB ServerMyPLC1MyPLC2
Sync