an introduction to the group and its projects tony mcgregor [email protected]
DESCRIPTION
An introduction to the group and its projects Tony McGregor [email protected]. WAND Projects. CRCNet Active Measurement IP Measurement protocol Passive Measurement Simulation Integrated measurement and simulation Emulation Network Physical layer switch IPv6 - PowerPoint PPT PresentationTRANSCRIPT
![Page 2: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/2.jpg)
WANDProjects
• CRCNet• Active Measurement• IP Measurement protocol• Passive Measurement• Simulation• Integrated measurement and simulation• Emulation Network• Physical layer switch• IPv6
• topology, mobile stacks, fast handover
• NZNOG ‘04
![Page 3: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/3.jpg)
CRCNetIntroduction
• Project started almost 2 years ago
• Rural communities were frustrated by low speed unreliable Internet access
• Develop a new platform suitable to deploy future generation (>>10Mbps) wireless networks in rural and remote areas
• based around a mesh architecture
• Funded by Foundation for Research Science and Technology
![Page 4: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/4.jpg)
CRCNetArchitecture
![Page 5: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/5.jpg)
CRCNetStage 1 – Build Trial Network
Range of equipment• 2.4Ghz (802.11b and g)
• Orinoco radio cards and APs• Advantech and Soekris Biscuit PC• Linksys wireless Ethernet bridges
• 5.8 GHz• Proxim Quick bridge20• Trango
![Page 6: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/6.jpg)
Current Topology
![Page 7: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/7.jpg)
CRCNetPirongia Site
![Page 8: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/8.jpg)
CRCNetHSK Site
![Page 9: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/9.jpg)
CRCNetMFR Site
![Page 10: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/10.jpg)
CRCNetWeb Casting
• Between Hamilton Zoo and the Fieldays site
• 6 wireless links
![Page 11: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/11.jpg)
CRCNetStage Two – Platform Design
• Routing protocols for mesh networks
• Link Layer Design
• Design of a new node
![Page 12: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/12.jpg)
• NLANR’s active measurement project• Approx 140 monitors, mostly in the USA. • International deployments
• a single AMP monitor in about a dozen other countries• some national AMPs (Australia, Taiwan, Russia soon)
• Measure• RTT• loss• topology• throughput (on demand)
• NSF funded
AMPIntroduction
![Page 13: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/13.jpg)
AMPUSA Sites
![Page 14: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/14.jpg)
AMPArchitecture
(amp)
(volt)
ActiveMonitor
Othertarget
ActiveMonitor
ActiveMonitorAnalysis
machine
Analysismachine
Webbrowser
Test Results
Test Results
test traffic
Cichlid
![Page 15: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/15.jpg)
AMPDemo
![Page 16: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/16.jpg)
AMPDemo
![Page 17: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/17.jpg)
AMPDemo
![Page 18: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/18.jpg)
AMPDemo
![Page 19: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/19.jpg)
AMPDemo
![Page 20: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/20.jpg)
AMPDemo
![Page 21: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/21.jpg)
AMPDemo
![Page 22: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/22.jpg)
AMPDemo
![Page 23: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/23.jpg)
• Design• dedicated machines• 1ms accuracy• No GPS/CDMA• 1 sample per minute
• Benefits• easy and cheap => wide deployment• full mesh• manageable
• Limits• no one-way delays (bidirectional traceroute, IPMP OWD)• very short events missed
AMPCost vs Function
![Page 24: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/24.jpg)
AMPManagement
ALL
AMP
amp-palomar
HPWREN
mySQL databse
amp-kiwi
system manager
monitors
Volt
AMP
![Page 25: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/25.jpg)
• Beginnings of a New Zealand AMP mesh• Waikato• Auckland• APE• Ihug (offer)
• Can fund more monitors and maintenance• need hosts (here?)• hosts provide space, power and network
AMPNew Zealand
![Page 26: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/26.jpg)
• Current active measurement protocols have weaknesses
• multiple packets (overhead, phantom routes)• measurement of components (reverse path, CPU)
• IPMP combines path and delay measurement in a single packet exchange with low router overhead
IPMPIntroduction
![Page 27: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/27.jpg)
IPMPArchitecture
IPMP
header header header header
Target Host
IPMP
IPMP
IPMP
MeasurementHost
IPMP Enabledrouter
Peering point
High perfomance ISP
Non-IPMP Router
Packet that leavesmeasurement host(one path record)
Path record addedat first IPMP
enabled router
no change
Packet as it leavesthe kernel on the
target host
Progression of packet through the network
![Page 28: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/28.jpg)
IPMPProtocol (IPv4)
![Page 29: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/29.jpg)
• Router can use any timestamp it has available
• Resolving to real-time is not done in the packet forwarding critical path
• Uses a separate packet exchange (information request/reply)
• supplies real-time reference points • other router information
IPMPTimestamps
![Page 30: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/30.jpg)
IPMPInformation Reply
0 8 6 4 10 0 1 2 3
Version Checksum
00000000 Type
00000000
00000000 Precision
Length Performance Data Pointer
Forwarding IP Address
Accuracy
IPMP Processing Overhead
(optional) Path Records
(optional) performance data
![Page 31: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/31.jpg)
• POM made better• combined path and latency, no phantom routes etc• lower overhead• kernel based timestamps• explicit clock information• forward and reverse traceroute• DoS resistant• associates router interfaces
• One way delay from NTP• Bandwidth Estimation• Deployment (AMP, CRCnet)
IPMPUses
![Page 32: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/32.jpg)
• To support simulation work the group developed passive header capture hardware.
• Known as Dag cards• Speeds from Ethernet to OC48 (2.5Gbps WAN)• Spun off a startup
• Endace (www.endace.com)• now OC192• better support
Passive MeasurementOverview
![Page 33: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/33.jpg)
• Capture IP headers or full packet• Add accurate timestamp
• GPS or CDMA for external time
• Originally header trace focused• real-time flow based• security applications
• Optical splitter, electrical card relay or electrical tap
Passive MeasurementDag Overview
![Page 34: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/34.jpg)
Passive MeasurementDag 3 block diagram
![Page 35: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/35.jpg)
PassiveDag 4.2
![Page 36: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/36.jpg)
PassiveWITS Traffic Archive
• Long traces from Auckland University and NZIX
•traces up to 45 days (3.2 billion packets)
•IP headers
•GPS timestamps
• Some analysis online
• Can fetch traces from NLANR
• Summary CD
![Page 37: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/37.jpg)
• ATM-TN based• University of Calgary/Waikato partnership• parallel• BSDLite network stack (sort of)• high bandwidth delay, mixed real-time/TCP
• NS-2 with FreeBSD stack• new work• network cradle
• 802.11b link layer
SimulationIntroduction
![Page 38: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/38.jpg)
SimulationExample –TCP splitting
Web Clients
US ProxyNZ Internet
NZ Proxy
US Internet
US Servers
international channel
![Page 39: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/39.jpg)
SimulationThe simulation process
SimulatePre-process Post-process
HTTPLog Logfile
generator
HostList
Hostfilegenerator
tracePacket
Graphs
livehosts
DigestedLogfile
Host Information
query onhost
buffer andMSS info
Internet
SimulationParameters
SimulatorHTTP PageLatencies
Line and Buffer use
SummariseandPlot
![Page 40: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/40.jpg)
• Bandwidth 34.369Mbps (E3)• Delay 60ms• TCP buffer size
• proxy 32767 bytes• servers as measured
• MSS as measured• US delay as measured• NZ delay not simulated
SimulationExample –TCP spliting, Network parameters
![Page 41: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/41.jpg)
SimulationTCP Splitting – a single connection
![Page 42: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/42.jpg)
SimulationIntroduction
![Page 43: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/43.jpg)
SimulationIntroduction
![Page 44: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/44.jpg)
• Simulation is only accessible to very large network operators and users
• AIM: Make simulation available to medium sized enterprises
• Integrate measurement and simulation • FRST funded
MessimIntroduction
![Page 45: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/45.jpg)
MessimIntroduction
Monitored Network
topology discovery
measurement
simulator
validation
and analysis
ModelWorkload Network
Model
workload query resultsalerts and
![Page 46: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/46.jpg)
• Topology discovery• automated discovery of link layer devices
• Traffic Models• further development of specific models (e.g. peer to
peer)• generic
• Extraction of simulation parameters from traces• Extended range of network stack models• Continuous validation• Hardware flows analysis
MessimProjects
![Page 47: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/47.jpg)
Network stack
FreeBSD 5 kernel
Mozilla / Bash / KDE / etc.
Ker
nel s
pace
Use
r sp
ace
MessimNetwork Stack Cradle
![Page 48: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/48.jpg)
MessimNetwork Stack Cradle
Network stackUse
r sp
ace
Cradle (~200 functions)
Network
Simulator
![Page 49: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/49.jpg)
• 2d Empirical distribution
MessimGeneric models
![Page 50: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/50.jpg)
MessimGeneric models
![Page 51: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/51.jpg)
MessimGeneric models
![Page 52: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/52.jpg)
• Use WEKA machine learning algorithms to• cluster• classify
• For each cluster• simplify the rule set into terms for a network
manager• produce an empirical distribution for each
• Allow simulations with different proportions of traffic
MessimGeneric models
![Page 53: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/53.jpg)
• There is a need for a structured environment in which to build networks in the laboratory
• validation of simulations• testing on network equipment
• The emulation network is two racks of PCs that can be configured as
• routers• end hosts• delay
• Plus configuration and measurement support
Emulation NetworkIntroduction
![Page 54: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/54.jpg)
Emulation NetworkOverview
SWIxia
PCPCPCPCPCPCPCPCPCPCRR
PC
Patch
Dag
Configure
Panel
H
H
H
RR
R
RRdelay
Configure
(DAG)Monitor
![Page 55: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/55.jpg)
• Usage• Is a public facility• Has been used to debug AT switch Used network trace capture and replay then Ixia
script• Ihug traffic shaper• Bandwidth estimator
• Development• Physical layer switch
Emulation NetworkUsage and development
![Page 56: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/56.jpg)
• 64 Port FastEthernet Crossbar switch• Fast / Flexible Reconfiguration• Link Monitoring• Latency Control
• Bandwidth limiting• Self Documenting Network Topology• Centralised Control
Crossbar SwitchIntroduction
![Page 57: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/57.jpg)
Crossbar SwitchBlock Diagram – Overview
Mainboard12.8Gb/s
Uplink
DaughterBoard
DaughterBoard
DaughterBoard
DaughterBoard3.2Gb/s
Mainboard• Crossbar• Latency
• Bandwidth Limiting
Daughterboards• Ethernet Interface
• Time Division MUX
![Page 58: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/58.jpg)
Crossbar SwitchBlock Diagram –Mother board
CPU
FPGA12.8Gb/s
UplinkDaughterBoard
DaughterBoard
DaughterBoard
DaughterBoard
DDR SDRAM(8GB max).
SDRAM
FLASH
![Page 59: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/59.jpg)
Crossbar SwitchBlock Diagram – Daughter board
PHY
FPGA
PHY
3.2Gb/s
Eth
ern
et
Port
sEth
ern
et
Port
s
Uplink to Motherboard
![Page 60: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/60.jpg)
Daughterboard Layout
Crossbar SwitchDaughter board Layout
![Page 61: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/61.jpg)
• Skitter for IPv6• Hope to capture the growth of the IPv6 internet
SkamperOverview
![Page 62: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/62.jpg)
• Small devices• One of the motivators for IPv6 is to provide addresses and
other support for small devices• a.k.a. cell phones• implementing a stack for embedded devices• little ram• moderate CPU speeds• prototype hardware development
• Fast handover between cells• normally may exceed 2s• reduce to around 150ms, l2 triggers, L3 preparation for
handover and timing improvements in protocols
IPv6 StacksOverview
![Page 63: An introduction to the group and its projects Tony McGregor tonym@wand.nz](https://reader036.vdocuments.mx/reader036/viewer/2022062314/5681493d550346895db688a2/html5/thumbnails/63.jpg)
• The New Zealand Network Operators Group has an annual conference
• The next one will be hosted by WAND• Jan 29-30 2004, at Waikato• Discounted registration (free?) for students• Hope to have a number of partial travel grants
for students• Could hold a parallel Academic Networking
Conference• need feedback
NZNOGConference