Transcript
  • Hans-Werner BraunRonn RitkeNLANR/MNA(UCSD/SDSC)http://moat.nlanr.net/

    Funded by the National Science Foundation/CISE/ANIR

    NLANR/MNA Measurement and Network Analysis

  • Goals and objectivesCreation of the Network Analysis Infrastructure (NAI) to support measurements and network analysisheader traces, performance, statisticsNetwork measurement and analysis research activitiesTool development for analysis and visualizationsAll data, analyses, graphs, visualizations, and tools are made public available for use by all researchers.

  • Public Interface Internet Trace User Community Attendance and presentation at meetings Host PAM2003 Workshop. Result reporting for the high performance environmentWeb interfacenewsletters (Networking Analysis Times, Packets)published papers

  • NLANR/MNA Publications2002 - 52001 - 122000 - 81999 7 (28/32 were peer reviewed)PAM2002 3/18 papers, 1/3 posters http://moat.nlanr.net/Papers

  • Internet Trace User Community Led by Joerg Micheel

    We are seeking constructive discussion on monitor placement strategies, trace duration, trace variety, etc.

    For example, a number of researchers have requested longer duration traces. As a result, a set of passive traces from Auckland that consists of single and multiple day duration traces were made available. Researchers have published at least 7 papers based on those traces.

    Which PMA trace summaries are most helpful in allowing other researchers to choose from available trace data sets?

  • Completely noninvasive, no impact on forwarding paths.

    Aggregated traffic signature at a measurement point.

    OC3/OC12, ATM and POS, OC48 (develop OC192 capability).

    Between June 2000 and Jan 2001 (7 months) 6,000 PMA trace files were downloaded (31 per day) from at least 193 different sites.

    Trace analysis summaries include (total packets, Bytes, top port numbers by volume, top 100 throughput connections, etc.)

    (Passive traffic collection and analysis at optical carrier speeds)Passive Measurement and Analysis (PMA) project

  • NCARU. Colorado, BoulderAIX/MAE-WestNASA-AmesArgonne Nat. LabU. of MichiganMichigan State U.OhioState U.STARTAP/APANRice U.Baylor College of MedicineU. of HoustonTexas A&M U.Old Dominion U.MCNCNorth Carolina State U.U. of North CarolinaDuke U.U. of FloridaMiami U.Florida State U.26 September 2000SDSC, U. California, San DiegoPassive measurement deployment statusFDDIOC3 ATMOC3 PoSOC12 ATMOC12 PoSNCSAFIX-WestTel Aviv U.(I-2)Colorado StateFront Range GigaPoPTexas GigaPoPU. MemphisIndiana StateColumbia U.

  • rank Mbps Throughput site applic. triplet Bytes duration ==== =============== ======= =============== 1 50.763475 ANL 6:12061:6001 8690339 1.369542 2 49.993387 ANL 6:6001:12062 8690338 1.390638 3 46.130484 TXS 17:1033:9875 377307 0.065433 4 40.374478 ANL 6:6001:12127 8690339 1.721947 5 40.351682 ANL 6:6001:12080 8690340 1.722920 6 40.346389 ANL 6:6001:12081 8690340 1.723146 7 40.334325 ANL 6:6001:12064 8690338 1.723661 8 40.330446 ANL 6:6001:12121 8690339 1.723827 9 40.284595 ANL 6:6001:12116 8690339 1.725789 10 40.278924 ANL 6:6001:12142 8690339 1.726032 Top 100 PMA Throughput Connections

  • Passive monitor components

  • Automated packet header trace collection036912151821n seconds (e.g., 90) measurement collected every three hours from measurement objects random start in first hour, but synchronized across machines sent to central collector (via encrypted ssh) daily analysis and encoded traces created encoded files available via ftp and httpmaximum timefor delayed starttime for networkanalysis tasksremaining availabletime for transmissionNAIMOAT

  • Active Measurement Project (AMP) Led by Tony McGregor

    Focus on site-to-site measurement across high performance networks

    Attempt to deploy FreeBSD-based AMP machines at all HPC sites about 130 machines currently deployed and operational

    RTT, topology, and loss; user/event driven throughput

    We currently measure RTT to each of the other monitors every minute and the route to each every 10 minutes

  • 23 February 2000UCSDActive measurement deployment statusSDSUUIowaPrincetonDartmouthNCREN/NCSCBUUCSCNCSAUMassGATechUCBCSU-SBUCBoulderNCARHarvardSDSCUMiamiDukeCMU/PSCUABUWashingtonFSUUWyomingFNALUWisc-MilwaukeeUNC-CHUArizonaUC-IrvineUWaikatoNTNUNSFSDSMTOklahoma StateWashingtonState U.StanfordUCLAUVirginiaUDelUKansasUFloridaUMdUNMUAUVermontUOregonKansas StateMITJHUColoStateRiceWUSTLIUUMissouriMississippiStateODUMontana StateNCSUUCFNDSUEmory U.WVUUMichSLACGMUURochesterMSUYaleUSFUofUtahCSUPomonaColumbiaIowaStatePSUSMUUPennUMBCGeorgetownUAHUICUAlaskaUWiscUofOklahomaUCNWUACCESSASUVanderbiltOregon StateStartapMTUWSUUofGeorgiaUConnUTKUHawaiiUIUCNMSU

  • AMP web info (1)

  • AMP web info (2)

  • AMP web info (3)

  • Event Detection Tony McGregor

    AMP system consists of around 130 monitors in a full mesh. A set of graphs is available for each of the approximately 14,000 measured paths.

    The Automated Event Detection is a system for detection of events in data collected by active monitors.

    The system is divided into algorithms; each algorithm detects one class of network event. Currently, three algorithms are implemented. The "Plateau Detector" detects a change in the base RTT between a pair of monitors. A second algorithm detects a change in the RTT variance over a path. While the last algorithm triggers when packet losses are above an input threshold value.

  • Collaborations Internet2 1. regarding the IPLS router instrumentation at the Indiana GigaPOP (Joerg Micheel in discussions with Matt Zekauskas). 2. continuing discussions with I2 researchers regarding AMP involvement in E2E project (Tony McGregor, Ronn Ritke). 3. participation on the Internet2 End-to-End Performance Initiative Design Team (Ronn Ritke).

    Deployment of AMP machines at NASA Goddard and JPL. The machine at JPL is part of the JPL Performance Reference System.

    We now have AMP monitors at LBNL, SLAC, Argonne National Lab and Fermi DOE facilities.

  • Collaborations (Contd) Phil Dykstra and Cindy Dykstra, WareOnEarth (WCI, Inc.) regarding the AMP peer network with Defense Research and Engineering Network (DREN), as well as other activities.

    Other NLANR sites and their researchers and administrators, including weekly conference calls, and other activities.

    Kevin Walsh and Jay Dombrowski network systems group at SDSC (SDSC Enterprise Network Services [ENS]) on creating the data compute engine/repository containing a replica of AMP data, as well as additional activities.

  • International Collaborations Discussions with Tom DeFanti have included the monitoring of STAR LIGHT, and early insertion of optical splitters to allow quick installation of PMA machines.

    We are in talks with AMPATH regarding the placement of an OCXmon and AMP machine to measure the traffic from AMPATH.

    We are in contact with Greg Cole of FASTnet (formerly MIRnet) and are discussing several possible measurement activities.

  • International Collaborations (Contd) We have a PMA monitor in Israel, and AMP machines in Korea, Norway, Australia, and New Zealand (soon Japan).

    We are working with Canada, Korea, and Australia to help them install their own local AMP meshes.

    We are working with the Pacific Rim Applications & Grid Middleware Assembly (PRAGMA) effort at SDSC.

    Interest has also been expressed by other countries (Japan and Thailand) in both the AMP and PMA projects.

  • KOREA Network Map : ~2001STARTAPKIXSeoulXPAPANTokyoXPATM/SONET 155Mbps/310MbpsATM/SONET 622Mbps2MATM8M2M45M

  • Hans-Werner BraunRonn RitkeNLANR/MNA(UCSD/SDSC)http://moat.nlanr.net/

    Funded by the National Science Foundation/CISE/ANIR

    NLANR/MNA Measurement and Network Analysis

  • Goals and objectivesCreation of the Network Analysis Infrastructure (NAI) to support measurements and network analysisNetwork measurement and analysis research activitiesTool development for analysis and visualizationsAll data, analyses, graphs, visualizations, and tools are made public available for use by all researchers.

  • Completely noninvasive, no impact on forwarding paths.

    Aggregated traffic signature at a measurement point.

    OC3/OC12, ATM and POS, OC48 (develop OC192 capability).

    Between June 2000 and Jan 2001 (7 months) 6,000 PMA trace files were downloaded (31 per day) from at least 193 different sites.

    Trace analysis summaries include (total packets, Bytes, top port numbers by volume, top 100 throughput connections, etc.)

    (Passive traffic collection and analysis at optical carrier speeds)Passive Measurement and Analysis (PMA) project

  • NCARU. Colorado, BoulderAIX/MAE-WestNASA-AmesArgonne Nat. LabU. of MichiganMichigan State U.OhioState U.STARTAP/APANRice U.Baylor College of MedicineU. of HoustonTexas A&M U.Old Dominion U.MCNCNorth Carolina State U.U. of North CarolinaDuke U.U. of FloridaMiami U.Florida State U.26 September 2000SDSC, U. California, San DiegoPassive measurement deployment statusFDDIOC3 ATMOC3 PoSOC12 ATMOC12 PoSNCSAFIX-WestTel Aviv U.(I-2)Colorado StateFront Range GigaPoPTexas GigaPoPU. MemphisIndiana StateColumbia U.

  • Active Measurement Project (AMP) Led by Tony McGregor

    Focus on site-to-site measurement across high performance networks

    Attempt to deploy FreeBSD-based AMP machines at all HPC sites about 130 machines currently deployed and operational

    RTT, topology, and loss; user/event driven throughput

    We currently measure RTT to each of the other monitors every minute and the route to each every 10 minutes

  • 23 February 2000UCSDActive measurement deployment statusSDSUUIowaPrincetonDartmouthNCREN/NCSCBUUCSCNCSAUMassGATechUCBCSU-SBUCBoulderNCARHarvardSDSCUMiamiDukeCMU/PSCUABUWashingtonFSUUWyomingFNALUWisc-MilwaukeeUNC-CHUArizonaUC-IrvineUWaikatoNTNUNSFSDSMTOklahoma StateWashingtonState U.StanfordUCLAUVirginiaUDelUKansasUFloridaUMdUNMUAUVermontUOregonKansas StateMITJHUColoStateRiceWUSTLIUUMissouriMississippiStateODUMontana StateNCSUUCFNDSUEmory U.WVUUMichSLACGMUURochesterMSUYaleUSFUofUtahCSUPomonaColumbiaIowaStatePSUSMUUPennUMBCGeorgetownUAHUICUAlaskaUWiscUofOklahomaUCNWUACCESSASUVanderbiltOregon StateStartapMTUWSUUofGeorgiaUConnUTKUHawaiiUIUCNMSU

  • AMP web info (1)

  • AMP web info (2)

  • AMP web info (3)

  • International Collaborations Discussions with Tom DeFanti have included the monitoring of STAR LIGHT, and early insertion of optical splitters to allow quick installation of PMA machines.

    We are in talks with AMPATH regarding the placement of an OCXmon and AMP machine to measure the traffic from AMPATH.

    I recently attended a meeting in Russia with Greg Cole of NaukaNet (formerly Fastnet) and are discussing several possible measurement activities.

  • International Collaborations (Contd) We have a PMA monitor in Israel, and AMP machines in Korea, Norway, Australia, and New Zealand (soon Japan).

    We are working with Canada, Korea, and Australia to help them install their own local AMP meshes.

    We are working with the Pacific Rim Applications & Grid Middleware Assembly (PRAGMA) effort at SDSC.

    Interest has also been expressed by other countries (Japan, China and Thailand) in both the AMP and PMA projects.

  • KOREA Network Map : ~2001STARTAPKIXSeoulXPAPANTokyoXPATM/SONET 155Mbps/310MbpsATM/SONET 622Mbps2MATM8M2M45M

  • AARNets International ConnectionsCurrent and PlannedSingaporeSouth AsiaMiddle EastEuropeEuropeAPANAbileneCANetGEANTStarTapFijiGlobalGRIDForumSouthAmericaAARNetInternational Transit NetworkJapanNew ZealandTaiwanHawaiiSLOSeattlePNGSydneyPerth

  • Possible CA*net 4 TopologyJanuary 1, 2002HalifaxEdmontonSeattleVancouverWinnipegQuebec CityMontrealOttawaChicagoHalifaxNew YorkReginaFrederictonCharlottetownVictoriaWindsorLondonSudburyThunder BaySaskatoonKamloopsBuffaloSpokaneMinneapolisAlbanySt. John'sCalgaryTorontoPrince GeorgeHamiltonKingstonCA*net 4 Node Mini-IXPossible Future BreakoutPossible Future link or OptionCA*net 4 OC192

  • Cichlid

    C:\WINDOWS\Desktop\Temp\NLANR-logo-4ppt.kpg*C:\WINDOWS\Desktop\Temp\NLANR-logo-4ppt.kpg*C:\WINDOWS\Desktop\Temp\NLANR-logo-4ppt.kpg*C:\WINDOWS\Desktop\Temp\NLANR-logo-4ppt.kpg*


Top Related