henp networks and grids for global virtual organizations
DESCRIPTION
HENP Networks and Grids for Global Virtual Organizations. Harvey B. Newman California Institute of Technology TIP2004, Internet2 HENP WG Session January 25, 2004. The Challenges of Next Generation Science in the Information Age. Flagship Applications - PowerPoint PPT PresentationTRANSCRIPT
HENP HENP Networks and Grids for Networks and Grids for Global Virtual Organizations Global Virtual Organizations
Harvey B. NewmanHarvey B. Newman California Institute of TechnologyCalifornia Institute of TechnologyTIP2004, Internet2 HENP WG SessionTIP2004, Internet2 HENP WG Session
January 25, 2004January 25, 2004
The Challenges of Next Generation Science in the Information Age
The Challenges of Next Generation Science in the Information Age
Flagship Applications Flagship Applications High Energy & Nuclear Physics, AstroPhysics Sky Surveys:High Energy & Nuclear Physics, AstroPhysics Sky Surveys:
TByte to PByte “block” transfers at 1-10+ Gbps TByte to PByte “block” transfers at 1-10+ Gbps eVLBI:eVLBI: Many real time data streams at 1-10 Gbps Many real time data streams at 1-10 Gbps BioInformatics, Clinical Imaging:BioInformatics, Clinical Imaging: GByte images on demand GByte images on demand
HEP Data Example: HEP Data Example: From Petabytes in 2003, ~100 Petabytes by 2007-8, From Petabytes in 2003, ~100 Petabytes by 2007-8,
to ~1 Exabyte by ~2013-5. to ~1 Exabyte by ~2013-5. Provide results with rapid turnaround, coordinating Provide results with rapid turnaround, coordinating
large but limited computing and data handling resources,large but limited computing and data handling resources,over networks of varying capability in different world regionsover networks of varying capability in different world regions
Advanced integrated applications, such as Data Grids, Advanced integrated applications, such as Data Grids, rely on seamless operation of our LANs and WANsrely on seamless operation of our LANs and WANs With reliable, quantifiable high performanceWith reliable, quantifiable high performance
Petabytes of complex data explored and analyzed by Petabytes of complex data explored and analyzed by 1000s of globally dispersed scientists, in hundreds of teams1000s of globally dispersed scientists, in hundreds of teams
First Beams: April 2007Physics Runs: from Summer 2007
TOTEM pp, general purpose; HI
pp, general purpose; HI
LHCb: B-physics
ALICE : HI
pp s =14 TeV L=1034 cm-2 s-1
27 km Tunnel in Switzerland & France
Large Hadron Collider (LHC) CERN, Geneva: 2007 Start
Large Hadron Collider (LHC) CERN, Geneva: 2007 Start
CMS
ATLASAtlas
Four LHC Experiments: The Four LHC Experiments: The Petabyte to Exabyte Petabyte to Exabyte
ChallengeChallengeATLAS, CMS, ALICE, LHCBATLAS, CMS, ALICE, LHCB
Higgs + New particles; Quark-Gluon Plasma; CP ViolationHiggs + New particles; Quark-Gluon Plasma; CP Violation
Tens of PB 2008; To 1 EB by ~2015Tens of PB 2008; To 1 EB by ~2015 Hundreds of TFlops To PetaFlops Hundreds of TFlops To PetaFlops
6000+ Physicists & Engineers; 60+ Countries;
250 Institutions
All charged tracks with pt > 2 GeV
Reconstructed tracks with pt > 25 GeV
(+30 minimum bias events)
109 events/sec, selectivity: 1 in 1013 (1 person in a thousand world populations)
LHC: Higgs Decay into 4 muons (Tracker only); 1000X LEP Data Rate
LHC: Higgs Decay into 4 muons (Tracker only); 1000X LEP Data Rate
LHC Data Grid Hierarchy:Developed at Caltech
LHC Data Grid Hierarchy:Developed at Caltech
Tier 1
Tier2 Center
Online System
CERN Center PBs of Disk;
Tape Robot
FNAL CenterIN2P3 Center INFN Center RAL Center
InstituteInstituteInstituteInstitute
Workstations
~100-1500 MBytes/sec
2.5-10 Gbps
0.1 to 10 GbpsTens of Petabytes by 2007-8.An Exabyte ~5-7 Years later.Physics data cache
~PByte/sec
~10 Gbps
Tier2 CenterTier2 CenterTier2 Center
~2.5-10 Gbps
Tier 0 +1
Tier 3
Tier 4
Tier2 Center Tier 2
Experiment
CERN/Outside Resource Ratio ~1:2Tier0/( Tier1)/( Tier2) ~1:1:1
Emerging Vision: A Richly Structured, Global Dynamic System
Bandwidth Growth of Int’l HENP Bandwidth Growth of Int’l HENP Networks (US-CERN Example)Networks (US-CERN Example)
Bandwidth Growth of Int’l HENP Bandwidth Growth of Int’l HENP Networks (US-CERN Example)Networks (US-CERN Example)
Rate of Progress >> Moore’s Law. Rate of Progress >> Moore’s Law. (US-CERN Example)(US-CERN Example) 9.6 kbps Analog9.6 kbps Analog (1985) (1985) 64-256 kbps Digital (1989 - 1994) [X 7 – 27]64-256 kbps Digital (1989 - 1994) [X 7 – 27] 1.5 Mbps Shared (1990-3; IBM) [X 160]1.5 Mbps Shared (1990-3; IBM) [X 160] 2 -4 Mbps2 -4 Mbps (1996-1998) [X 200-400] (1996-1998) [X 200-400] 12-20 Mbps (1999-2000) [X 1.2k-2k]12-20 Mbps (1999-2000) [X 1.2k-2k] 155-310 Mbps155-310 Mbps (2001-2) [X 16k – 32k] (2001-2) [X 16k – 32k] 622 Mbps622 Mbps (2002-3) [X 65k] (2002-3) [X 65k] 2.5 Gbps 2.5 Gbps (2003-4) [X 250k] (2003-4) [X 250k] 10 Gbps 10 Gbps (2005) [X 1M] (2005) [X 1M]
A factor of ~1M over a period of 1985-2005 A factor of ~1M over a period of 1985-2005 (a factor of ~5k during 1995-2005)(a factor of ~5k during 1995-2005)
HENP has become a leading applications driver, HENP has become a leading applications driver, and also a co-developer of global networks; and also a co-developer of global networks;
* 9/01 105 Mbps 30 Streams: SLAC-IN2P3; 102 Mbps 1 Stream CIT-CERN9/01 105 Mbps 30 Streams: SLAC-IN2P3; 102 Mbps 1 Stream CIT-CERN 5/20/02 450-600 Mbps SLAC-Manchester on OC12 with ~100 Streams5/20/02 450-600 Mbps SLAC-Manchester on OC12 with ~100 Streams 6/1/02 290 Mbps Chicago-CERN One Stream on OC12 6/1/02 290 Mbps Chicago-CERN One Stream on OC12 9/02 9/02 850, 1350, 1900 Mbps Chicago-CERN 1,2,3 GbE Streams, 2.5G Link850, 1350, 1900 Mbps Chicago-CERN 1,2,3 GbE Streams, 2.5G Link 11/02 [LSR] 930 Mbps in 1 Stream California-CERN, and California-AMS 11/02 [LSR] 930 Mbps in 1 Stream California-CERN, and California-AMS FAST TCP 9.4 Gbps in 10 Flows California-Chicago FAST TCP 9.4 Gbps in 10 Flows California-Chicago 2/03 [LSR] 2.38 Gbps in 1 Stream California-Geneva (99% Link Utilization)2/03 [LSR] 2.38 Gbps in 1 Stream California-Geneva (99% Link Utilization) 5/03 [LSR] 0.94 Gbps IPv6 in 1 Stream Chicago- Geneva5/03 [LSR] 0.94 Gbps IPv6 in 1 Stream Chicago- Geneva TW & SC2003: 5.65 Gbps (IPv4), 4.0 Gbps (IPv6) in 1 Stream Over 11,000 km TW & SC2003: 5.65 Gbps (IPv4), 4.0 Gbps (IPv6) in 1 Stream Over 11,000 km
HEP is Learning How to Use Gbps Networks Fully: Factor of ~50 Gain in Max. Sustained TCP Thruput
in 2 Years, On Some US+Transoceanic Routes
HEP is Learning How to Use Gbps Networks Fully: Factor of ~50 Gain in Max. Sustained TCP Thruput
in 2 Years, On Some US+Transoceanic Routes
FAST TCP: Baltimore/Sunnyvale
1 flow 2 flows 7 flows 9 flows 10 flows
Average utilization
95%
92%
90%
90%
88%
Measurements 11/02 Std Packet Size Utilization averaged
over > 1hr 4000 km Path
Fast convergence to equilibriumFast convergence to equilibrium RTT estimation: fine-grain timerRTT estimation: fine-grain timer Delay monitoring in equilibriumDelay monitoring in equilibrium Pacing: reducing burstinessPacing: reducing burstiness
Fair SharingFair SharingFast RecoveryFast Recovery
8.6 Gbps;8.6 Gbps;21.6 TB 21.6 TB
in 6 Hoursin 6 Hours
9G
10G
Fall 2003: Transatlantic Ultraspeed TCP TranfersFall 2003: Transatlantic Ultraspeed TCP TranfersThroughput Achieved: X50 in 2 yearsThroughput Achieved: X50 in 2 years
Juniper, HP
Level(3)Telehous
e
Terabyte Transfers by the Caltech-CERN Team: Nov 18: 4.00 Gbps IPv6 Geneva-Phoenix (11.5 kkm) Oct 15: 5.64 Gbps IPv4 Palexpo-L.A. (10.9 kkm)
Across Abilene (Internet2) Chicago-LA, Sharing with normal network traffic
Peaceful Coexistence with a Joint Internet2-Telecom World VRVS Videoconference
Nov 19: 23+ Gbps TCP: Caltech, Nov 19: 23+ Gbps TCP: Caltech, SLAC, CERN, LANL, UvA, ManchesterSLAC, CERN, LANL, UvA, Manchester
HENP Major Links: Bandwidth Roadmap (Scenario) in Gbps
HENP Major Links: Bandwidth Roadmap (Scenario) in Gbps
Year Production Experimental Remarks
2001 0.155 0.622-2.5 SONET/SDH
2002 0.622 2.5 SONET/SDH DWDM; GigE Integ.
2003 2.5 10 DWDM; 1 + 10 GigE Integration
2005 10 2-4 X 10 Switch; Provisioning
2007 2-4 X 10 ~10 X 10; 40 Gbps
1st Gen. Grids
2009 ~10 X 10 or 1-2 X 40
~5 X 40 or ~20-50 X 10
40 Gbps Switching
2011 ~5 X 40 or
~20 X 10
~25 X 40 or ~100 X 10
2nd Gen Grids Terabit Networks
2013 ~Terabit ~MultiTbps ~Fill One Fiber
Continuing the Trend: ~1000 Times Bandwidth Growth Per Decade;We are Rapidly Learning to Use Multi-Gbps Networks Dynamically
HENP Lambda Grids:Fibers for Physics
HENP Lambda Grids:Fibers for Physics
Problem: Extract “Small” Data Subsets of 1 to 100 Terabytes Problem: Extract “Small” Data Subsets of 1 to 100 Terabytes from 1 to 1000 Petabyte Data Storesfrom 1 to 1000 Petabyte Data Stores
Survivability of the HENP Global Grid System, with Survivability of the HENP Global Grid System, with hundreds of such transactions per day (circa 2007)hundreds of such transactions per day (circa 2007)requires that each transaction be completed in a requires that each transaction be completed in a relatively short time. relatively short time.
Example: Take 800 secs to complete the transaction. ThenExample: Take 800 secs to complete the transaction. Then Transaction Size (TB)Transaction Size (TB) Net Throughput (Gbps)Net Throughput (Gbps) 1 101 10 10 10010 100 100 1000 (Capacity of 100 1000 (Capacity of
Fiber Today) Fiber Today) Summary: Providing Switching of 10 Gbps wavelengthsSummary: Providing Switching of 10 Gbps wavelengths
within ~2-4 years; and Terabit Switching within 5-8 years within ~2-4 years; and Terabit Switching within 5-8 years would enable “Petascale Grids with Terabyte transactions”,would enable “Petascale Grids with Terabyte transactions”,to fully realize the discovery potential of major HENP programs, to fully realize the discovery potential of major HENP programs, as well as other data-intensive research.as well as other data-intensive research.
National Light Rail FootprintNational Light Rail Footprint
15808 Terminal, Regen or OADM siteFiber route
NLRStarting Up NowInitially 4 10 Gb
WavelengthsFuture: to 40 10Gb Waves
Transition beginning now to optical, multi-wavelength R&E networks. Also Note: XWIN (Germany); IEEAF/GEO plan for dark fiber in Europe
PITPIT
PORPOR
FREFRE
RALRAL
WALWAL
NASNASPHOPHO
OLGOLGATLATL
CHICHI
CLECLE
KANKAN
OGDOGDSACSAC BOSBOSNYCNYC
WDCWDC
STRSTR
DALDAL
DENDEN
LAXLAX
SVLSVL
SEASEA
SDGSDG
JACJAC
GLIF network 1Q2004:“Global Lambda Integrated Facility”
GLIF network 1Q2004:“Global Lambda Integrated Facility”
DWDM DWDM SURFnet SURFnet
lambda service pathlambda service path
IP service pathIP service path
10 Gbit/s10 Gbit/s
SURFnetSURFnet10 Gbit/s10 Gbit/s
SURFnetSURFnet10 Gbit/s10 Gbit/s
IEEAFIEEAF10 Gbit/s10 Gbit/s
DwingelooDwingelooASTRON/JIVEASTRON/JIVE
DwingelooDwingelooASTRON/JIVEASTRON/JIVE
PraguePragueCzechLightCzechLight
PraguePragueCzechLightCzechLight
2.5 Gbit/s2.5 Gbit/s
NSFNSF10 Gbit/s10 Gbit/s
LondonLondonUKLightUKLightLondonLondonUKLightUKLight
StockholmStockholmNorthernLightNorthernLight
StockholmStockholmNorthernLightNorthernLight
2.5 Gbit/s 2.5 Gbit/s
New YorkNew YorkMANLANMANLANNew YorkNew YorkMANLANMANLAN
TokyoTokyoWIDEWIDETokyoTokyoWIDEWIDE
10 10 Gbit/s Gbit/s
1010Gbit/sGbit/s
10 Gbit/s10 Gbit/s(2/29 ?)(2/29 ?)
2x10 2x10 Gbit/sGbit/s
IEEAFIEEAF10 10
Gbit/sGbit/s
2x10 2x10 Gbit/sGbit/s
10 Gbit/s10 Gbit/s
2.5 Gbit/s 2.5 Gbit/s
2.5 Gbit/s2.5 Gbit/sTokyoTokyoAPANAPANTokyoTokyoAPANAPAN
GenevaGenevaCERNCERN
GenevaGenevaCERNCERN
ChicagoChicagoChicagoChicago AmsterdamAmsterdamAmsterdamAmsterdam
(2/29 )(2/29 )
Aarnet: SXTransport Project in 2004Aarnet: SXTransport Project in 2004 Connect Major Australian Universities to 10 Gbps BackboneConnect Major Australian Universities to 10 Gbps Backbone Two 10 Gbps Research Links to the USTwo 10 Gbps Research Links to the US Aarnet/USLIC Collaboration on Net R&D Starting NowAarnet/USLIC Collaboration on Net R&D Starting Now
GLORIAD: Global Optical Ring (US-Ru-Cn)GLORIAD: Global Optical Ring (US-Ru-Cn)““Little Gloriad” (OC3) Launched January 12; to OC192 in 2004Little Gloriad” (OC3) Launched January 12; to OC192 in 2004
Germany: 2003, 2004, 2005Germany: 2003, 2004, 2005
GWIN Connects 550 Universities, Labs, Other InstitutionsGWIN Connects 550 Universities, Labs, Other Institutions
GWIN: Q4/03GWIN: Q4/03 GWIN: Q4/04GWIN: Q4/04PlanPlan
XWIN: Q4/05XWIN: Q4/05((Dark Fiber Option)Dark Fiber Option)
The original Computational and Data Grid concepts are The original Computational and Data Grid concepts are largely stateless, open systems: known to be scalable largely stateless, open systems: known to be scalable
Analogous to the WebAnalogous to the WebThe classical Grid architecture has a number of implicit The classical Grid architecture has a number of implicit
assumptionsassumptions The ability to locate and schedule suitable resources,The ability to locate and schedule suitable resources,
within a tolerably short time (i.e. resource richness) within a tolerably short time (i.e. resource richness) Short transactions with relatively simple failure modesShort transactions with relatively simple failure modes
HENP Grids are HENP Grids are Data Intensive & Resource-ConstrainedData Intensive & Resource-Constrained 1000s of users competing for resources at 100s of sites1000s of users competing for resources at 100s of sites Resource usage governed by local and global policiesResource usage governed by local and global policies Long transactions; some long queuesLong transactions; some long queues
HENP HENP Stateful, End-to-end Monitored and Tracked ParadigmStateful, End-to-end Monitored and Tracked Paradigm Adopted in OGSA, Now WS Resource FrameworkAdopted in OGSA, Now WS Resource Framework
Classical, HENP Data Grids, and Classical, HENP Data Grids, and Now Service-Oriented GridsNow Service-Oriented Grids
19Caltech GAE Team
The Grid Analysis Environment (GAE)The Grid Analysis Environment (GAE)
The GAE: key to “success” or “failure” for physics & Grids in the LHC era:The GAE: key to “success” or “failure” for physics & Grids in the LHC era: 100s - 1000s of tasks, with a wide range of computing, data 100s - 1000s of tasks, with a wide range of computing, data
and network resource requirements, and priorities and network resource requirements, and priorities
The Move to OGSA and then The Move to OGSA and then Managed Integration SystemsManaged Integration Systems
Incr
ease
d f
un
ctio
nal
ity,
stan
dar
diz
atio
n
Time
Customsolutions
Open GridServices Arch
GGF: OGSI, …(+ OASIS, W3C)
Multiple implementations,including Globus Toolkit
Web services + …
Globus Toolkit
Defacto standardsGGF: GridFTP, GSI
X.509,LDAP,FTP, …
App-specificServices~Integrated Systems~Integrated Systems
Stateful; ManagedWeb Serv
Resrc Framwk
Managing Global Systems: Dynamic Managing Global Systems: Dynamic Scalable Services ArchitectureScalable Services Architecture
MonALISA: http://monalisa.cacr.caltech.edu
““Station Server” Services-enginesStation Server” Services-engines at sites host “Dynamic Services” at sites host “Dynamic Services” Auto-discovering, CollaborativeAuto-discovering, Collaborative Scalable to thousands of Scalable to thousands of
service-Instances service-Instances Servers interconnect dynamically; Servers interconnect dynamically;
form a robust fabric form a robust fabric Service Agents: Goal-Oriented, Service Agents: Goal-Oriented,
Autonomous, Adaptive Autonomous, Adaptive Adaptable to Web services: Adaptable to Web services:
many platforms & working many platforms & working environments (also mobile)environments (also mobile)
StationStationServerServer
StationStationServerServer
StationStationServerServer
LookupLookupServiceService
LookupLookupServiceService
Proxy ExchangeProxy Exchange
Registration
Registration
Service Listener
Service Listener
Lookup Lookup Discovery Discovery
ServiceService
Remote Notification
Remote Notification
Dynamic Distributed Services Dynamic Distributed Services Architecture (DDSA)Architecture (DDSA)
Caltech/UPB (Romania)/NUST (Pakistan) Collaboration
See http://monalisa.cacr.caltech.edu http://diamonds.cacr.caltech.edu
23Caltech GAE Team
GAE ArchitectureGAE Architecture Analysis Clients talk
standard protocols to the “Grid Services Web Server”, a.k.a. the Clarens data/services portal.
Simple Web service API allows Analysis Clients (simple or complex) to operate in this architecture.
Typical clients: ROOT, Web Browser, IGUANA, COJAC
The Clarens portal hides the complexity of the Grid Services from the client, but can expose it in as much detail as req’d for e.g. monitoring.
Key features: Global Scheduler, Catalogs, Monitoring, and Grid-wide Execution service.
SchedulerCatalogs
Analysis Client
Grid ServicesWeb Server
ExecutionPriority
Manager
Grid WideExecutionService
DataManagement
Fully-ConcretePlanner
Fully-AbstractPlanner
Analysis Client
AnalysisClient
Virtual Data
Replica
ApplicationsMonitoring
Partially-AbstractPlanner
Metadata
HTTP, SOAP, XML/RPC
24Caltech GAE Team
GAE ArchitectureGAE Architecture
The GAE, based on Clarens and Web services, easily allows a “Peer-to-Peer” configuration to be built, with associated robustness and scalability features.
Flexible: allows easy creation, use and management of highly complex VO structures.
A typical Peer-to-Peer scheme would involve the Clarens servers acting as “Global Peers,” that broker GAE client requests among all the Clarens servers available worldwide.
“Structured Peer-to-Peer”
Integrated hybrid experimental network, leveraging Transatlantic Integrated hybrid experimental network, leveraging Transatlantic R&D network partnerships; packet-switched + dynamic optical paths R&D network partnerships; packet-switched + dynamic optical paths 10 GbE across US and the Atlantic: NLR, DataTAG, TransLight, 10 GbE across US and the Atlantic: NLR, DataTAG, TransLight,
NetherLight, UKLight, etc.; Extensions to Japan, Taiwan, BrazilNetherLight, UKLight, etc.; Extensions to Japan, Taiwan, Brazil End-to-end monitoring; Realtime tracking and optimization; End-to-end monitoring; Realtime tracking and optimization;
Dynamic bandwidth provisioningDynamic bandwidth provisioning Agent-based services spanning all layers of the system, from the Agent-based services spanning all layers of the system, from the
optical cross-connects to the applications.optical cross-connects to the applications.
National Lambda RailNational Lambda Rail
UltraLight Collaboration:UltraLight Collaboration:http://ultralight.caltech.eduhttp://ultralight.caltech.edu
Caltech, UF, FIU, UMich, SLAC,FNAL,MIT/Haystack,CERN, UERJ(Rio), NLR, CENIC, UCAID,Translight, UKLight, Netherlight, UvA, UCLondon, KEK, Taiwan
Cisco, Level(3)
Flagship Applications(HENP, VLBI, Oncology, …)
Grid/Storage Management
Network Protocols &Bandwidth Management
En
d-t
o-e
nd
Mo
nit
ori
ng
Inte
llig
en
t A
ge
nts
En
d-t
o-e
nd
Mo
nit
ori
ng
Inte
llig
en
t A
ge
nts
Application Frameworks
Distributed CPU & Storage
Network Fabric
Grid Middleware
Flagship Applications(HENP, VLBI, Oncology, …)
Grid/Storage Management
Network Protocols &Bandwidth Management
En
d-t
o-e
nd
Mo
nit
ori
ng
Inte
llig
en
t A
ge
nts
En
d-t
o-e
nd
Mo
nit
ori
ng
Inte
llig
en
t A
ge
nts
Application Frameworks
Distributed CPU & Storage
Network Fabric
Grid Middleware
PITPIT
PORPOR
FREFRE
RALRAL
WALWAL
NASNASPHOPHO
OLGOLG ATLATL
CHICHICLECLE
KANKAN
OGDOGDSACSAC NYCNYC
WDCWDC
STRSTR
DALDAL
DENDEN
LAXLAX
SVLSVL
SEASEA
SDGSDG
JACJAC
ICFA Standing Committee on Interregional Connectivity (SCIC)
ICFA Standing Committee on Interregional Connectivity (SCIC)
Created by ICFA in July 1998 in Vancouver ; Following ICFA-NTFCreated by ICFA in July 1998 in Vancouver ; Following ICFA-NTF CHARGE: CHARGE: Make recommendations to ICFA concerning the connectivity between Make recommendations to ICFA concerning the connectivity between
the Americasthe Americas, Asia and Europe (and network requirements of HENP), Asia and Europe (and network requirements of HENP) As part of the process of developing theseAs part of the process of developing these
recommendations, the committee should recommendations, the committee should Monitor traffic Monitor traffic Keep track of technology developmentsKeep track of technology developments Periodically review forecasts of future Periodically review forecasts of future
bandwidth needs, and bandwidth needs, and Provide early warning of potential problemsProvide early warning of potential problems
Create subcommittees when necessary to meet the chargeCreate subcommittees when necessary to meet the charge The chair of the committee should report to ICFA once perThe chair of the committee should report to ICFA once per
year, at its joint meeting with laboratory directors (Today)year, at its joint meeting with laboratory directors (Today) Representatives: Major labs, ECFA, ACFA, NA Users, S. AmericaRepresentatives: Major labs, ECFA, ACFA, NA Users, S. America
ICFA SCIC in 2002-2004A Period of Intense Activity ICFA SCIC in 2002-2004A Period of Intense Activity
Strong Focus on the Digital Divide ContinuingStrong Focus on the Digital Divide Continuing
Five Reports; Presented to ICFA 2003Five Reports; Presented to ICFA 2003See See http://cern.ch/icfa-scichttp://cern.ch/icfa-scic
Main Report: “Networking for HENP” Main Report: “Networking for HENP” [H. Newman et al.] [H. Newman et al.] Monitoring WG ReportMonitoring WG Report [L. Cottrell] [L. Cottrell] Advanced Technologies WG ReportAdvanced Technologies WG Report [R. Hughes-Jones, [R. Hughes-Jones,
O. Martin et al.] O. Martin et al.]Digital Divide Report Digital Divide Report [A. Santoro et al.][A. Santoro et al.]Digital Divide in Russia ReportDigital Divide in Russia Report [V. Ilyin][V. Ilyin]
2004 Reports in Progress; Short Reports on Nat’l and 2004 Reports in Progress; Short Reports on Nat’l and Regional Network Infrastructures and Initiatives.Regional Network Infrastructures and Initiatives.
Presentation to ICFA February 13, 2004Presentation to ICFA February 13, 2004
SCIC Report 2003 General ConclusionsSCIC Report 2003
General ConclusionsThe scale and capability of networks, their pervasiveness The scale and capability of networks, their pervasiveness
and range of applications in everyday life, and HENP’s and range of applications in everyday life, and HENP’s dependence on networks for its research, are all dependence on networks for its research, are all increasing rapidly. increasing rapidly.
However, as the pace of network advances continues to However, as the pace of network advances continues to accelerate, the gap between the economically “favored” accelerate, the gap between the economically “favored” regions and the rest of the world is in danger of widening. regions and the rest of the world is in danger of widening.
We must therefore workWe must therefore work to Close the Digital Divideto Close the Digital Divide To make Physicists from All World Regions Full Partners To make Physicists from All World Regions Full Partners
in Their Experiments; and in the Process of Discoveryin Their Experiments; and in the Process of Discovery This is essential for the health of our global This is essential for the health of our global
experimental collaborations, our plans for future experimental collaborations, our plans for future projects, and our field.projects, and our field.
Work on the Digital Divide:Several Perspectives
Work on the Digital Divide:Several Perspectives
Work on Policies and/or Pricing: pk, in, br, cn, SE Europe, …Work on Policies and/or Pricing: pk, in, br, cn, SE Europe, … Share Information: Comparative Performance and Pricing Share Information: Comparative Performance and Pricing Find Ways to work with vendors, NRENs, and/or Gov’tsFind Ways to work with vendors, NRENs, and/or Gov’ts Exploit Model Cases: e.g. Poland, Slovakia, Czech RepublicExploit Model Cases: e.g. Poland, Slovakia, Czech Republic
Inter-Regional Projects Inter-Regional Projects South America: CHEPREO (US-Brazil); EU @LIS ProjectSouth America: CHEPREO (US-Brazil); EU @LIS Project GLORIAD, Russia-China-US Optical RingGLORIAD, Russia-China-US Optical Ring Virtual SILK Highway Project (DESY): FSU satellite linksVirtual SILK Highway Project (DESY): FSU satellite links
Help with Modernizing the Infrastructure Help with Modernizing the Infrastructure Design, Commissioning, DevelopmentDesign, Commissioning, Development Provide Tools for Effective Use: Monitoring, CollaborationProvide Tools for Effective Use: Monitoring, Collaboration
Workshops and Tutorials/Training SessionsWorkshops and Tutorials/Training Sessions For Example: Digital Divide and HEPGrid Workshop,For Example: Digital Divide and HEPGrid Workshop,
UERJ Rio, February 2004UERJ Rio, February 2004 Participate in Standards Development; Open ToolsParticipate in Standards Development; Open Tools
Advanced TCP stacks; Grid systemsAdvanced TCP stacks; Grid systems
ICTP 2nd Open Round Table on Developing Countries Access to Scientific Information ICTP 2nd Open Round Table on Developing Countries Access to Scientific Information
STATEMENTSTATEMENT: AFFORDABLE: AFFORDABLE ACCESS TO THE INTERNET ACCESS TO THE INTERNETFOR RESEARCH AND LEARNINGFOR RESEARCH AND LEARNING
““Scholars from across the world meeting at the Abdus Salam International Centre for Scholars from across the world meeting at the Abdus Salam International Centre for Theoretical Physics (ICTP) in Trieste [10/2003] were concerned to learn of the barrier to Theoretical Physics (ICTP) in Trieste [10/2003] were concerned to learn of the barrier to education and research caused by the high cost of Internet access in many countries. education and research caused by the high cost of Internet access in many countries. The Internet enables the use of content which is vital for individuals and for institutions The Internet enables the use of content which is vital for individuals and for institutions engaged in teaching, learning and research. In many countries use of the Internet is severely engaged in teaching, learning and research. In many countries use of the Internet is severely restricted by the high telecommunications cost, leading to inequality in realising the benefits of restricted by the high telecommunications cost, leading to inequality in realising the benefits of education and research.education and research. Research staff and students in countries with liberal Research staff and students in countries with liberal telecommunications policies favouring educational use are gaining social and economic telecommunications policies favouring educational use are gaining social and economic advantage over countries with restrictive, high-cost policies. The potential benefits of access to advantage over countries with restrictive, high-cost policies. The potential benefits of access to the Internet are not available to all. the Internet are not available to all. The signatories to this message invite scholars in every country to join them in The signatories to this message invite scholars in every country to join them in expressing concern to governments and research funding agencies at the effect of high expressing concern to governments and research funding agencies at the effect of high telecommunications costs upon individuals and institutions undertaking teaching, learning and telecommunications costs upon individuals and institutions undertaking teaching, learning and research. The situation in many countries could be improved through educational discounts on research. The situation in many countries could be improved through educational discounts on normal telecommunications costs, or through the lifting of monopolies. It is for each country to normal telecommunications costs, or through the lifting of monopolies. It is for each country to determine its own telecommunications policies but the need for low-cost access to the Internet determine its own telecommunications policies but the need for low-cost access to the Internet for educational purposes is a need which is common to the whole of humankind.”for educational purposes is a need which is common to the whole of humankind.”
History - Throughput Quality Improvements from US
Bandwidth of TCP < MSS/(RTT*Sqrt(Loss)) (1)
(1) Macroscopic Behavior of the TCP Congestion Avoidance Algorithm1) Macroscopic Behavior of the TCP Congestion Avoidance Algorithm, Matthis, , Matthis, Semke, Mahdavi, Ott, Computer Communication Review 27(3), July 1997Semke, Mahdavi, Ott, Computer Communication Review 27(3), July 1997
60% annual improvement Factor ~100/10 yr
Progress: but the Digital Divide
is Being Maintained
1.5-8 Year Lag
S.E. Europe, Russia: Catching Up Lat Am., MidEast, China, Africa: Keeping Up India: Falling Behind
Current State – June 2003 (Max. Throughput in Mbps)Current State – June 2003 (Max. Throughput in Mbps)
Within region performance improving: Within region performance improving: E.g. Ca/US-NA, Hu-SE Eu, Eu-Eu, Jp-E Asia, Au-Au, Ru-RuE.g. Ca/US-NA, Hu-SE Eu, Eu-Eu, Jp-E Asia, Au-Au, Ru-Ru
Africa, Caucasus, Central & S. Asia all badAfrica, Caucasus, Central & S. Asia all bad
Bad < 200kbits/s < DSL Acceptable > 200, < 1000kbits/s
Good > 1000kbits/s
APAN Link Information 2004.1.05 [email protected] Network Bandwidth(Mbps) AUP/Remark
AU-US AARNet 310 to 2 X 10 Gbps R&E + CommodityCN-HK CERNET/HARNET 2 R&ECN-HK CSTNET 155 R&ECN-JP CERNET 10 R&ECN-JP CERNET 45 Native IPv6CN-UK CERNET 45 R&ECN-US CERNET 10 Research CN-US CERNET 200 R&ECN-US CSTNET 155 R&EHK-US HARNET 45 R&EHK-TW HARNET/TANET 10 R&EJP-ID AI3(ITB) 2/1.5 R&EJP-KR APII 2Gbps R&EJP-MY AI3(USM) 1.5/0.5 R&EJP-PH AI3(ASTI) 1.5/0.5 R&EJP-PH MAFFIN 2 Research JP-SG AI3(SICU) 1.5/0.5 R&EJP-TH AI3(AIT) 1.5/0.5 R&EJP-TH SINET(ThaiSarn) 2 R&EJP-US TransPac 5 Gbps R&EJP-VN AI3(IOIT) 1.5/0.5 R&E
APAN Link Information 2004.1.05 [email protected]
Countries Network Bandwidth(Mbps) AUP/Remark
KR-FR KOREN/RENATER 34 Research (TEIN)
KR-SG APII 8 R&E
KR-US KOREN/KREONet2 155 R&E
LK-JP LEARN 3 R&E
MY-SG NRG/SICU 2 Experiment (Down)
SG-US SingaREN 90 R&E
TH-US Uninet 155 R&E
TW-HK ASNET/TANET2 155 R&E
TW-JP ASNET/TANET2 155 R&E
TW-US ASNET/TANET2 5 Gbps R&E
(TW)-US-UK ASNET/TANET2 155 R&E
Non APAN Links
Countries Network Bandwidth(Mbps) AUP
IN-US/UK ERNET 16 R&E
(JP)-US-EU SINET 155 R&E / No Transit
JP-US SINET 5 Gbps R&E / No Transit
International Connectivity Costs in the Different European Market Segments
Market segment
Number of Countries
Cost Range
Liberal Market with transparent pricing
8 1-1.4
Liberal Market with less transparent pricing structure
7 1.8-3.3
Emerging Market without transparent pricing
3 7.5-7.8
Traditional Monopolist market
9 18-39
Dai Davies SERENATE Workshop Feb. 2003
Virtual SILK HighwayVirtual SILK HighwayArchitectural OverviewArchitectural Overview
Hub Earth Station at DESY with access to the European NRENs and the Internet via GEANT– Providing International Internet access directly
National Earth Station at each Partner site– Operated by DESY, providing international access – Additional earth stations from other sources – none yet– SCPC up-link, common down-link, using DVB
Routers for each Partner site– Linked on one side to the Satellite Channel– On the other side to the NREN
Bandwidth Plan – as of 3/03Bandwidth Plan – as of 3/03
From To MHz DVBMbps
SCPC Mbps
$K
08/02 11/02 2.9 3.1 0.77 20
12/02 05/03 5.4 6.9 2.40 92
06/03 11/03 7.5 9.5 3.32 136
12/03 05/04 9.4 12 4.10 175
06/04 11/04 12 16 4.90 220
12/04 07/05 15 19 6.50 379
1022
VRVS on WindowsVRVS on WindowsVRVS (Version 3)VRVS (Version 3)Meeting in 8 Time Meeting in 8 Time
ZonesZones
80+ Reflectors80+ Reflectors24.5k hosts worldwide24.5k hosts worldwideUsers in 99 CountriesUsers in 99 Countries
SERENATE is the name of a series of strategic studies into the future of research and education networking in Europe,
addressing the local (campus networks), national (national research & education networks), European and intercontinental levels. The SERENATE studies bring together the research and
education networks of Europe, national governments and funding bodies, the European Commission, traditional and "alternative" network operators, equipment manufacturers,
and the scientific and education community as the users of networks and services.
Study into European Research and Education Networking as Targeted
by eEurope
www.serenate.org
Summary and Conclusions by D.O. Williams, CERN
Optics and Fibres[Message to NRENs; or Nat’l Initiatives]
If there is one single technical lesson from SERENATE it is that transmission is moving from the electrical domain to optical.
The more you look at underlying costs the more you see the need for users to get access to fibre.
When there’s good competition users can still lease traditional communications services (bandwidth) on an annual basis. But: Without enough competition prices go through the roof.
A significant “divide” exists inside Europe – with the worst countries [Macedonia, B-H, Albania, etc.] 1000s of times worse off than the best. Also many of the 10 new EU members are ~5X worse off than the 15 present members.
Our best advice has to be “if you’re in a mess, you must get access to fibre”.
Also try to lobby politicians to introduce real competition. In Serbia – still a full telecoms monopoly – the two ministers talked and
the research community was given a fibre pair all around Serbia !
NEWS: Bulletin: ONE TWOWELCOME BULLETIN General InformationRegistrationTravel Information Hotel RegistrationParticipant List How to Get UERJ/Hotel Computer AccountsUseful Phone Numbers ProgramContact us: Secretariat Chairmen
CLAF CNPQ FAPERJ UERJ
SPONSORS
HEPGRID and Digital Divide Workshop
UERJ, Rio de Janeiro, Feb. 16-20 2004
Theme: Global Collaborations, Grids and Their Relationship to the Digital
DivideICFA, understanding the vital role of these issues for our field’s future, commissioned the Standing
Committee on Inter-regional Connectivity (SCIC) in 1998, to survey and monitor the state of the
networks used by our field, and identify problems. For the past three years the SCIC has focused on
understanding and seeking the means of reducing or eliminating the Digital Divide, and proposed in ICFA that these issues, as they affect our field of
High Energy Physics, be brought to our community for discussion. This led to ICFA’s approval, in July
2003, of the Digital Divide and HEP Grid Workshop.
More Information: http://www.uerj.br/lishep2004
Networks, Grids and HENPNetworks, Grids and HENP Network backbones and major links used by HENP experimentsNetwork backbones and major links used by HENP experiments
are advancing rapidly are advancing rapidly To the 10 G range in < 2 years; much faster than Moore’s LawTo the 10 G range in < 2 years; much faster than Moore’s Law Continuing a trend: a factor ~1000 improvement per decade; Continuing a trend: a factor ~1000 improvement per decade;
a new DOE and HENP Roadmap a new DOE and HENP Roadmap Transition to a community-owned and operated infrastructureTransition to a community-owned and operated infrastructure
for research and education is beginning with (NLR, USAWaves) for research and education is beginning with (NLR, USAWaves) HENP is learning to use long distance 10 Gbps networks effectively HENP is learning to use long distance 10 Gbps networks effectively
2002-2003 Developments: to 5+ Gbps flows over 11,000 km2002-2003 Developments: to 5+ Gbps flows over 11,000 km Removing Regional, Last Mile, Local Bottlenecks and Removing Regional, Last Mile, Local Bottlenecks and
Compromises in Network Quality are nowCompromises in Network Quality are now On the critical path, in all world regionsOn the critical path, in all world regions
Digital Divide: Network improvements are especially neededDigital Divide: Network improvements are especially neededin SE Europe, So. America; SE Asia, and Africain SE Europe, So. America; SE Asia, and Africa
Work in Concert with Internet2, Terena, APAN, AMPATH; Work in Concert with Internet2, Terena, APAN, AMPATH; DataTAG, the Grid projects and the Global Grid Forum DataTAG, the Grid projects and the Global Grid Forum
Computing Model Progress CMS Internal Review of Software and Computing
Some Extra Slides Some Extra Slides
FollowFollow
ICFA and International Networking ICFA and International Networking
ICFA Statement on Communications in Int’l HEPICFA Statement on Communications in Int’l HEPCollaborations of October 17, 1996Collaborations of October 17, 1996 See See http://www.fnal.gov/directorate/icfa/icfa_communicaes.htmlhttp://www.fnal.gov/directorate/icfa/icfa_communicaes.html
““ICFA urges that all countries and institutions wishing ICFA urges that all countries and institutions wishing to participate even more effectively and fully in to participate even more effectively and fully in international HEP Collaborations should:international HEP Collaborations should: Review their operating methods to ensure they Review their operating methods to ensure they
are fully adapted to remote participation are fully adapted to remote participation Strive to provide the necessary communications Strive to provide the necessary communications
facilities and adequate international bandwidth” facilities and adequate international bandwidth”
NREN Core Network Size (Mbps-km):http://www.terena.nl/compendium/2002
NREN Core Network Size (Mbps-km):http://www.terena.nl/compendium/2002
Logarithmic Scale
1k
100k
100
100M
10M
1M
10kRo
It
PlGrIr
Ukr
Hu Cz
Es
Nl
Fi
Ch
Lagging
In Transition
Leading
Advanced
Network Readiness Index:How Ready to Use Modern ICTs [*]?
Network Readiness Index:How Ready to Use Modern ICTs [*]?
NetworkReadiness
Index
Environment
Readiness
Usage
Market
Infrastructure
Political/Regulatory
Individual Readiness
Gov’t Readiness
Business Readiness
Individual Usage
Gov’t Usage
Business Usage
(FI)
(FI)
(SG)
(US)(IC)
(SG)
(US)
(SG)
(US)
(FI)
(FI)
(DE)
(KR)
( ): Which Country is First
From the 2002-2003 Global InformationTechnology Report. See http://www.weforum.org
PINGER History – Loss Quality
Fewer sites have very poor to dreadful performance
More have good performance(< 1% Loss)
BUT <20% of the world’sBUT <20% of the world’spopulation has Good orpopulation has Good orAcceptable performanceAcceptable performance
Throughput vs Net Readiness Index Throughput vs Net Readiness Index NRI from Center for Int’l Development, Harvard NRI from Center for Int’l Development, Harvard http://www.cid.harvard.edu/cr/pdf/gitrr2002_ch02.pdfhttp://www.cid.harvard.edu/cr/pdf/gitrr2002_ch02.pdf
Improved correlation (0.21 Improved correlation (0.21 0.41) by Using derived throughput ~0.41) by Using derived throughput ~ MSS / (RTT * sqrt(loss)); fit an exponential MSS / (RTT * sqrt(loss)); fit an exponential
Interesting Outliers: Slovakia, Hungary, Portugal. LithuaniaInteresting Outliers: Slovakia, Hungary, Portugal. Lithuania
Intern
et for all fo
cusA
&R
focus
NRI TopsNRI TopsFinland Finland 5.925.92US US 5.795.79SingaporeSingapore 5.745.74Sweden Sweden 5.585.58Iceland Iceland 5.515.51Canada Canada 5.445.44UKUK 5.355.35Denmark Denmark 5.335.33TaiwanTaiwan 5.315.31GermanyGermany 5.295.29Netherlnd Netherlnd 5.285.28Israel Israel 5.225.22Switz’land Switz’land 5.185.18Korea Korea 5.105.10
UltraLight UltraLight
http://ultralight.caltech.edu Serving the major LHC experiments; developments Serving the major LHC experiments; developments broadly applicable to other data-intensive programs broadly applicable to other data-intensive programs ““Hybrid” packet-switched and circuit-switched, Hybrid” packet-switched and circuit-switched,
dynamically managed optical networkdynamically managed optical network Global services for system managementGlobal services for system management Trans-US wavelength riding on NLR: LA-SNV-CHI-JAXTrans-US wavelength riding on NLR: LA-SNV-CHI-JAX Leveraging advanced research & production networksLeveraging advanced research & production networks
USLIC/DataTAG, SURFnet/NLlight, UKLight, USLIC/DataTAG, SURFnet/NLlight, UKLight, Abilene, CA*net4 Abilene, CA*net4
Dark fiber to CIT, SLAC, FNAL, UMich; Florida Light RailDark fiber to CIT, SLAC, FNAL, UMich; Florida Light Rail Intercont’l extensions: Rio de Janeiro, Tokyo, TaiwanIntercont’l extensions: Rio de Janeiro, Tokyo, Taiwan
Flagship Applications with a diverse traffic mixFlagship Applications with a diverse traffic mix HENP: TByte to PByte “block” data transfers at 1-10+ HENP: TByte to PByte “block” data transfers at 1-10+
GbpsGbps eVLBI: Real time data streams at 1 to several GbpseVLBI: Real time data streams at 1 to several Gbps
By I. Legrand (Caltech) et al. Monitors Clusters, Networks Agent-based Dynamic
information / resource discovery mechanisms
Implemented in Java/Jini; SNMP WDSL / SOAP with UDDI
Global System Optimizations > 100 Sites and Growing Being deployed in Abilene;
through the Internet2 E2EPi MonALISA (Java) 3D Interface
MonaLisa: A Globally Scalable Grid Monitoring System
PingER BenefitsPingER Benefits
Measures analyzes & reports round-trip Measures analyzes & reports round-trip times, losses, availability, throughput ...times, losses, availability, throughput ...
Covers 75+ countries (99% of Internet Covers 75+ countries (99% of Internet connected population)connected population)
Low impact on network << 100bits/s, Low impact on network << 100bits/s, important for many DD sitesimportant for many DD sites
Uses ubiquitous ping, no special host, or Uses ubiquitous ping, no special host, or software to install/configure at remote software to install/configure at remote sitessites
Provides Provides quantitativequantitative historical (> 8yrs) and historical (> 8yrs) and near real-time informationnear real-time information
How bad is performance to various How bad is performance to various regions, rank countries?regions, rank countries?
Trends: who is catching up, falling Trends: who is catching up, falling behind, is progress being made?behind, is progress being made?
Compare vs. economic, development Compare vs. economic, development indicators etc.indicators etc.
Useful Useful for troubleshooting, setting for troubleshooting, setting expectations; presenting to policy makers, expectations; presenting to policy makers, funding bodiesfunding bodies
Used to monitorOnly 1 host
Countries MonitoredCountries Monitored
CountryCountryHoHostssts CountryCountry
HoHostssts CountryCountry HostsHosts CountryCountry HostsHosts
ArgentinaArgentina 66 EstoniaEstonia 11 LatviaLatvia 11 SlovakiaSlovakia 22
ArmeniaArmenia 22 FinlandFinland 11 LithuaniaLithuania 11 SloveniaSlovenia 11
AustraliaAustralia 44 FranceFrance 1111 MacedoniaMacedonia 22 S AfricaS Africa 33
AustriaAustria 22 GeorgiaGeorgia 11 MalaysiaMalaysia 33 SpainSpain 66
AzerbaijanAzerbaijan 22 GermanyGermany 1313 MexicoMexico 55 SwedenSweden 44
BangladeshBangladesh 11 GhanaGhana 11 MoldovaMoldova 22 SwitzerlandSwitzerland 88
BelarusBelarus 22 GreeceGreece 11 MongoliaMongolia 11 TaiwanTaiwan 11
BelgiumBelgium 33 GuatemalaGuatemala 22 NetherlandsNetherlands 1212 ThailandThailand 11
BrazilBrazil 2121 HungaryHungary 55 New-ZealandNew-Zealand 44 TurkeyTurkey 22
BulgariaBulgaria 11 IcelandIceland 33 NigeriaNigeria 11 UgandaUganda 11
CanadaCanada 1111 IndiaIndia 1010 NorwayNorway 22 UkraineUkraine 22
ChileChile 44 IndonesiaIndonesia 33 PakistanPakistan 11 UKUK 3636
ChinaChina 66 IranIran 44 PeruPeru 11 USUS 208208
ColombiaColombia 44 IrelandIreland 22 PolandPoland 44 UruguayUruguay 33
Costa-RicaCosta-Rica 11 IsraelIsrael 55 PortugalPortugal 22 UzbekistanUzbekistan 22
CroatiaCroatia 55 ItalyItaly 1313 RomaniaRomania 11 VenezuelaVenezuela 22
CubaCuba 22 JapanJapan 1111 RussiaRussia 1212 Vietnam Vietnam 11
Czech-RepCzech-Rep 33 JordanJordan 11 Saudi ArabiaSaudi Arabia 11 AlbaniaAlbania 00
DenmarkDenmark 11 KazakhstanKazakhstan 22Serbia & Serbia & MontenegroMontenegro 22 PhilippinesPhilippines 00
EgyptEgypt 11 KoreaKorea 22 SingaporeSingapore 11
Need > 1 host to reduce anomalies
PingER SummaryPingER Summary
Performance is improving all overPerformance is improving all over Performance to developed countries are orders of Performance to developed countries are orders of
magnitude better than to developing countries magnitude better than to developing countries Poorer regions 5-10 years behindPoorer regions 5-10 years behind Poorest regions Africa, Caucasus, Central & S. AsiaPoorest regions Africa, Caucasus, Central & S. Asia Some regions are:Some regions are:
Catching up: Catching up: SE Europe, RussiaSE Europe, RussiaKeeping up:Keeping up: Latin America, Mid East, Latin America, Mid East, China China Falling further behind:Falling further behind: E.g, India, AfricaE.g, India, Africa
User Requirements
In ALL countries and in ALL disciplines researchers are eagerly anticipating improved networking tools. There is no divide on the demand-side. Sciences, such as particle physics, which make heavy use of advanced networking, must help to break down any divide on the supply-side, or else declare themselves elitist and irrelevant to researchers in essentially all developing countries.
Connectivity pricing and competition
In some locations the price of connectivity is (really) unreasonably high
Linked (obviously) to how competitive the market is Strong competition on routes between various key
European cities, and between major national centres Less competition effectively none as you move to
countries with de facto monopoly or simply to parts of countries where operators see little reason to invest.
While some expensive routes are where you would expect, others are much more surprising (at first sight), like Canterbury and Lancaster (UK) and parts of Brittany (F)
Understanding transmission costs and DIY solutions
Own trenching only makes sense in very special cases. Say 1-30 km. Even then look for partners.
Maybe useful (as a threat) over longer distances in countries with crazy pricing
Now possible to lease (short- or long-term) fibres on many routes in Europe [0.5 to 2 KEuro/km Typ.]
Transmission costs jump at ~200 km [below which you can operate with “Nothing In Line” (NIL), above which you need amplifiers] and ~800 km [above which you need signal regenerators]
Possibly leading to some new approaches in GEANT-2 implementation
AN INTERESTING STUDY AN INTERESTING STUDY MADE BY FUNDAÇÃO GETULIO MADE BY FUNDAÇÃO GETULIO
VARGAS - BRAZIL.;VARGAS - BRAZIL.;REPORTED by A. Santoro (UERJ)REPORTED by A. Santoro (UERJ)
July 11 SCIC MeetingJuly 11 SCIC Meeting
Digital InclusionDigital Inclusion
0,00 0,00 0,000,00Computer InternetComputer Internet
Until 2001, only 12,46% of Brazilians had Access to a PC and 8,31% to Internet
% Having :PC - Internet - % Total Pop.
BRAZIL: Access to a PC, and to the Internet Vs. Yrs. of StudyBRAZIL: Access to a PC, and to the Internet Vs. Yrs. of Study
0 YEARS TO 4 YEARS 4 TO 8 YEARS 8 TO 12 YEARS MORE THAN 12 YEARS
~1/3 of those with Access to a PC and to the Internet is concentrated in the hands of the 6% of the population who
graduated from high school
Limited by many externalsystemic
factors: Electricity;
Import Duties;Education; Trade
restrictions
Jensen, ICTP
Progress in Africa ?
Application Empowerment of Global Systems: Key Role of HENP
Application Empowerment of Global Systems: Key Role of HENP
Effective use of networks is vital for the existence Effective use of networks is vital for the existence and daily operation of Global Collaborationsand daily operation of Global Collaborations
Physicists today face the greatest challenges in terms of Physicists today face the greatest challenges in terms of Data intensiveness; volume and complexityData intensiveness; volume and complexity Distributed computation and storage resourcesDistributed computation and storage resources Global dispersion of many cooperating research teams Global dispersion of many cooperating research teams
Physicists and computer scientists have become Physicists and computer scientists have become leading co-developers of networks and global systems leading co-developers of networks and global systems Building on a tradition of building next-generation systemsBuilding on a tradition of building next-generation systems
that harness new technologies in the service of science that harness new technologies in the service of science Mission OrientationMission Orientation
Tackle the hardest problems, to enable the science, maintaining a Tackle the hardest problems, to enable the science, maintaining a years-long commitmentyears-long commitment
Broad Applicability to Other Fields of Research, SocietyBroad Applicability to Other Fields of Research, Society
Scaling to Handle Thousands of Simultaneous RequestsScaling to Handle Thousands of Simultaneous Requests Including the Network as a Dynamic, Managed ResourceIncluding the Network as a Dynamic, Managed Resource
Co-Scheduled with Computing and StorageCo-Scheduled with Computing and Storage Maintaining a Maintaining a Global ViewGlobal View of Resources and System State of Resources and System State
End-to-end MonitoringEnd-to-end Monitoring Adaptive Learning: New paradigms for optimization, Adaptive Learning: New paradigms for optimization,
problem resolution problem resolution Balancing Policy Against Moment-to-moment Capability Balancing Policy Against Moment-to-moment Capability
High Levels of Usage of Limited Resources Versus High Levels of Usage of Limited Resources Versus Better Turnaround Times for Priority TasksBetter Turnaround Times for Priority Tasks
Strategic Workflow Planning; Strategic RecoveryStrategic Workflow Planning; Strategic Recovery An Integrated User Environment An Integrated User Environment
User-Grid Interactions; Progressive AutomationUser-Grid Interactions; Progressive Automation Emerging Strategies and GuidelinesEmerging Strategies and Guidelines
Next Generation Grid Challenges: Next Generation Grid Challenges: Workflow Management & OptimizationWorkflow Management & Optimization
Grid Enabled Analysis: View Grid Enabled Analysis: View of a Collaborative Desktop of a Collaborative Desktop
PDAPDAROOTROOT
ClarensClarensClarensClarens
External Services
MonaLisaMonaLisaBrowserBrowserIguanaIguana
VO
ManagementAuthentication Authorization Logging Key Escrow
File Access
Shell
Storage Resource
Broker
CMS ORCA/COBRA
Cluster Schedulers
ATLAS DIAL
Griphyn VDT
MonaLisa Monitoring
Building the GAE is the “Acid Test” for Grids; and isBuilding the GAE is the “Acid Test” for Grids; and iscrucial for next-generation experiments at the LHCcrucial for next-generation experiments at the LHC Large, Diverse, Distributed Community of usersLarge, Diverse, Distributed Community of users Support hundreds to thousands of analysis tasks,Support hundreds to thousands of analysis tasks,
shared among dozens of sites shared among dozens of sites Widely varying task requirements and prioritiesWidely varying task requirements and priorities Need Priority Schemes, robust authentication and SecurityNeed Priority Schemes, robust authentication and Security
Relevant to the future needs of research and industryRelevant to the future needs of research and industry
Current ProblemsCurrent Problems
Siting of the Earth Station - UzbekistanAUPs – ArmeniaLicence - ArmeniaExistence of NREN – TurkmenistanShortage of Bandwidth – GeorgiaNumber of Earth Stations – KazakhstanMarginal transmitters – putting in amplifiers
Scaling to Handle Thousands of Simultaneous RequestsScaling to Handle Thousands of Simultaneous Requests Including the Network as a Dynamic, Managed ResourceIncluding the Network as a Dynamic, Managed Resource
Co-Scheduled with Computing and StorageCo-Scheduled with Computing and Storage Maintaining a Maintaining a Global ViewGlobal View of Resources and System State of Resources and System State
End-to-end MonitoringEnd-to-end Monitoring Adaptive Learning: New paradigms for optimization, Adaptive Learning: New paradigms for optimization,
problem resolution problem resolution Balancing Policy Against Moment-to-moment Capability Balancing Policy Against Moment-to-moment Capability
High Levels of Usage of Limited Resources Versus High Levels of Usage of Limited Resources Versus Better Turnaround Times for Priority TasksBetter Turnaround Times for Priority Tasks
Strategic Workflow Planning; Strategic RecoveryStrategic Workflow Planning; Strategic Recovery An Integrated User Environment An Integrated User Environment
User-Grid Interactions; Progressive AutomationUser-Grid Interactions; Progressive Automation Emerging Strategies and GuidelinesEmerging Strategies and Guidelines
Next Generation Grid Challenges: Next Generation Grid Challenges: Workflow Management & OptimizationWorkflow Management & Optimization
Seattle
Portland
D enverSan Francisco
San Diego Phoenix
Santa Theresa
Las Vegas
Kansas City
Dallas
A ustin
Fort W orth
St. Louis
Nashville
Washington D.C.Baltim ore
Boston
Buffalo
Toronto
Montreal
Louisville
Cincinnati
Detroit
Richm ondNorfolk
New YorkW eehawkenStamford
Houston
Om aha
MinneapolisGreen Bay
Milwaukee
C hicago
San Antonio
Sacramento
Los Angeles
New Orleans
Tam pa
Miami
AtlantaBirmingham
Memphis
Raleigh
Durham
Charlotte
Orlando
San Luis Obispo
San Jose
PhiladelphiaW ilmington
ClevelandS alt Lake City
H artford
Jacksonville
OaklandIndianapolis
Mobile
Pittsburgh
Irvine
Syracuse
Colum bus
Newark
Tulsa
Oklahoma City
A lbany
W hite Plains
Available fiber topology
Leading & Emerging Regional Optical Initiatives
California (CALREN) Colorado (FRGP/BRAN) Connecticut (Connecticut Education Network) Florida (Florida LambdaRail) Indiana (I-LIGHT) Illinois (I-WIRE) Maryland, D.C. & northern Virginia (MAX) Michigan Minnesota New York + New England region (NEREN) North Carolina (NC LambdaRail) Ohio (Third Frontier Network) Oregon Rhode Island (OSHEAN) SURA Crossroads (southeastern U.S.) Texas Utah Wisconsin