shouldnt high-performance networks be as easy to use as the web? basil irwin senior network engineer...

30
Shouldn’t High-Performance Shouldn’t High-Performance Networks Be As Easy To Use Networks Be As Easy To Use As the Web? As the Web? Basil Irwin Basil Irwin Senior Network Engineer Senior Network Engineer NETS NETS July 13, 1999 July 13, 1999 National Center for Atmospheric National Center for Atmospheric Research Research

Upload: benjamin-sheridan

Post on 27-Mar-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

Shouldn’t High-Performance Shouldn’t High-Performance Networks Be As Easy To Use As the Networks Be As Easy To Use As the

Web?Web?

Basil IrwinBasil Irwin

Senior Network EngineerSenior Network Engineer

NETSNETS

July 13, 1999July 13, 1999

National Center for Atmospheric ResearchNational Center for Atmospheric Research

Page 2: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 22NCARNCAR

Yes!Yes!

Page 3: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 33NCARNCAR

How High-PerformanceHow High-PerformanceNetworks Work NowNetworks Work Now

Page 4: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 44NCARNCAR

What Happens TodayWhat Happens Today

•Fire up FTP on a >100-Mbps national network between two supercomputers or other high-performance hosts and you get 10-Mbps if you’re lucky

•How many have seen such behavior?

•And then what?*Do you have tools that tell you where the problem is?

*Or is it all just a big mystery as to why it doesn’t go fast?

Page 5: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 55NCARNCAR

And What About the Web?And What About the Web?

Page 6: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 66NCARNCAR

It Just Works!It Just Works!

Page 7: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 77NCARNCAR

Where Are The Problems?Where Are The Problems?

Page 8: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 88NCARNCAR

It’s Not The NetworkIt’s Not The Network

•Networks aren’t usually the problem* vBNS and Abilene are very high-performance

networks at the national level

*Universities are now frequently connected at least at T3 (45-Mbps) or higher

*Campus LANs and host connections for researchers are often capable of 100-Mbps

•Problems are usually in the host-software

Page 9: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 99NCARNCAR

So What’s Wrong WithSo What’s Wrong WithThe Host-Software?The Host-Software?

Page 10: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1010NCARNCAR

Lot’s Of Things Are WrongLot’s Of Things Are Wrong

•One of the biggest affects national-scale high-performance networks the worst * This is the so-called “bandwidth-delay-product”

issue

*Right now it takes network-engineer training to understand and deal with this issue

*A big part of many high-performance seminars for end-users is dealing with this issue

*Akin to having to be an auto mechanic to drive a car

Page 11: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1111NCARNCAR

The Problems (cont.)The Problems (cont.)

•Poor and inconsistent TCP implementations among operating system vendors

•Obscure programmatic interfaces (APIs) such as sockets that are difficult to use and lead to error/bad-performance prone user-codes

•And even worse, ALL problems have to be fixed to automatically obtain high-performance

Page 12: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1212NCARNCAR

Usability ProblemsUsability Problems

Page 13: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1313NCARNCAR

•Rotten FTP programs* Bad and inconsistent user-interfaces

•Lack of simple APIs optimized for common user needs

•No ubiquitous turnkey GUI-based diagnostic or performance monitoring tools* Still basically just have just “ping” and

“traceroute”, which have been around since the dawn of network computing

Usability ProblemsUsability Problems

Page 14: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1414NCARNCAR

Why Hasn’t The MarketWhy Hasn’t The MarketWorked?Worked?

•E-commerce development soaking up venture capital

•Vendors are focused on making money now, and often don’t take the long-term view

•Mass-market is often the major driver of high-technology and not vice-versa

•Solutions require uniformity to work well, and vendors tend to compete and not cooperate when strong standards don’t exist

Page 15: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1515NCARNCAR

How Do We FixHow Do We FixThese Problems?These Problems?

Page 16: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1616NCARNCAR

A Comprehensive SolutionA Comprehensive Solution

•Need an approach that fixes ALL host-software problems* Simply fixing this problem or that in isolation won’t

yield high-performance results

•Network researchers need to agree on what a comprehensive host-software solution is

•Operating system and other host-software vendors need to be induced to consistently install this comprehensive solution

Page 17: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1717NCARNCAR

A Comprehensive Solution A Comprehensive Solution (cont.)(cont.)

•Need a common vision that researchers, policy makers, and vendors can all relate to

•Need to demonstrate success with applications that everyone can relate to

Page 18: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1818NCARNCAR

How Can We Do This?How Can We Do This?

Page 19: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 1919NCARNCAR

A ProposalA Proposal

•Frame a comprehensive approach in terms of a Web that runs 100 faster than it does today

•Develop solutions into a complete, turnkey high performance network-enabled system that includes an operating system, a Web Server, a Web Browser, and common application/plug-ins such as FTP and give the system away!

•The National Science Foundation leads this effort

Page 20: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2020NCARNCAR

A Proposal (cont.)A Proposal (cont.)

•This approach:*Offers a common vision for success

* Provides a demonstration of success

* Is designed to induce vendors to adopt the improvements

Page 21: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2121NCARNCAR

Why A 100xWeb?Why A 100xWeb?

•A supercharged Web is something that everyone can understand and rally around*Goal for policy-makers

*Goal for users

*Goal for developers

•Fixing the problems inhibiting Web performance fixes them for other high-performance applications

•Web itself is one of the most important networking tools used by researchers today

Page 22: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2222NCARNCAR

Why Free Software?Why Free Software?

•Shows the value of high-performance networking-enabled system

•Hopefully, provides an inducement for commercial vendors to adopt the solutions*Replicates the ARPA model with BSD Unix and

TCP/IP sockets

* Propagated distribution of TCP/IP via BSD Unix, enabling the success of TCP/IP, and thereby inducing adoption by commercial vendors wishing to remain in business

Page 23: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2323NCARNCAR

Why the NSF?Why the NSF?

•History of involvement of government in critical networking technologies*DARPA and TCP/IP development

*WWW protocols invented at CERN

•History of NSF involvement in critical networking developments*NSFnet

*MOSAIC at NCSA

•Directly related to the goals of the NSF as an NGI partner

Page 24: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2424NCARNCAR

Why the NSF? (cont.)Why the NSF? (cont.)

•NSF may be the only organization in a position to meld the numerous and diverse pieces to solve the host-software problems

Page 25: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2525NCARNCAR

Example Development PlatformExample Development Platform

Page 26: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2626NCARNCAR

Example Development PlatformExample Development Platform

•Development platform needs:*An operating system

*A hardware platform

*A Web Server

*A Web Browser

•Development component choices require* Source code freely available

* Source code freely distributable

* Source code already widely used and supported

* Source code suitable for performing desired functions

Page 27: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2727NCARNCAR

Example Development PlatformExample Development Platform(cont.)(cont.)

•Components that appear to meet the four criteria:* Linux OS

* Intel hardware platform

*Netscape Web Browser

*Apache Web Server

Page 28: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2828NCARNCAR

ConclusionConclusion

Page 29: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 2929NCARNCAR

ConclusionConclusion

•We will continue to remain at the dawn of the high-performance networking era until these problems are solved

•Therefore a comprehensive effort should be made to solve the bulk of the host-software problems and provide a demonstration vehicle

•This won’t be easy and success isn’t guaranteed, but it’s vital that a bold attempt be made at a comprehensive solution

Page 30: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric

National Center for Atmospheric ResearchNational Center for Atmospheric Research 3030NCARNCAR

THE ENDTHE END