Presenters:Presenters:Chris White – Oregon State UniversityChris White – Oregon State UniversityKarl Vollmer – Oregon State UniversityKarl Vollmer – Oregon State UniversityChris Giem – Oregon State UniversityChris Giem – Oregon State University

Traffic Shaping & Quotas Traffic Shaping & Quotas w/Cisco's SCEw/Cisco's SCE

• Background & History

• Implementation & Configuration

• Network Architecture

• Future Plans

• Questions

Oregon State UniversityOregon State UniversityCorvallis, OregonCorvallis, Oregon

• 19,500 total students19,500 total students

• 15,900 undergrads15,900 undergrads

• 3,700 on-campus residents 3,700 on-campus residents supported by ResNetsupported by ResNet

• OSU Public Wireless network OSU Public Wireless network for all student, staff, & facultyfor all student, staff, & faculty

Shaping History Shaping History

• Problems: network saturation, bandwidth abuse, Problems: network saturation, bandwidth abuse, copyright infringementcopyright infringement

• Packeteer Packetshaper 6500 was the perfect Packeteer Packetshaper 6500 was the perfect solution for ResNetsolution for ResNet

• Enabled ResNet to implement bandwidth shaping, Enabled ResNet to implement bandwidth shaping, quotas, & block hard-coded IPsquotas, & block hard-coded IPs

•• Thinking ahead: more speed, what will our Thinking ahead: more speed, what will our problems be, how to solve themproblems be, how to solve them

Our SaviorOur Savior• Found Cisco SCE 2000 (service control engine)Found Cisco SCE 2000 (service control engine)

• (2) 1Gb/s Subscriber interfaces(2) 1Gb/s Subscriber interfaces• (2) 1Gb/s Network interfaces(2) 1Gb/s Network interfaces• No hard drives to fail, configuration separated from deviceNo hard drives to fail, configuration separated from device• Zero downtime for policy & firmware updatesZero downtime for policy & firmware updates• Less expensive then comparable Packeteer PSLess expensive then comparable Packeteer PS

Whahh!? The Cisco box is Whahh!? The Cisco box is less expensive?!less expensive?!

• Packeeter 6500Packeeter 6500– (1) 100Mb/s Subscriber Interface(1) 100Mb/s Subscriber Interface

– (1) 100Mb/s Network Interface(1) 100Mb/s Network Interface

– Web Interface, Data collection (HDD)Web Interface, Data collection (HDD)

Network DevicesNetwork Devices

Packeeter Hardware ConfigurationPackeeter Hardware Configuration

ServersServers• Collection ManagerCollection Manager

– Integrated into Network DeviceIntegrated into Network Device

• Subscription ManagerSubscription Manager– N/AN/A

• Quota ManagerQuota Manager– N/AN/A

• SCE 2000SCE 2000– (2) 1Gb/s Subscriber interfaces(2) 1Gb/s Subscriber interfaces

– (2) 1Gb/s Network interfaces(2) 1Gb/s Network interfaces

– (2) 100Mb/s management interfaces(2) 100Mb/s management interfaces

Network DevicesNetwork Devices

SCE Hardware ConfigurationSCE Hardware Configuration

ServersServers• Collection ManagerCollection Manager

– Redhat Enterprise server (MySQL)Redhat Enterprise server (MySQL)

• Subscription ManagerSubscription Manager– Redhat Enterprise server (SM service)Redhat Enterprise server (SM service)

• Quota ManagerQuota Manager– Redhat Enterprise server (QM service)Redhat Enterprise server (QM service)

SCE Policy HierarchySCE Policy Hierarchy

SCE Policy HierarchySCE Policy Hierarchy

• 62.5 Mb/s Total Commodity 62.5 Mb/s Total Commodity • 5Mb/s (in) 2.5Mb/s (out) Bittorrent 5Mb/s (in) 2.5Mb/s (out) Bittorrent • 1Mb/s P2P 1Mb/s P2P • 1Mb/s Newsgroups 1Mb/s Newsgroups

Global Rules Global Rules

ResNet Policy ConfigurationResNet Policy Configuration

Subscriber RulesSubscriber Rules• Highest Priority GamingHighest Priority Gaming• Lowest Priority P2P, Bittorrent, NewsgroupsLowest Priority P2P, Bittorrent, Newsgroups• 400Kb/s Bittorrent 400Kb/s Bittorrent • 92Kb/s VOIP92Kb/s VOIP

• (2) Servers(2) Servers– Traffic monitoring of 2300 IP’s per serverTraffic monitoring of 2300 IP’s per server– In house Python script for user quota and trackingIn house Python script for user quota and tracking– Update of rate limited, blocked users once per minUpdate of rate limited, blocked users once per min

Packeeter 6500 Packeeter 6500

User & Quota TrackingUser & Quota Tracking

SCE 2000SCE 2000• (1) Server (1) Server [ Currently not in Production][ Currently not in Production]

– Subscription manager & Quota Manager managing ~10,000 Subscription manager & Quota Manager managing ~10,000 IP’s IP’s

– In house C++ application leveraging Cisco API for In house C++ application leveraging Cisco API for subscriber to IP mappingssubscriber to IP mappings

– Update of rate limited users once every ~15 secondsUpdate of rate limited users once every ~15 seconds

SCE Graphs of Shaped TrafficSCE Graphs of Shaped Traffic

Switch Interface StatisticsSwitch Interface Statistics

• Web InterfaceWeb Interface– Manual Addition of subscribersManual Addition of subscribers– Bulk Modification of current subscribersBulk Modification of current subscribers– Reporting Tools and Statistical InformationReporting Tools and Statistical Information

Subscription ManagerSubscription Manager

Future Development PlansFuture Development Plans

• Web InterfaceWeb Interface– Manual Reset of subscriber quotaManual Reset of subscriber quota– Bulk Modification of subscriber quotaBulk Modification of subscriber quota– Reporting Tools and Statistical InformationReporting Tools and Statistical Information

Quota ManagerQuota Manager

Cisco SCE 2000

http://cisco.com/en/US/products/ps6151/

Cisco SCE 1000

http://cisco.com/en/US/products/ps6150/

Presentation Evaluations

http://resnetsymposium.org/resnet2007/