arin engineering report
DESCRIPTION
ARIN Engineering Report. Mark Kosters. Engineering Theme. 2012 s uccess is being aided by contractors (but not near as many) The search is on to fill open engineering slots Lots of work is done, but there is much more to do. Staffing. Operations 5 People + Manager (down 1 since ARIN 29) - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/1.jpg)
ARIN Engineering
Report
Mark Kosters
![Page 2: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/2.jpg)
Engineering Theme• 2012 success is being aided by
contractors (but not near as many)
• The search is on to fill open engineering slots
• Lots of work is done, but there is much more to do
22
![Page 3: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/3.jpg)
Staffing• Operations
– 5 People + Manager (down 1 since ARIN 29)– 2 DBA slots open
• Development– 5 Developers + Manager– 2 Contractors (down 3 more since ARIN 29)
• Quality Assurance– 3 QA + Manager– 4 Contractors
• Project Management– 1 Filled! (up 1 since ARIN 29)
• Management– 1 (me)
33
![Page 4: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/4.jpg)
Operations• Upgrading end-of-life equipment
• Maintaining the various environments we have running (Production/OT&E/Dev/QA/Staging)
• Load Balancer challenges
• Moving production to the colocation facility
• IT support
• RPKI rollout
44
![Page 5: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/5.jpg)
Whois-RWS Traffic Loads
• Running “normally” now at 405 queries per second (QPS)– down 70 QPS since last meeting
• RESTful calls have overtaken Port 43 calls since March
• 1.5 Billion RESTful calls for September• 1.1 Billion Port 43 queries
55
![Page 6: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/6.jpg)
Whois-RWS StatisticsQueries on Port 43
Months
Qu
eri
es P
er
Secon
d
6
2001-072002-062003-052004-042005-032006-022007-012007-122008-112009-102010-092011-082012-070.00
500.00
1000.00
1500.00
2000.00
2500.00
3000.00
3500.00
4000.00
6
![Page 7: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/7.jpg)
Whois-RWS Statistics Queries
Months
Tota
l Q
ueri
es
(x10000)
0
2000000000
4000000000
6000000000
8000000000
10000000000
12000000000
RESTful Web Whois Port 43
7
![Page 8: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/8.jpg)
Whois-RWS – IPv6To
tal P
er
Mon
th
Month
8
2010
-09
2010
-11
2011
-01
2011
-03
2011
-05
2011
-07
2011
-09
2011
-11
2012
-01
2012
-03
2012
-05
2012
-07
2012
-09
0
2000000
4000000
6000000
8000000
10000000
12000000
14000000
Port 80Port 43
![Page 9: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/9.jpg)
9
Web Traffic V4 versus V6
19,228,325IPv4
2,815,272IPv6
12.77% Traffic on the website is IPv6
BUT….
![Page 10: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/10.jpg)
10
Web Traffic IPv4 versus IPv6
Take out the IPv6 connectivity testersIPv6 is 4.05% of our total traffic
19,228,325Ipv4
893,698 IPv6
![Page 11: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/11.jpg)
Development/QA• Improvements to existing systems• ARIN Online releases since ARIN
XXVIII– RPKI!– Integrated payments–Move from Red Hat JBoss to JBoss AS7
Community Edition– Runout functionality enhancements for
staff– Various minor bug fixes
1111
![Page 12: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/12.jpg)
Initiatives Currently Underway
• Implement delegated RPKI • Extended statistics generation• Improvements to internal billing
systems• Move from Oracle to PostgreSQL
12
![Page 13: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/13.jpg)
How is ARIN Online used?• 62,998 accounts activated since
inception through Q3 of 2012
2008
2009
2010
2011
2012*
Number of Accounts Activated
5000 10000 15000 20000
* Through Q3 of 2012
13
![Page 14: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/14.jpg)
Active Usage of ARIN Online
0 1 2 - 5 6 - 10 11 - 15 >160
5000
10000
15000
20000
25000
30000
Logins
# o
f U
sers
Times logged in
14
![Page 15: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/15.jpg)
Reg-RWS (RESTful Provisioning)
Cumulative totals since April, 2011
REST
Templates
0 200000 400000 600000 800000 10000001200000
Transactions
15
RESTTemplates
0 20 40 60 80 10 12
Transactions
Today
At ARIN XXIX
![Page 16: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/16.jpg)
Evolution/Deployment of RPKI
• A brief look at– Pilot participation– Feedback– The move to production
16
![Page 17: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/17.jpg)
RPKI Pilot
• Pilot period– Operational from 7/2009 until 9/2012– 63 users– 76 ROAs in the pilot
• Services are still hooked into the Pilot– 15000 fetches per day at peak usage– Let signatures expire after production
deployment– 4000 fetches today on a empty
repository
17
![Page 18: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/18.jpg)
RPKI Pilot
• Feedback on the Pilot over the three years– Comments• Just one -“weird passwords”
–Operational Learning• People noticed for a time when signatures
expired• A few data entries did not match global
routing entries
18
![Page 19: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/19.jpg)
19
Production RPKI
• Getting the Trust Anchor– 27 people have signed the RPA– 17 people are non-RIR members
• Signing Resources– 7 Organizations– 19 ROAS– 30 Networks/ASs
![Page 20: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/20.jpg)
20
RPKI Results
• No real landrush to join• Is it still in the experimental stage?• Has been a multi-year effort– $2.5 Million – Very complex code
• Hope it has success in the long run
![Page 21: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/21.jpg)
21
Maybe this will be like the IRR• Low usage when started multi-month
project to upgrade the IRR• Report from ARIN XXVIII showed low
usage which in turn called into question the need to upgrade
![Page 22: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/22.jpg)
IRR Usage From 2009-2Q/2011
2009 2010 2Q/20110
100020003000
Insertions/Changes
0
100
200
300
400
Active Maintainers
In YearSince 2009
442 Insertions by one maintainer
22
![Page 23: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/23.jpg)
23
Now the Traffic on IRR has gone up after Upgrade in Sept 2011• Maintainers– 1,682 pre-conversion– 1,812 today
• Routes– 17,937 pre-conversion– 20,513 today
• Networks– 456 pre-conversion– 539 today
![Page 24: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/24.jpg)
RPKI Challenges• Protocol is mature – kind of
– Validators do not allow for extension that we require (certificate policies extension)
– Draft is to be written within the IETF to explicitly mention this
– Rsync may not be the best protocol to retrieve data from repositories – quickly becomes a DDOS vector
– Work on a HTTP transport for getting data from repositories
• Challenges– ERX and Inter-RIR Transfers– Merging with the Global Trust Anchor– Simultaneous operation of RIR Trust Anchor and
Global Trust Anchor
24
![Page 25: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/25.jpg)
Schedule Pressure– ACSP Suggestions (8 Pending)– DNSSEC improvements– Streamlined Transfer Service– CMSD membership/voter functionality– Integration of IRR within ARIN Online– Lame Delegation reporting– Additional OT&E services– Alternative RPKI-like services– Billing Management Improvements
25
![Page 26: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/26.jpg)
Schedule Pressure
• Community needs/Policy– Ways to better vet/implement community needs – Need to hear from you
• Technical and Operational debt– Many existing internal processes are inefficient and labor
intensive– Software changes
• Thought Leadership– Whois-RWS– RPKI– Research
26
![Page 27: ARIN Engineering Report](https://reader035.vdocuments.mx/reader035/viewer/2022062408/5681356d550346895d9cd234/html5/thumbnails/27.jpg)
Comments?
27