efi.uchicago.edu ci.uchicago.edu fax status report ilija vukotic computation and enrico fermi...

efi.uchicago.educi.uchicago.edu

FAX status report

Ilija Vukotic

Computation and Enrico Fermi InstitutesUniversity of Chicago

US ATLAS Computing Integration and Operations MeetingApril 16, 2014

efi.uchicago.educi.uchicago.edu

2

Global Deployment Status

CloudT1s T2Ds T2

Done Total Done Total Done TotalCA 0 1 1 4 0 1US 1 1 5 6 1 2FR 0 1 2 8 0 6DE 1 1 7 9 2 5IT 1 1 3 3 1 1ES 0 1 0 4 0 2NL 0 2 1 2 1 9UK 1 1 8 10 2 7TW 1 1 - - 0 1ND 0 1 - - 0 3CERN 1 1 - - - -RU 0 1 - - - -Total 6 13 27 46 7 37

• SFU-LCG2 (CA cloud) joined– Direct dCache – Connected to xrd-

central• Mayor T1s missing

– CA –TRIUMF – good progress

– ES – pic – working with them

– FR – Lyon – progress stalled

– NL – Sara, Nikhef – no progress

efi.uchicago.educi.uchicago.edu

3

North American Redirectors

• Restructuring of the redirection tree in North America• Hosted at BNL; FAX operations team provides configuration

and operational support– atlas-xrd-us.usatlas.org

o North American region– atlas-xrd-east.usatlas.org

o -BNL, BU, Victoria, Scinet– atlas-xrd-central.usatlas.org

o MWT2, AGLT2, OU, SWT2– atlas-xrd-west.usatlas.org

o SLAC, TRIUMF, McGill, SFU

• Status and timeframe:– Hosts and configurations ready. Waiting for git repository’s

connection.

efi.uchicago.educi.uchicago.edu

4

Global SSB: most sites are stable

efi.uchicago.educi.uchicago.edu

5

US FAX status: past three months

efi.uchicago.educi.uchicago.edu

6

Operational• Network

saturation occurrence at FZK-LCG2

• ALICE analysis is suspect

• If it needs an analysis to find who/what is responsible, then the monitoring is inadequate.

FTS

XROOT

Throughput

Throughput Transfers finished

Transfers finished

efi.uchicago.educi.uchicago.edu

7

Cost Matrix - US

• Averaged over last week

DEFINITION: Rate in MB/s measured between WN and a FAX endpoint

efi.uchicago.educi.uchicago.edu

8

Failover Statistics – last two weeks

efi.uchicago.educi.uchicago.edu

9

Testing & Development

• New dCache redirector plugin developed– Provides simpler federating, improves efficiency and stability of

dCache endpoints.

• 100Gbps tests as soon as MWT2-BNL circuit available

• Testing overflow now the new test pilot is available

• Working with EOS on finding solution to a too many DDM endpoints issue

• Wei continuously testing using input files from analysis jobs.

• Restarting frameworks measuring and following IO characteristics of ATLAS data formats – in particular xAOD.

efi.uchicago.educi.uchicago.edu

10

Cost matrix

Yesterday Last 30 days

efi.uchicago.educi.uchicago.edu

11

EXTRA