dcaf (decentralized analysis farm) korea chep fermilab (cdf) korcaf (dcaf in korea) kihyeon cho...
TRANSCRIPT
DCAF (DeCentralized Analysis Farm)DCAF (DeCentralized Analysis Farm)
Korea CHEP
Fermilab (CDF)
KorCAF (DCAF in Korea)
Kihyeon Cho (CHEP, KNU)
(On the behalf of HEP Data Grid Working Group)
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
Production FarmRef. Mark Neubauer
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
Stage 1 & 2 Feynman Computer C
enter (FCC) at Fermilab
for CDF Experiment 306 Dual CPUs and 1
80TByte
FCC (Feynman Computer Center)
CAF (Central Analysis CAF (Central Analysis Farm)Farm)
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
CAF design considered:
Submit jobs from 'anywhere‘
Job output can be sent directly to desktop or stored on CAF for later retrieval
Integer
CAF DesignCAF Design
Ref. Mark Neubauer
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
Requirement set by goal200 simultaneous users should analyze 107 events in a d
ayNeed ~700 TB of disk and ~5THz of CPU by end of FY’0
5 DCAF (DeCentralized Analysis Farm)
SAM (Sequential Access through Meta data) To handle real data at Fermilab for DCAF around worldGridification of DCAF via SAM Grid
KorCAF (DeCenteralized Analysis Farm in Korea)
Why DCAF and SAM for Why DCAF and SAM for CDF?CDF?
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
DCAF in Korea (KorCAF)
CAF or
Proposed Schemes for SAMGridProposed Schemes for SAMGrid
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
1TB buffer (FCC)
CAFGUI
ICAFGUI SAM Station (KCAF)
User Desktop
Remote Desktop
KCAF Head Node
rcp,
GridFTP
bbftp
cp
KCAF Cluster
FCC (CAF)
CHEP
(KCAF)
ICAF FTP server
CDFen(Raw Data)
dCache
rcp
fcdfsam
Smaster
FSS, Stager
stager
stager
TechnicalRequest
STKen
Calibration
Data
dCache
rcp
A Design of KorCAF for CDF (Fermilab) Grid
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
Schedule for DCAF & SAMGrid Schedule for DCAF & SAMGrid
Nov. 2002 – Installed JIM v0.0 and demo on SC2002
July-August 2003 – Installing DCAF v1.0 Oct. 2003 – To install JIM (Job Information
Management) v1.0 environment based on DCAF
Nov. 2003 – demo on SC2003 by users
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
Methods for SAMGrid for CDFMethods for SAMGrid for CDF
CAF(Central Analysis Farm)
current
Installing PBS batch
(each institutes)
CDF SAMGrid
DCAF(DeCentralized Analysis Farm)
SAM(for real data)
Current
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
Testbed at CHEPTestbed at CHEP
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
CDF Grid Testbed at CHEPCDF Grid Testbed at CHEP
DCAF: C73, C46~C49
(5 machines, 10 CPUs)
PBS Batch:
(20 machines, 23 CPUs)
Total Grid Test bed: 25 machines (33 CPUs)
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
Network Test (Parallel ftp’s are used) ~60 Mbps (155 Mbps/1Gbps) via Hyeonhae/Genkai ~30 Mbps ( 155 Mbps) via Star-tap
Daejeon
APIITEIN
…
CHEP
Seoul
Daegu
Busan
US Fermilab
2 x 155Mbps 1Gbps
155Mbps
155Mbps
40Gbps
Hyeonhae/IGenkai
…2 X 1Gbps
155Mbps
Network between CHEP Network between CHEP and Fermilaband Fermilab
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
SAM Grid
Fermi LabFermi Lab
Installation of DCAF & SAMGridInstallation of DCAF & SAMGrid
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
SAMGrid Monitoring Page SAMGrid Monitoring Page
KIHYEON CHOCENTER FOR HIGH ENERGY PHYSICS
SAMGrid demo was showed at SC2002. 6 institutes (KNU, Toronto, RAL, Rutgers, Texas Tech, Glasgo
w) were involved for CDF experiment. At KNU, 12 CPUs were allocated for SAM Grid Demo
UCSD made testbed for DCAF.
KorCAF(DCAF in Korea) is the first for analysis farm at CDF experiment as DCAF
For the first step, to use the KorCAF as MC production farm. Later, real data…
Prepare for SC2003 Demo for SAMGrid
DCAF ActivitiesDCAF Activities