ssl - indico.cern.ch€¦ · ssl scalable systems laboratory for innovation & integration...
TRANSCRIPT
![Page 1: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/1.jpg)
SSLScalable Systems Laboratory for Innovation & Integration
IRIS-HEP Steering Board MeetingFebruary 6, 2019
Rob GardnerEnrico Fermi InstituteUniversity of Chicago
1
![Page 2: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/2.jpg)
IRIS-HEP SSL Purpose
● Provide the Institute and the HL-LHC experiments with scalable platforms needed for development in context
● Provides access to infrastructure and environments ● Organizes software and resources for scalability testing ● Does foundational systems R&D on accelerated services● Provides the integration path to the OSG-LHC
production infrastructure
2
![Page 3: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/3.jpg)
SSL Team & Resources
● Small core group to support base environment● Dynamically draws effort from R&D pillars● Interfaces to OSG-LHC and LHC Ops ● Organizes leveraged resources needed to scale
3
![Page 4: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/4.jpg)
SSL Team
● Still in formation at this point● Plan (to be revised with specific hires)
○ 0.05 FTE - rwg - coordination○ 0.02 FTE - A. Chien - CS research○ 0.33 FTE - UC - Offer accepted, 2/25○ 0.33 FTE - UC - devOps engineer (TBN)○ 0.40 FTE - UCSD - Edgar/Igor○ 0.25 FTE - UC - CS grad student (TBN)
4
![Page 5: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/5.jpg)
Components and Practice
● A number of core IRIS-HEP SSL services will be defined resulting from requirements gathering○ Shared (cross-experiment, cross-pillar) dev environment
● The SSL will support the HL-LHC R&D activities of the LHC Ops programs
5
![Page 6: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/6.jpg)
SSL and ATLAS ADC
● The SSL can provide a shared development and integration platform for ATLAS Distributed Computing activities
● Introduced SSL at US ATLAS Computing Facility meeting at Argonne in December
● SSL will support XCache DevOps
6
![Page 7: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/7.jpg)
SSL and NSF CC* Proposals
● NSF soliciation for Campus Cyberinfrastructure○ https://www.nsf.gov/publications/pub_summ.jsp?ods_ke
y=nsf19533○ Potential resources contributing to SSL
● Offering help to support CC* proposals from IRIS-HEP affiliated campuses
● Narrative input: http://bit.ly/ccstar-iris-hep
7
![Page 8: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/8.jpg)
Extra Slides
8
![Page 9: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/9.jpg)
9
SSL: Path to Production
Provisioning of software environments and development tools.
Distributed platforms materialized with tools like containerized edge services.
Integration point with the OSG and LHC experiment services (data, analysis).
![Page 10: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/10.jpg)
Example: DOMA simulators
● Major theme in WLCG-DOMA is R&D on new data architectures capable of HL-LHC scales
● SSL to facilitate prototyping
10
![Page 11: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/11.jpg)
Example: systems R&D
● Another major theme is system scalability R&D
● In DOMA this might be a hardware accelerated intelligent data delivery service
● In AS this might be used in a declarative or "low-latency" analysis platform
11
![Page 12: SSL - indico.cern.ch€¦ · SSL Scalable Systems Laboratory for Innovation & Integration IRIS-HEP Steering Board Meeting February 6, 2019 Rob Gardner Enrico Fermi Institute](https://reader036.vdocuments.mx/reader036/viewer/2022071219/6056ae5b4b9be512ea077c28/html5/thumbnails/12.jpg)
12
Scenario:
Develop new third-party copy software (TPC)
Requires three orchestrated four orchestrated services plus control host
Labeled, reproducible:Micro deploymentWAN deploymentScaled deployment
Carved storage - block devices
iDDS_XdeployTPC_X
micro-deploy
<= scale out
WAN
SSL-contribLab-X, univ-Y
metrics, curated profiles
SSL-base
labeled deployments "handles"
SSL instance (1 or more)
Dev enviro <-- miniSSL (cf minikube, minislate)