ways to connect to osg tuesday afternoon, 3:00 pm lauren michael research computing facilitator...
TRANSCRIPT
![Page 1: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/1.jpg)
Ways to Connect to OSGTuesday afternoon, 3:00 pm
Lauren Michael <[email protected]>Research Computing Facilitator
University of Wisconsin-Madison
![Page 2: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/2.jpg)
2015 OSG User School
Overview
• Types of OSG submit points
• OSG Virtual Organizations(members of OSG consortium)
• Other OSG submit pointsOSG ConnectOSG Connect ClientOSG via XSEDE
2
![Page 3: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/3.jpg)
2015 OSG User School
Overview
• Types of OSG submit points
• OSG Virtual Organizations(members of OSG consortium)
• Other OSG submit pointsOSG ConnectOSG Connect ClientOSG via XSEDE
3
![Page 4: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/4.jpg)
2015 OSG User School
HTC Submit Point
Submit Node
HTCondor Pool
(or other type of Cluster)
![Page 5: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/5.jpg)
2015 OSG User School
HTC Submit Point
Submit Node
HTCondor Pool
(or other type of Cluster)
osg-ss-submit
![Page 6: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/6.jpg)
2015 OSG User School
OSG Submit Points
6
OSG(>120 sites)
Submit Node
HTCondor Pool
(or other Cluster)
OSG entry point
specific to VO
![Page 7: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/7.jpg)
2015 OSG User School
OSG Submit Points
7
OSG(>120 sites)
Submit Node
HTCondor Pool
(or other Cluster)
Submit Node
OSG entry point
![Page 8: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/8.jpg)
2015 OSG User School
OSG Submit Points
8
OSG(>120 sites)
Submit Node
HTCondor Pool
(or other Cluster)
Submit Node
OSG entry point
osg-ss-glidein-submit
![Page 9: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/9.jpg)
2015 OSG User School
OSG Submit Points
9
OSG(>120 sites)
Submit Node
HTCondor Pool
(or other Cluster)
Submit Node
OSG entry point
![Page 10: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/10.jpg)
2015 OSG User School
Accessing an OSG Submit Point – 4 Ways
• Local Virtual Organization (VO) campus, national lab, or research organization that is
part of the OSG consortium
• OSG Connect an OSG VO for individuals without a local VO
OSG Connect Client use another cluster submit/head node as an OSG
submit point
• XSEDE collection of HPC clusters available to U.S. academics
via allocations of compute hours
10
![Page 11: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/11.jpg)
2015 OSG User School
OSG entry point
Access Methods: Local VO
11
OSG(>120 sites)
Submit Node
HTCondor Pool
Submit Node
![Page 12: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/12.jpg)
2015 OSG User School
HTCondor Pool
(or other type of Cluster)
OSG entry point
Other Access Methods:
12
OSG(>120 sites)
Submit Node
Submit Node
OSGConnectXSEDE
ConnectClient
![Page 13: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/13.jpg)
2015 OSG User School
*not all XSEDE Campus Champions will have experience with HTC or OSG
Accessing an OSG Submit Point – 4 Ways
13
Local VO OSG Connect Connect Client XSEDE
Available tousers with a
campus/org VOaffiliates of U.S. research orgs
users of cluster with Connect Client
users with XSEDE allocation
Cost unlikely FREE unlikelyNO
(but need allocation)
Limit on CPU hrs
unlikely NO NOYES
(per allocation)
Local Helpvery likely (local staff)
unlikelypossibly
(cluster staff)possibly*
(Campus Champion)
Online Guides likely YES YES limited
Submit Point Type
submit server(or direct OSG entry server)
direct OSG entry server
cluster submit node to OSG entry server
submit node to OSG entry server
![Page 14: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/14.jpg)
2015 OSG User School
Accessing an OSG Submit Point – 4 Ways
• Local Virtual Organization (VO) campus, national lab, or research organization
that is part of the OSG consortium
• OSG Connect an OSG VO for individuals without local OSG support
OSG Connect Client use another cluster submit server as a submit point
• XSEDE collection of HPC clusters available to U.S. academics
via allocations of compute hours
14
![Page 15: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/15.jpg)
2015 OSG User School
Virtual Organization (VO)
• institution or research project that is part of the OSG consortium
• accounts and access determined by local VO administrators
• most offer user support or specialized interfaces for their specific setup and population of users
How do I determine whether my organization is/has a VO?
15
![Page 16: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/16.jpg)
2015 OSG User School
… to the real world
16
![Page 17: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/17.jpg)
2015 OSG User School
… to the real world
17
![Page 18: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/18.jpg)
2015 OSG User School
… to the real world
18
![Page 19: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/19.jpg)
2015 OSG User School 19
![Page 20: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/20.jpg)
2015 OSG User School
Using OSG through a VO
1. Determine whether there is a local VO for your institution/organization.
2. Get an accountContact the administrators to get an account on their glidein server (or submit node tied to a glidein server).
3. Submit jobsFollow site-specific guides and/or submit jobs as you have been at the OSG School.
20
![Page 21: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/21.jpg)
2015 OSG User School
Accessing an OSG Submit Point – 4 Ways
• Local Virtual Organization (VO) campus, national lab, or research organization that is
part of the OSG consortium
• OSG Connect an OSG VO for individuals without local OSG support
OSG Connect Client use another cluster submit server as a submit point
• XSEDE collection of HPC clusters available to U.S. academics
via allocations of compute hours
21
![Page 22: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/22.jpg)
2015 OSG User School
OSG Connect
22
• Essentially, a VO available to those without a Local VO
• Free for affiliates/partners of U.S. research institutions
• Submit from OSG Connect server or use Connect Client on another cluster
• OSG ConnectBook has online guide information and contact info for help
![Page 23: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/23.jpg)
2015 OSG User School 23
![Page 24: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/24.jpg)
2015 OSG User School 24
Details and hands-on exercises after this
coming next!
![Page 25: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/25.jpg)
2015 OSG User School
Accessing an OSG Submit Point – 4 Ways
• Local Virtual Organization (VO) campus, national lab, or research organization that is
part of the OSG consortium
• OSG Connect an OSG VO for individuals without local OSG support
OSG Connect Client use another cluster submit server as a submit point
• XSEDE collection of HPC clusters available to U.S.
academics via allocations of compute hours
25
![Page 26: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/26.jpg)
2015 OSG User School
OSG via
26
• XSEDE: a consortium of HPC clusters and other computational services available to academics in the U.S.
• free accounts, but you must request an XSEDE allocation of compute hours
• limited online guides specific to OSG-XSEDE, but similar to submission via osg-ss-glidein-submit
![Page 27: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/27.jpg)
2015 OSG User School
Using OSG via
27
1. Sign up for an XSEDE account.
2. Request an OSG allocationvia the XSEDE User Portal to request a startup (or long-term) allocation of compute hours for OSG.
3. Follow XSEDE’s guides for connecting to and using the OSG submit server.
4. Submit jobs as you have been at the school, making sure to indicate your XSEDE project name (allocation code).
![Page 28: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/28.jpg)
2015 OSG User School 28
![Page 29: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/29.jpg)
2015 OSG User School
… to the real world
29
![Page 30: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/30.jpg)
2015 OSG User School
… to the real world
30
![Page 31: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/31.jpg)
2015 OSG User School
Overview
• Types of OSG submit points
• OSG Virtual Organizations(members of OSG consortium)
• Other OSG submit pointsOSG ConnectOSG Connect ClientOSG via XSEDE
31
![Page 32: Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison](https://reader035.vdocuments.mx/reader035/viewer/2022070407/56649e365503460f94b2501f/html5/thumbnails/32.jpg)
2015 OSG User School
Questions?
• Feel free to contact me: [email protected]
• Next: OSG Connect and Connect Client 3:30-4:00pm, Intro by David
• Then: 4:00pm-5:00pm, Using OSG Connect and
Connect Client (hands-on) End, Day 2
32