www.see-grid-sci.eu see-grid-sci user interface (ui) installation and configuration branimir ackovic...
TRANSCRIPT
www.see-grid-sci.eu
SEE-GRID-SCI
User Interface (UI) Installation and Configuration
Branimir AckovicInstitute of Physics
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338
Regional SEE-GRID-SCI Training for Site Administrators
Institute of Physics BelgradeMarch 5-6, 2009
<Title>
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 2
Presentation Overview
• User Interface• User Certificates• Host Certificates• UI Installation• UI Configuration• Tweaking UI• Job types
• Job
• Collection
• Parametric
• DAG
• MPI
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 3
User Interface
• List all the resources suitable to execute a given job• Submit jobs for execution• Cancel jobs• Retrieve the output of finished jobs• Show the status of submitted jobs• Retrieve the logging and bookkeeping information of jobs• Copy, replicate and delete files from the Grid• Retrieve the status of different resources from the Information System
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 4
Grid Security
• X.509, SSL• Certification Authority (CA)• Host Certificate• User Certificate• Proxy• MyProxy Service
Grid Security Infrastructure GSI
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 5
Grid Security
•Private key•Public Key
SSL, X.509
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 6
SEE Certification Authorities
• SEEGRID - HellasGrid
• Greece - HellasGrid• Turkey - TRGrid• Hungary - NIIF• Croatia - SRCE• Serbia - RCUB• Macedonia - UKIM
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 7
Host Certificate
/etc/grid-security/globus-host-ssl.conf
grid-cert-request -host <fqdn> -d <dirname>
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 8
User Certificate
/etc/grid-security/globus-user-ssl.conf
grid-cert-request -int
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 9
Proxy, MyProxy
Grid proxy
MyProxy delegation
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 10
UI Installation
http://glite.web.cern.ch/glite/packages/R3.0/R20060502/doc/installation_guide_3.0-2.html
http://rpm.scl.rs/yum.conf/scl-glite-UI.repo
yum install glite-UI
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 11
UI Configuration
https://twiki.cern.ch/twiki/bin/view/EGEE/YAIM
yaim -c -s <location of site-info.def> -n UI
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 12
UI Tweaking
WMS and MyProxy config files:
/opt/glite/etc/<voname>
LFC config:
$LFC_HOST
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 13
Creating Proxy, Proxy delegation
grid-proxy-init
voms-proxy-init -voms <voname>
voms-proxy-info
voms-proxy-destroy
myproxy-init -d -n -c <hrs>
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 14
lcg-info
lcg-info --vo <voname> --list-ce
lcg-info –vo <voname> --list-se
lcg-info –list-attrs
--attrs
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 15
JDL
Type = "Job";
Executable = "test.sh";
#Arguments = "";
StdOutput = "output";
StdError = "stderror";
InputSandbox = {"test.sh"};
OutputSandbox = {"output","stderror"};
Requirements = other.GlueCEUniqueID == "<GCEUID>";
.....
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 16
Job Operations
glite-wms-job-submit -a (-d <delegation>) -c <wmscfg>
glite-wms-delegate-proxy -d <delegation>
glite-wms-job-status <jobid>
glite-wms-job-output <jobid>
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 17
Job Types
• Simple JOB• Collection• Parametric• DAG• MPI
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 18
Collection 1/2
Type = "Collection";
nodes = {
[
JobType = "normal";
Executable = "/bin/hostname";
Arguments = "-i";
StdOutput = "out";
StdError = "err";
OutputSandbox ={"out","err"};
],
[
JobType = "Normal";
Executable = "/bin/date";
StdOutput = "date";
StdError = "err";
OutputSandbox= {"date"};
]
};
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 19
Collection 1/2
[
JobType = "Normal";
Executable = "/bin/date";
StdOutput = "date";
StdError = "err";
OutputSandbox= {"date"};
]
};
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 20
Parametric type 1 Parametric type 1
Type = "Job";
JobType = "Parametric";
Executable = "/bin/echo";
Arguments = "_PARAM_";
Parameters = {red, green, blue};
StdOutput = "colour_PARAM_.txt";
StdError = "error_PARAM_.txt";
OutputSandbox = {"colour_PARAM_.txt","error_PARAM_.txt"};
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 21
Parametric type 2
Type = "Job";
JobType = "parametric";
Executable = "exec";
StdInput = "input_PARAM_.txt";
StdOutput = "output_PARAM_.txt";
Parameters = 10;
ParameterStart = 1;
ParameterStep = 1;
InputSandbox = {"<exec>", "<param_file>"};
OutputSandbox = {"output_PARAM_.txt"};
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 22
DAG 1/5
Type = "dag";
InputSandbox = {"job.sh"};
Nodes = [
nodeA = [
Description = [
JobType = "Normal";
Executable = "job.sh";
Arguments = "A";
StdOutput = "std.out";
StdError = "std.err";
InputSandbox = {root.InputSandbox[0]};
OutputSandbox = {"std.out","std.err"};
];
];
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 23
DAG 2/5
nodeB = [
Description = [
JobType = "Normal";
Executable = "job.sh";
Arguments = "B";
StdOutput = "std.out";
StdError = "std.err";
InputSandbox = {root.InputSandbox[0]};
OutputSandbox = {"std.out","std.err"};
];
];
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 24
DAG 3/5
nodeC = [
Description = [
JobType = "Normal";
Executable = "job.sh";
Arguments = "C";
StdOutput = "std.out";
StdError = "std.err";
InputSandbox = {root.InputSandbox[0]};
OutputSandbox = {"std.out","std.err"};
];
];
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 25
DAG 4/5
nodeD = [
Description = [
JobType = "Normal";
Executable = "job.sh";
Arguments = "D";
StdOutput = "std.out";
StdError = "std.err";
InputSandbox = {root.InputSandbox[0]};
OutputSandbox = {"std.out","std.err"};
];
];
Dependencies = {
{nodeA,nodeB},{nodeA,nodeC},{{nodeB,nodeC},nodeD}
};
]
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 26
DAG 5/5
job.sh
#!/bin/bash
echo "Job $1 - `date` - BEGIN"
hostname
sleep 100
echo "Job $1 - `date` - END"
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 27
MPI 1/2
Type = "Job";
JobType = "MPICH";
NodeNumber = 2;
Executable = "test-mpi.sh";
Arguments = "test-mpi";
StdOutput = "test-mpi.out";
StdError = "test-mpi.err";
InputSandbox = {"test-mpi.sh","test-mpi.c"};
OutputSandbox = {"test-mpi.err","test-mpi.out","mpiexec.out"};
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 28
MPI 2/2
int main(int argc, char *argv[])
{
int numprocs; /* Number of processors */
int procnum; /* Processor number */
/* Initialize MPI */
MPI_Init(&argc, &argv);
/* Find this processor number */
MPI_Comm_rank(MPI_COMM_WORLD, &procnum);
/* Find the number of processors */
MPI_Comm_size(MPI_COMM_WORLD, &numprocs);
printf ("Hello world! from processor %d out of %d\n", procnum, numprocs);
/* Shut down MPI */
MPI_Finalize();
return 0;
}
Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 29
Links
Glite User guide:
https://edms.cern.ch/file/722398/1.2/gLite-3-UserGuide.html
Glite Installation guide:
http://glite.web.cern.ch/glite/packages/R3.0/R20060502/doc/installation_guide_3.0-2.html
https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310
Yaim guide:
https://twiki.cern.ch/twiki/bin/view/LCG/YaimGuide400