wp3 rgma deployment laurence field / ral steve fisher / ral
TRANSCRIPT
Laurence Field 30/01/2003R-GMA Deployment 2
WP3R-GMA
• Uses the Grid Monitoring Architecture from Global Grid Forum
• R-GMA is a relational implementation
• Applied to both information and monitoring
• Creates impression that you have one RDBMS per Virtual Organisation
Producer
Consumer
Registry
Information flow
Meta-data flow
Laurence Field 30/01/2003R-GMA Deployment 3
WP3SiteInfo Example
dn: in=siteinfo,Mds-Vo-name=ralrgma,o=grid
objectclass: SiteInfo
objectclass: DataGridTop
objectclass: DynamicObject
siteName: RALRGMA
sysAdminContact: [email protected]
userSupportContact: [email protected]
siteSecurityContact: [email protected]
dataGridVersion: v1_4_3
installationDate: 20021111103000Z
createTimestamp: 20030129111208Z
modifyTimestamp: 20030129111208Z
entryTtl: 1200
[email protected]=siteinfo,Mds-Vo-name=ralrgma,o=grid
sysAdminContactsiteNamedn
Gin Gout
Laurence Field 30/01/2003R-GMA Deployment 4
WP3
R-GMA MDS
Gin
Information Provider
• Uses the same information provider as MDS
• Can run MDS and R-GMA in parallel
• Can compare information systems
edg-rgma
GinGRIS
CircularBuffer Producer
Laurence Field 30/01/2003R-GMA Deployment 5
WP3Gout
R-GMA
Consumer (CE)
Consumer (SE)
Consumer (SiteInfo) RDBMS
DataBase Producer
LDAPServer
GOUT
ConsumerAPI
Archiver
• LDAP Server is queried by RB
• Two RBs should be used currently in the UK – one for MDS and one for R-GMA
Laurence Field 30/01/2003R-GMA Deployment 6
WP3CE and SE Tables
ComputingElement
dnCEIdTotalCPUsFreeCPUsTotalJobsRunningJobs……
CloseStorageElement
dnCEIdCloseSE……
StorageElementstatus
dnSEIdSEfreespace……
“Select a ComputingElement with at least 1 free CPU that also has a CloseStorageElement with at least 1000 MB of free space”
SELECT DISTINCT ComputingElement.CEId FROM
ComputingElement, CloseStorageElement,StorageElementStatus WHERE
ComputingElement.FreeCPUs > 0 AND
(ComputingElement.CEId = CloseStorageElement.CEId AND
CloseStorageElement.CloseSE = StorageElementStatus.SEId AND
StorageElementStatus.SEfreespace > 1000)
R-GMA
CLI Join
Laurence Field 30/01/2003R-GMA Deployment 7
WP3InfoCat• One logical registry per VO
– Replication/Distribution system ready soon
• At the moment only using one for all VOs• Located at RAL
– Infocat.gridpp.rl.ac.uk
• InfoCat machine also hosts BrowserServlet
R-GMA
Browser
Laurence Field 30/01/2003R-GMA Deployment 8
WP3R-GMA Deployment
Site A
Information Catalogue
Tomcat
RegistryServlet
SchemaServlet
Client Config
Gin
Producer API
Information Provider
Resource Broker
LDAP
Gout
ArchieverAPI
Tomcat
ArchiverServlet
Information flow
MetaData flow
Server Config
Tomcat
ProducerServlet
Gin
Producer API
Information Provider
job
submission
Laurence Field 30/01/2003R-GMA Deployment 9
WP3R-GMA Tools
• R-GMA CLI– Command Line Interface (similar to MySQL)
– Supports single query and interactive modes
• R-GMA Browser– JSP application dynamically generating web pages
– Supports pre-defined and user-defined queries
• Pulse– R-GMA Java client-based GUI
– Supports streaming and simple graphical displays
• Nagios– R-GMA plug-in instantiates an Archiver and uses that information
to populate Nagios displays
– Users can benefit from Nagios alert mechanism
Laurence Field 30/01/2003R-GMA Deployment 10
WP3Service Status
R-GMA
Browser
• Monitors EDG components• Provides a standard interface for plug-in
service status scripts– Return 0 or 1 OK or fail– Returns message from standard out
• Browsing via the web
hostName name VO status message measurementTime
gpp.rl.ac.uk R-GMA GridPP OK Running 20021111103000
Laurence Field 30/01/2003R-GMA Deployment 11
WP3How to upgrade
• Based on edg version 1_4_3• Install rpms need for R-GMA• Configure via lcfg (or manually)
Laurence Field 30/01/2003R-GMA Deployment 12
WP3RPMSEDG RPMSedg-info-main-2.0.1-0CEedg-info-siteinfo-1.0.0-1SEedg-info-se-2.0.0-4
Externalsj2sdk-1.4.1-fcslog4cpp-0.2.7-3mm.mysql-2.0.6-2xerces-c-1.7.0-1MySQL-python2.1-0.9.2-1python2-2.1.3-2log4j-1.2.6-1jppSWIG-1.3.11-edg1
R-GMAedg-rgma-api-c-2.2.8-1edg-rgma-common-2.2.8-1edg-rgma-api-cpp-2.2.8-1edg-rgma-demo-2.2.8-1edg-rgma-api-java-2.2.8-1edg-rgma-servlets-2.2.8-5edg-rgma-api-perl-2.2.8-1edg-rgma-tools-2.2.8-5edg-rgma-api-python-2.2.8-1
LCFG
obj-rgma-2.2.8-5
obj-infoproviders-2.0.1-9
Laurence Field 30/01/2003R-GMA Deployment 13
WP3LCFG R-GMArgma.servletlocation localhost
rgma.registrylocation INFOCAT_HOSTNAME
rgma.GOUT no
rgma.service RGMA MDS GIN
rgma.VO_RGMA SE_GDMP_VOS
rgma.cmd_RGMA /opt/edg/bin/rgma-servlet-status /etc/tomcat4/server.xml
rgma.VO_MDS SE_GDMP_VOS
rgma.cmd_MDS /etc/rc.d/init.d/globus-mds status
rgma.VO_GIN SE_GDMP_VOS
rgma.cmd_GIN /etc/rc.d/init.d/edg-rgma-gin status
Laurence Field 30/01/2003R-GMA Deployment 14
WP3LCFG InfoProvidersinfoproviders.GRID_INFO_USER edginfoinfoproviders.INFO_LOCATION infoinfoproviders.INFO_PROVIDER_LOG /opt/edg/var/info/info-provider-loginfoproviders.SIenabled yes
infoproviders.siteName SITE_NAME_infoproviders.sysAdminContact SITE_MAILROOTinfoproviders.userSupportContact SITE_MAILROOTinfoproviders.siteSecurityContact SITE_MAILROOTinfoproviders.dataGridVersion SITE_EDG_VERSIONinfoproviders.installationDate SITE_INSTALLATION_DATE_infoproviders.SITE_DN Mds-Vo-name=local,o=gridinfoproviders.SITE_GIN_UPDATE_PERIOD 600
infoproviders.CEenabled yes
Laurence Field 30/01/2003R-GMA Deployment 15
WP3
BOSS job,
edg-rgma-
pulse
CMS - BOSS• Batch Object Submission System
– A wrapper for any jobs a user wants to run
• A BOSS job is submitted containing the user’s job, whereupon BOSS carries out the following:– Forks the job off to a worker node– Parses (i.e. filters) ‘standard output’ and writes
selected data from that output to a local database
• User application using R-GMA to stream data• CircularBufferProducer used to publish parsed
Standard Output• Archiver used to collect and store information
from multiple jobs
Laurence Field 30/01/2003R-GMA Deployment 16
WP3
R-GMA Deployment and Performance• Deployment of WP3 Demo Testbed (used in EU
review)– Revealed R-GMA bug with multiple Tomcat instances –
subsequently fixed– UK and INFN deployment following WP3 Demo Testbed
• R-GMA is being used by:– WP1 (logging and book keeping)– WP2 (replica manager using R-GMA as the information
provider)– WP7 (network monitoring)– CMS (Imperial College, Brunel) (BOSS)
• Performance and Optimisation– Using NetLogger and profiling tools to identify possible
bottlenecks
Laurence Field 30/01/2003R-GMA Deployment 17
WP3Programme for 2003
• Functionality– Enhanced Mediator– Complete GRM integration for monitoring parallel applications– Nagios Integration
• Resilience and Scalability– Consider all failure modes– Complete Registry and Schema replication
• Security– Authorisation
• Performance Optimisation• OGSA Compliant Implementation
– GT3 inter-operability– Include wrapper for backwards compatibility
Laurence Field 30/01/2003R-GMA Deployment 18
WP3Summary• R-GMA works!• Need to deploy to enable R-GMA to be tested
in a real grid environment– Within UK and Italy initially– Problems found will be fixed quickly
• Currently focusing on reliability, stability and performance