information modeling of grid resources: the ogf glue wg approach
DESCRIPTION
Information Modeling of Grid Resources: the OGF GLUE WG Approach. DMTF Symposium - Portland, 17 July 2007. Sergio Andreozzi INFN-CNAF, Bologna, Italy [email protected]. Agenda. Context and Problem Description Overview of GLUE 1.X (2002-2006) - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/1.jpg)
© 2006 Open Grid Forum
Information Modeling of Grid Resources:
the OGF GLUE WG ApproachDMTF Symposium - Portland, 17 July 2007
Sergio AndreozziINFN-CNAF, Bologna, [email protected]
![Page 2: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/2.jpg)
2© 2006 Open Grid Forum
Agenda
• Context and Problem Description
• Overview of • GLUE 1.X (2002-2006)• GLUE 2 (since 2007 in the context of OGF)
• GLUE and CIM
• Insight on GLUE 2 Info model
![Page 3: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/3.jpg)
© 2006 Open Grid Forum
Context and Problem Description
![Page 4: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/4.jpg)
4© 2006 Open Grid Forum
Grid as a multi-institutional infrastructure
Intra-site resource
local credential Grid-level credential
Inter-site seamless collaboration
Virtual organization
![Page 5: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/5.jpg)
5© 2006 Open Grid Forum
Problem Statement
• How do we describe resources shared in Grid systems in order to enable:
• Resource awareness
• Resource discoverability
• Resource requirements expression
• Resource basic monitoring
![Page 6: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/6.jpg)
6© 2006 Open Grid Forum
Use Case 1
• I want to run my job on an execution environment characterized by:
• OS• Linux, Distribution X, version Y
• CPU Archicture • IA64
• Available software packages: • S1, S2
![Page 7: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/7.jpg)
7© 2006 Open Grid Forum
Use Case 2
• I want to know
• how many job slots are used by members of the VO A
• what is the global available storage space for the users of VO B
![Page 8: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/8.jpg)
8© 2006 Open Grid Forum
• Generalization • capture common aspects for different entities providing the same
functionality • e.g.: uniform view over different batch services
• Abstraction given by the Grid paradigm• Virtual pool of resources• Grid-related user attributes (e.g., VO, groups, roles)
• Main focus on discovery for brokering, monitoring and inventory• concerns those attributes that are meaningful for locate
resources on the basis of a set of preferences/constraints
Modeling Guidelines
![Page 9: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/9.jpg)
9© 2006 Open Grid Forum
Who Provides Requirements
• The definition of the GLUE Info Model is an open process
• For its adoption, we have to involve:• End-users (persons using Grid systems)• Site administrators• Grid operators• Virtual Organizations managers• Developers
![Page 10: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/10.jpg)
© 2006 Open Grid Forum
GLUE 1.X2002-2006
“GLUE Schema activity before OGF”
![Page 11: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/11.jpg)
11© 2006 Open Grid Forum
GLUE Schema • Collaborative effort focusing on interoperability started by the EU DataTAG
and US iVDGL Grid projects
• Initial Contributors: DataGrid, Globus, PPDG, GriPhyn, NorduGrid
• Goal: • a common description for Grid resources designed to support discovery and
selection via Grid information Service
• Current projects supporting this activity:• EGEE, OMII-Europe, KnowArc, TERAGRID; APACGRID, NAREGI, UNICORE,
NGS, OSG, APACGrid, …
01/04/2002 31/12/2006
01/01/2003 01/01/2004 01/01/2005 01/01/2006
9/2002GLUE 1.0
4/2003GLUE 1.1
5/2005GLUE 1.2
12/2006GLUE 1.3
![Page 12: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/12.jpg)
12© 2006 Open Grid Forum
GLUE Schema
• Conceptual Model described by UML Class Diagrams• Mapping for several concrete data models
Globus Schema(LDAP)
DataGrid Schema (LDAP)
GLUE Schema 1.X (UML)
GLUE Schema (Relational)
R-GMA
GLUE Schema (XML)
GT MDS 4GLUE Schema
(LDAP)GT MDS 2
GLUE Schema(OldClassAd)
![Page 13: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/13.jpg)
13© 2006 Open Grid Forum
Adoption
• Used in production Grid infrastructures• Mainly EGEE Grid and OSG Grid
• Main Focus• Grid-wide scheduling• Resource Inventory• Basic Monitoring
• Other Grid infrastructure have a partial adoption
![Page 14: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/14.jpg)
14© 2006 Open Grid Forum
GLUE 1.X - concepts
• Core• Site, Service, Element
• Computing• Cluster/SubCluster/Host• Computing Element
• Storage• Storage Element• Storage Area• Access/Control Protocol
![Page 15: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/15.jpg)
© 2006 Open Grid Forum
GLUE 2Since 2007 in the context of OGF
![Page 16: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/16.jpg)
16© 2006 Open Grid Forum
OGF GLUE WG
• New OGF Working Group approved at OGF 19 (Jan 2007)
• Focus: • facilitate interoperability between Grid infrastructures via
common information models and reference implementation for describing Grid resources in response to use cases
• Goal: • define a use case document collecting use cases from
different Grid projects/infrastructures• define a conceptual model defining the abstract schema
GLUE 2.0 satisfying the collected use cases. • develop reference implementations
![Page 17: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/17.jpg)
17© 2006 Open Grid Forum
Relationship to other OGF WGs
JSDL
GLUE
Reference Model
SAGA
GSMOGSA Res.Mgt.
Used to express requirements inCommon service descripton
for discovery API
Used to describe exposed resources
Should fit into the picture
Should fit into the picture
BES
Used to describe exposed resources
SAGA:Simple Access Grid APIGSM:Grid Storage Management BES: Basic Execution Service
JSDL: Job Submission Description Language
![Page 18: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/18.jpg)
18© 2006 Open Grid Forum
Tentative Timeline
01/01/2007 30/04/2008
01/01/2008
1/2007OGF19 - 1st GLUE WG Session
5/2007OGF20 - Entity and Use Cases Session
10/2007OGF21 - Mature Spec and Use Cases Docs
11/2007SC2007 - BES + GLUE interop demo
1/2008OGF22 – Docs in Public Comment
& Ref. Implem. available
![Page 19: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/19.jpg)
© 2006 Open Grid Forum
GLUE and CIMA possible marriage?
![Page 20: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/20.jpg)
20© 2006 Open Grid Forum
Why not yet a CIM-based GLUE?
• Modeling • Perceived high complexity of CIM
• Difficult to extend for non-expert• Difficult to use CIM-based models for sharing knowledge among
Grid experts that are non knowledgeable of CIM
• Implementing• Several implementations exist
• Issues of choosing among them
• High learning curve for writing both MOF and providers
![Page 21: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/21.jpg)
21© 2006 Open Grid Forum
Why not yet a CIM-based GLUE?
• Current panorama in Grid• There are CIM extensions for Grid not having real
implementation and support from real Grid infrastructure• There are info model implementations non CIM-
compliant
• People prefer • simpler modeling• hand-made mapping to different concrete data models• implementation with scripting-based providers for rapid
prototyping
![Page 22: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/22.jpg)
22© 2006 Open Grid Forum
Can We Fill the Gap?
• Current work on GLUE 2 is a fresh-new work with no backwards-compatibility constraints
• There is a 6-month timeframe to try GLUE and CIM marriage
• For a success:• Ability to talk to people that provide use cases• Ability to talk to developers that know the details of the various
Grid components and tell them how to write providers• Ability to exchange GLUE concepts among CIM-nonexperts
![Page 23: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/23.jpg)
23© 2006 Open Grid Forum
Contribution to OGF GLUE WG
• The OMII-Europe project is funding three persons (me plus two other colleagues) • to contribute to GLUE 2 • to write info providers for OGSA-BES
implementations of gLite and UNICORE
• We are investigating the adoption of CIM and OpenPegasus right in this period
• Important for the success is to enstablish the right relationships for a positive experience
![Page 24: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/24.jpg)
© 2006 Open Grid Forum
Insight on GLUE 2 Info Model Main Entities
![Page 25: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/25.jpg)
25© 2006 Open Grid Forum
GLUE::Main Entities
Can change in the near future
![Page 26: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/26.jpg)
26© 2006 Open Grid Forum
GLUE::Site
• Administrative domain grouping resources and services managed by the same set of person
• the administrative site can span different physical locations
• the location attributes in this entity are meant to be used for the core location
![Page 27: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/27.jpg)
27© 2006 Open Grid Forum
GLUE::Element
• It groups concepts that participate in the creation of an entity useful in a Grid environment.
• The element is autonomous and can be composed by services and the exposed resources.
![Page 28: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/28.jpg)
28© 2006 Open Grid Forum
GLUE::Resource
• An entity that is useful in a Grid environment and offered through service(s)
• A resource may contain aggregated information
![Page 29: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/29.jpg)
29© 2006 Open Grid Forum
GLUE::Service
• An abstracted, logical view of actual software components having a well-defined interface and offering one or more functionalities;
• it does have network endpoint(s); it abstracts some functionality
![Page 30: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/30.jpg)
30© 2006 Open Grid Forum
GLUE::Share
• A utilization target for a set of resources defined by policies and characterized by status information
![Page 31: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/31.jpg)
31© 2006 Open Grid Forum
GLUE::Activity
• An activity is a unit of work managed by a service;
• An activity can have relationships to other activities being managed by different services, therefore it shares a common context.
![Page 32: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/32.jpg)
32© 2006 Open Grid Forum
GLUE::Virtual Organization
• A virtual organization (VO) comprises a set of individuals and/or institutions having direct access to computers, software, data, and other resources for collaborative problem-solving or other purposes.
• Resources utilized by a VO are expected to be provisioned via SLA’s . The VO can exhibit the internal structure in terms of groups of individuals and/or institutions and their roles
![Page 33: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/33.jpg)
33© 2006 Open Grid Forum
GLUE::Policy
• Statements, rules or assertions that specify the correct or expected behavior of an entity
• Relevant specialization are important to express authorization aspects to services/resources/shares
![Page 34: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/34.jpg)
© 2006 Open Grid Forum
Insight on GLUE 2 Info ModelComputing Entity
![Page 35: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/35.jpg)
35© 2006 Open Grid Forum
Computing Entities
• The computing power is typically offered by cluster systems
• They can offer different types of machines (i.e., execution environments)
• Requests are typically staged into queues for efficient system usage and fair share among clients
• By playing with queues and authorization policies, it is possible to implement different level of services (e.g., guaranteed share, priorities)
![Page 36: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/36.jpg)
36© 2006 Open Grid Forum
Involved Concepts and Inheritance
![Page 37: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/37.jpg)
37© 2006 Open Grid Forum
GLUE::Computing Element
• It groups the concepts that participate in the creation of an entity providing computational activity in a Grid environment.
• It considers computing services and the exposed computing resources where services and related resources have many to many relations
![Page 38: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/38.jpg)
38© 2006 Open Grid Forum
Computing Element as Concepts Container
Useful to refer all the concepts related to a computing entity instance with a persistent and unique ID
![Page 39: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/39.jpg)
39© 2006 Open Grid Forum
Computing Entity Relationships
![Page 40: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/40.jpg)
40© 2006 Open Grid Forum
GLUE::ComputingService
• Specialization of service for creating, monitoring, and controlling computational activities called jobs
![Page 41: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/41.jpg)
41© 2006 Open Grid Forum
GLUE::ComputingResource
• Grouping concept for a set of different types of execution environments; the aggregation is defined by the common management scope (e.g., a local resource management system like a batch system defines an aggregation scope);
• The OS can be the simplest case of LRMS. • The Computing Resource may contain
aggregated status information
![Page 42: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/42.jpg)
42© 2006 Open Grid Forum
GLUE::ExecutionEnvironment
• A description of hardware and software characteristics that defines the environments available to and requestable by a Grid job when submitted to a Computing Service;
• the description also includes information about the total/available/used instances of the execution environment
![Page 43: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/43.jpg)
43© 2006 Open Grid Forum
GLUE::ApplicationEnvironment
• Description of the application software environment available within one or more execution environments
![Page 44: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/44.jpg)
44© 2006 Open Grid Forum
GLUE::ComputingShare
•A utilization target for a set of computing resources defined by policies and characterized by status information
• a typical implementation of a share is a batch queue with the associated policies and status information
• the same share can be implemented using different batch system configuration/strategies
• in complex batch systems, it is possible to define different set of policies for the same batch queue, this will imply a share for each set of policies
![Page 45: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/45.jpg)
45© 2006 Open Grid Forum
GLUE::Job
• An activity managed by a computing service
![Page 46: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/46.jpg)
© 2006 Open Grid Forum
Insight on GLUE 2 Info ModelStorage Entity
![Page 47: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/47.jpg)
47© 2006 Open Grid Forum
Status
• The status of the GLUE 2 specification for Storage entities is in an early stage
• In order to provide an idea about the involved concepts, we sketch the GLUE 1.3 model
![Page 48: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/48.jpg)
48© 2006 Open Grid Forum
GLUE13::Storage Element
Storage Element:
• Abstraction for a storage resource
• Group of services, protocols and data sources
![Page 49: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/49.jpg)
49© 2006 Open Grid Forum
GLUE 1.3 Storage Element concepts
• Storage Area: • portion of storage extent to which a uniform set of
policies applies
• Access Protocol • Protocol available to access/transport files in/from
storage areas
• Control Protocol• Protocol available for the control and/or
management of the storage resource
![Page 50: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/50.jpg)
50© 2006 Open Grid Forum
Conclusion
• Common Models of Grid resources are a key aspect for their integration and usage
• The OGF GLUE WG is working on a re-design and itnegration of existing models in order to provide the community with use-cases driven info model
• Reference implementations will be used by services exposing resources and by Grid Information Service
• GLUE can enter the CIM world if we manage to enstablish the right relationships and keep in mind the inherent knowledge barriers
![Page 51: Information Modeling of Grid Resources: the OGF GLUE WG Approach](https://reader035.vdocuments.mx/reader035/viewer/2022062423/56814790550346895db4c108/html5/thumbnails/51.jpg)
51© 2006 Open Grid Forum
References
• OGF GLUE WG Website http://forge.ogf.org/sf/projects/glue-wg
• Documents• GLUE 2 - Specification • GLUE 2 - Use Caseshttp://forge.ogf.org/sf/docman/do/listDocuments/projects.glue-wg/docman.root.drafts
• GLUE Schema Specification v.1.3http://glueschema.forge.cnaf.infn.it/ (pre-OGF website)