introduction to egee-ii
DESCRIPTION
Introduction to EGEE-II. Antonio Fuentes [email protected] Tutorial Grid Sevilla, September 2007 RedIRIS/Red.es (Slices of Bob Jone, Director of EGEE-II Project ). The project. EGEE 1 April 2004 – 31 March 2006 71 partners in 27 countries, federated in regional Grids EGEE-II - PowerPoint PPT PresentationTRANSCRIPT
1
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW). Introduction to EGEE-II
Antonio [email protected]
Tutorial Grid Sevilla, September 2007RedIRIS/Red.es
(Slices of Bob Jone, Director of EGEE-II Project )
2
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
The project
• EGEE 1 April 2004 – 31 March 2006 71 partners in 27 countries, federated in
regional Grids
• EGEE-II 1 April 2006 – 31 March 2008
91 partners in 32 countries
• Objectives Large-scale, production-quality
grid infrastructure for e-Science Attracting new resources and
users from industry as well asscience
Maintain and further improve“gLite” Grid middleware
3
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Applications on EGEE
• Applications from many scientific domains Archaeology Astrophysics Computational Chemistry Digital libraries Earth Sciences Financial Simulation Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences …..
Book of abstracts:http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-005.pdf
4
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Support for digital repositories
GÉANT .
INFRASTRUCTURE
GRID .
INFRASTRUCTURE
KNOWLEDGE .
INFRASTRUCTURE
3 layered model to support access to heterogeneousinformation and connect resources throughcommon shared services
Grids can offer:• Sharing of resources
• Secure Access Control
• Data management
• Execution of computationally demanding applications (e.g. multi-media content)
5
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
EGEE Operations Structure
• Operations Coord. Centre (OCC)
• Regional Operations Centres (ROC) Front-line
support for user and operations issues
Provide local knowledge and adaptations
One in each region – many distributed
Manage daily grid operations – oversight, troubleshooting
“Operator on Duty”
Run infrastructure services
ROCs serving
6
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
EGEE Related Infrastructures
GIN
7
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Grid Interoperability
• We currently see different flavors of Grids deployed worldwide Because of application needs, legacy constraints, funding, etc. Diversity is positive! – Competition to find the best solutions
• Many applications need to operate on more than one Grid infrastructure Pragmatic approach to interoperability is key Applications need interoperable Grid infrastructures now A production infrastructure cannot be an early adopter of quickly
changing standards • Interoperability and standardization pursued at multiple levels
Bilateral efforts (e.g. EGEE and EUChinaGrid, OSG and TeraGrid, EGEE and Naregi) Resulted in the “Grid Interoperability Now (GIN)” effort
combining major worldwide and regional Grid efforts at GGF Grid standardization and best practices at the Global Grid Forum
Now merging with comparable industry efforts – Open Grid Forum Standardization of basic infrastructure like web services (OASIS)
8
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Grid Middleware
• Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware
• Higher-Level Grid Services are supposed to help the users building their computing infrastructure but should not be mandatory
• Foundation Grid Middleware will be deployed on the EGEE infrastructure Must be complete and
robust Should allow
interoperation with other major grid infrastructures
Should not assume the use of Higher-Level Grid Services
Foundation Grid Middleware
Security model and infrastructure
Computing (CE) and Storage Elements (SE)
Accounting
Information and Monitoring
Higher-Level Grid Services
Workload Management
Replica Management
Visualization
Workflow
Grid Economies
...
Applications
9
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
EGEE Middleware Distribution
gLiteExploit experience and existing components from VDT (Condor, Globus), EDG/LCG, and others
Develop a lightweight stack of generic middleware useful to EGEE applications (HEP and Biomedics are pilot applications).
Pluggable components – cater for different implementationsFollow SOA approach, WS-I compliant where possible
Focus is on re-engineering and hardening
Business friendly open source licensePlan to switch to Apache-2
10
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Workload ManagementData Management
SecurityInformation & Monitoring
Access
gLite Grid Middleware Services
API
ComputingElement
WorkloadManagement
MetadataCatalog
StorageElement
DataMovement
File & ReplicaCatalog
Authorization
Authentication
Information &Monitoring
Application
MonitoringAuditing
JobProvenance
PackageManager
CLI
Accounting
Site Proxy
11
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
gLite Grid Middleware Services
Overview paper
http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf
12
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
EGEE and Sustainability
BUT …
• How does EGEE compare to other computing infrastructures? Number of infrastructure users? Number of application domains? Number of computing nodes? Number of years in service?
• What would happen, if EGEE is turned off?
• What happens after April 2008 (End of EGEE-II)?
13
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Sustainability: Beyond EGEE-II
• Need to prepare for permanent Grid infrastructure Maintain Europe’s leading position in global
science Grids Ensure a reliable and adaptive support for all
sciences Independent of short project cycles Modelled on success of GÉANT
Infrastructure managed in collaboration with national grid initiatives
14
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Structure
• Federated model bringing together National Grid Initiatives (NGIs) to build a European organisation (EGI)
• EGEE-II federations wouldevolve into NGIs
• Each NGI is a national body Recognised at the national level Mobilises national funding and resources Contributes and adheres to international standards and
policies Operates the national e-Infrastructure Is application independent, open to new user
communities and resource providers
15
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).
Summary
• Grids are all about sharing – they are an excellent means of working with groups around the world
• EGEE operates the world’s largest multi-disciplinary grid infrastructure for scientific research In constant and significant production use EELA & EUMedGrid & EUChinaGrid as part of this production
infrastructure
• We have gained significant experience in what it takes to deploy, operate and manage a large distributed infrastructure Next steps: Service Availability Monitoring, Service Level
Agreements
• This work has shown the importance of interoperability/interoperations with related projects
• Need to prepare the long-term EGEE, related EU projects, national grid initiatives and user
communities are working to define a model for a sustainable grid infrastructure