infso-ri-508833 enabling grids for e-science crossgrid migrating-desktop marcus hardt...
TRANSCRIPT
INFSO-RI-508833
Enabling Grids for E-sciencE
www.eu-egee.org
CrossGrid Migrating-Desktop Marcus HardtForschungszentrum Karlsruhe GmbH
An Induction to EGEE for small and medium sized Businesses
FhG SCAI May 2005
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
2
CrossGrid
• EU Projekt 2002-2005 (IST-2001-32243)– ~ 200 Teilnehmer von 21 Instituten in 11 Ländern
• Projektziele– Vier (neue) gesellschaftlich wichtige Anwendungen auf
dem Grid etablieren BioMedizien, Flutkatastrophenhilfe, Hochenergiephysik,
Meteorologisches Modell zur Luftverschmutzung
– Interaktive Anwendungen “Human in the Loop”
– Parallele Anwendung mit MPI Intra- (p4) und inter- (g2) site Modus
– Aufbau eines europäischen Grid-Systems mit Beteiligung der neuen Mitgliedsstaaten
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
3
CrossGrid Testbed
• 16 Rechenzentren
• 9 Länder
• ~ 150 CPUs
• ~ 4 TB Speicher
• Unterteilung– Development– Test&Validation– Production
• Entwicklung von Unterstützungs-Werkzeugen
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
4
CrossGrid Benutzer-Schnittstelle
Job Submissio
n
ServiceInteractive Session
Service
File Management
Service
Profile Mangement
Service
Application Management
Service
Roaming Access Service CrossBroker
Virtual Directory
II / LDAP
EDG Resourcen
Migrating Desktop
Portal
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
5
CrossGrid Middleware – Migrating Desktop
Migrating Desktop
Zugang von jedem (JA
VA)-Computer is
t nun
möglich
Window Benutzer e
rhalten Grid
Zugang
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
6
?
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
7
Life Demo
• Grid Commander– Data Management mit dem Virtual Directory– Datenreplikation
• Jobsubmission– Verschicken eines Jobs ins grid– Statusabfrage– Auswertung
• Tool– GridBench
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
8
Glossar & Referenzen
• Links– CrossGrid homepage: www.crossgrid.org– Migrating Desktop:
http://willow.crossgrid.man.poznan.pl/crossgrid
• Glossar– PPC: Perfomance Prediction Component– OCM-G: Grid version of OCM– G-PM: Grid version of PM– JDL: Job Description Language– II: Information Index
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
9
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
10
CrossGrid Middleware – Interaktivität
Job Submission Services CrossBroker
Logging&
Bookkeeping
Roaming Access Server
Computing Element
LRMS
Gatekeeper
JDLMigrating Desktop
RAS shadow port,
RAS shadow host
Process Launched
Interactive data
Control data
Submission flow
In/Out/Err job data
010011000
WorkerNode
Job Shadow
stdin – stdout -stderr
Console Agent
Job
Condor ByPass SystemCondor ByPass System
Job Shadow
Java Visualisatio
n plug-in
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
11
CrossGrid Architektur
T e s t b e d
Applications
Services
Tools
• 16 sites• 9 countries
• over 200 CPUs• 4 TB of storage
RoamingAccess Server
MigratingDesktop
OCM-G
PerformancePrediction
Data Access Globus
Toolkit
MPI Verification
MPI Library
Portal
Post-processing
InfrastructureMonitoring
Plugin
Plugin
Plugin
SOAP
SOAP
SOAP
SOAP
SOAP
Protocol
API
API
API
API
Links
API
API APISOAP
SOAP
API
API(JMX)
(OMIS)
VisualizationKernel
Links
PerformanceAnalysis
APIApplicationMonitoring
Benchmarks
NetworkMonitoring
MedicalSupport
ParticlePhysics
Meteo/Pollution
FloodSimulation
DataGrid
Scheduler
Marcus Hardt GENIUS and GILDA, FhG SCAI, May 05
Enabling Grids for E-sciencE
12
CrossGrid Middleware – CrossBroker
Job Submission
Services
RSL
JDL
Migrating Desktop
Scheduling Agent
Application Launcher DAGMan
Resource Searcher
GMDAT
Condor-G
LRMS
Gatekeeper
WN WN
RSL
Command Line
JDL
CROSSBROKER
CrossGrid Job
Management Service
LRMS
Gatekeeper
WN WN