Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Enhancing SegHidro/BRAMS experience through EELA

José Flávio M. V. Júnior

Paulo Ricardo Motta Gomes

SegHidroFINAL PRESENTATIONFINAL PRESENTATION

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

EGRIS1 Achievements

• Successful gridifying of the meteorologic application of SegHidro Portal– Input data uploading module– Input data validation module– Job submitting module– Job monitoring module– Output data retrieving module

• Acquaintance of gLite middleware components– Helpful on the integration OurGrid/gLite

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Overall architecture

SegHidro

LFC

PortalRB CE WN SE

User

CPTEC FTP

L&B

MPI

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Input data uploading module

• Performed by update_brams_data.sh• Evoked daily by system scheduler (cron)

CPTEC FTP SERVER LOCAL MACHINE

ftp_gamrams.sh

SE

lcg-del

lcg-cr

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Input data validation module

SegHidroCORE

SE FILE CATALOG (LFC)

INPUT FILE LIST

LFC JAVA API

1

2

2

33

JOB SUBMITTING MODULE

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Job submitting module

• Performed by brams-job-submitter.sh

SegHidroCORE

SHELL

Parameters

Edit

JDL MODEL

EDG-JOB-SUBMITJOBID

1

2

3

JOB MONITORING THREAD

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Job monitoring module

• Performed by job-status-checker.sh

SegHidroCORE

SHELL

jobID

1

LOGGING AND BOOKKEEPING

EDG-JOB-STATUS

2

jobStatus

3 OUTPUT DATA RETRIEVINGMODULE

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Output data retrieving module

• Performed by job-get-output.sh

SegHidroCORE

SHELL

jobID + output file list

1EDG-JOB-GET-OUTPUT

RB

boolean

2

False

True

3

3

download

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Next steps

• Install an EELA site at LSD

• Make new system available to users

• Optimize architecture– AMGA– File replication on SE

• Integration between EELA’s gLite and LSD’s OurGrid

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Thank you!

Merci!

Danke!

Grazie!

Gracias!

Obrigado!

SegHidro

Laboratório de Sistemas Distribuídos (LSD) – Universidade Federal de Campina Grande (UFCG) EELA Grid School – December 04, 2006

Questions?