see-grid and egee portal applications
DESCRIPTION
SEE-GRID and EGEE Portal applications. M. Kozlovszky, A. Balasko Computer and Automation Research Institute of the Hungarian Academy of Sciences PUCOWO, Zurich, Switzerland 10-11/06/2010. www.lpds.sztaki.hu. Content. SEE-GRID-SCI Tools & Applications Tools - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/1.jpg)
SEE-GRID and EGEE Portal applications
M. Kozlovszky, A. Balasko
Computer and Automation Research Institute of the Hungarian Academy of Sciences
PUCOWO,Zurich, Switzerland 10-11/06/2010
www.lpds.sztaki.hu
![Page 2: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/2.jpg)
2
Content1. SEE-GRID-SCI Tools & Applications
1. Tools1. USGIME - User specific grid infrastructure monitoring
extension 2. CWRE - Workflow Repository
2. Applications1. NMMC3D2. SRA
2. SEE-GRID2 Applications1. FEM2.5D2. EMMIL
3. EGEE Applications1. OMNeT++2. ABC, MPI-FD-FDTD, ...
![Page 3: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/3.jpg)
3
Content1. SEE-GRID-SCI Tools & Applications
1. Tools1. USGIME - User specific grid infrastructure monitoring
extension 2. CWRE - Workflow Repository
2. Applications1. NMMC3D2. SRA
2. SEE-GRID2 Applications1. FEM2.5D2. EMMIL
3. EGEE Applications1. OMNeT++2. ABC, MPI-FD-FDTD, TINKER, ...
![Page 4: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/4.jpg)
4
USGIME - User/application specific grid infrastructure monitoring extension of P-GRADE Portal
•Aim: Allow users of P-GRADE Portal to test: • The validity of their own certificate• Accessibity between
•Computing Elements•Storage Elements (using Remote Files and Logical File Catalog)
•Solution: portlet development with new functionalities•Functions: shows availability/compatibility of specified resources or makes query of the whole grid infrastructure (from user point of view).•Advantage: Always up-to-date information about the infrastructure for developers/end users.•Targeted: mainly end users and not grid administrators•Gridification:
•LPDS @ SZTAKI•Used special feature: Google visualization toolkit•More detailed informationhttp://wiki.egee-see.org/index.php/JRA1_Commonalities#USGIME_.28User.2Fapplication_specific_grid_infrastructure_monitoring_extension_of_P-GRADE_Portal.29
![Page 5: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/5.jpg)
P-GRADE Portal 2.7
+ List of Computing Elements,and Storage Elements
Pre-developed workflowJob generation is done from CE-list
List of SEs
Usage scenario
![Page 6: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/6.jpg)
Implemented GUI 1/3
![Page 7: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/7.jpg)
Implemented GUI 2/3
![Page 8: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/8.jpg)
Implemented GUI 3/3
![Page 9: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/9.jpg)
•Aim: to make available workflow applications for the whole P-GRADE portal user community •Solution: Integrating P-GRADE portal with DSpace repository•Functions:
•App developers can publish their ready-to-use and half-made applications in the repository•End-users can download, parameterize and execute the applications stored in the repository
•Advantage: • Appl. developers can collaborate with appl. developers and with end-users•Portal user community members can share their WFs• Different portal user communities can share their WFs
Portal
DSpace repository
Portal
End-users
App developers
Portal
• Gridification: LPDS @ SZTAKI, WPI /US/• DSpace was developed by HP and MIT Libraries (http://www.dspace.org.)
• More detailed informationhttp://wiki.egee-see.org/index.php/JRA1_Commonalities#CWRE_.28Common_Workflow_Repository_Extension_of_P-GRADE_Portal.29
CWRE - Common Workflow Repository Extension
![Page 10: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/10.jpg)
• DSpace View• DSpace Download• DSpace Upload
New portlets
![Page 11: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/11.jpg)
11
Integrating P-GRADE portal with DSpace repository
DSpace Repository
Upload WF to DSpace
Download WF from DSpace
![Page 12: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/12.jpg)
12
Content1. SEE-GRID-SCI Tools & Applications
1. Tools1. USGIME2. CWRE
2. Applications1. NMMC3D2. SRA
2. SEE-GRID2 Applications1. FEM2.5D2. EMMIL
3. EGEE Applications1. OMNeT++2. ABC, MPI-FD-FDTD, TINKER, ...
![Page 13: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/13.jpg)
13
Seismo VO’s applications
• NMMC3D - Numerical Modeling of Mantle Convection
• MDSSP-WA – process and analysis of seismic signals
• SRA - Seismic Risk Assessment
• ELF – Earthquake Location finder
Country 1
Applications
(ELF,FPS,MDSSP-WA,NMMC3D,SDS)
Programming tool (SDS data I terators)
Earthquake and seismic waveform data
Earthquake and seismic waveform data
Earthquake and seismic waveform data
Country 2 Country n...
Distributed storage and indexing of data on grid (by SDSAS upload scripts)
Country 1
Applications
(ELF,FPS,MDSSP-WA,NMMC3D,SDS)
Programming tool (SDS data I terators)
Earthquake and seismic waveform data
Earthquake and seismic waveform data
Earthquake and seismic waveform data
Earthquake and seismic waveform data
Earthquake and seismic waveform data
Earthquake and seismic waveform data
Country 2 Country n...
Distributed storage and indexing of data on grid (by SDSAS upload scripts)
"We shape our buildings, and afterwards our buildings shape us”
-- Churchill
GRNET.gr
MTA SZTAKI .hu
IPP .bg
ICI .ro
TUBITAK.tr
UPT.al
UKIM.mk
UoBL.ba
RBI.hr
UOB.rs
RENAM.md
UOM.me
GRENA.ge
IIAP-NAS-RA.am
SEEFIRE + Geant Support
SEE-GRID
SeismologyVO
MeteorologyVO
EnvironmentalVO
SeismologyVO
MeteorologyVO
EnvironmentalVO
SEE-SCI
e-Infrastru
cture
= P-GRADE portal was used during development
![Page 14: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/14.jpg)
14
NMMC3D - Numerical Modeling of Mantle Convection
• Aim: better understand the influences of parameters on the behavior of upwellings.•Function: The application solves the equations of thermal convection with a partly finite difference, partly spectral scheme.•Gridification:
•GGRI /Geodetic and Geophysical Research Institute/•LPDS @ SZTAKI•Bogazici University /Turkey/
•Important used/developed features•Application specific complex portlet structure•Embedded picture rendering service •Parameter Study type solution
•More detailed informationhttp://www.lpds.sztaki.hu/gasuc/index.php?m=7&s=16
![Page 15: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/15.jpg)
15
NMMC3D – application profile and Workflow structure
• Fortran based binaries• No internal communication• Small input size (1MB)• Moderate large output size (100MB)• Output rendered by external application (embedded visualization)• End users are able to configure parameter• Extra parameter configuration and submission portlet for end-user • Workflow structure:
• 1 Autogenerator • 1 Parameter Study job
• 5 direct input parameters + one generated parameter• 1 binary in the PSJob
![Page 16: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/16.jpg)
16
![Page 17: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/17.jpg)
17
![Page 18: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/18.jpg)
18
![Page 19: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/19.jpg)
19
![Page 20: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/20.jpg)
20
![Page 21: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/21.jpg)
21
![Page 22: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/22.jpg)
22
![Page 23: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/23.jpg)
Example result file converted to an image
Application output
![Page 24: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/24.jpg)
SRA - Seismic Risk Assessment• Aim:
•Application for public safety and hazards mitigation.
•Gridification:• METU /Ankara, Turkey/
•Important used/developed features•Application specific portlet •Embedded Google maps •Embedded picture rendering service •Parameter Study solution
•More detailed informationhttp://wiki.egee-see.org/index.php/SRA_gridification_guide
![Page 25: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/25.jpg)
25
SRA: Seismic Risk Assessment
• developed as a portlet• Google-powered map
![Page 26: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/26.jpg)
26
Content1. SEE-GRID-SCI Tools & Applications
1. Tools1. USGIME2. CWRE
2. Applications1. NMMC3D2. SRA
2. SEE-GRID2 Applications1. FEM2.5D2. EMMIL
3. EGEE Applications1. OMNeT++2. ABC, MPI-FD-FDTD, TINKER, ...
![Page 27: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/27.jpg)
27
FEM2.5D
•Aim: Finite difference (FD) modeling (for solving partial differential equations). •Gridification:
• Miskolc University• LPDS @ SZTAKI support
•Important used/developed features• Application specific portlet for end users• Embedded picture rendering service • Parameter Study type solution
•More detailed informationhttp://www.lpds.sztaki.hu/gasuc/index.php?m=7&s=2
![Page 28: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/28.jpg)
28
FEM 2.5D end-user GUI and workflow output
![Page 29: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/29.jpg)
29
EMMIL : E-Marketplace Model Integrated with Logistics
•Aim: Supply chain efficiency improvement with numerical model. Three sided negotiation between:
• Buyers• Sellers• Third party logistics providers
•Gridification:•IBS /International Business School/•LPDS @ SZTAKI support
•Important used/developed features• Application specific portlets• Embedded Google maps• Embedded picture rendering service• Parameter Study type solution• Complex independent user views
•More detailed information
http://www.lpds.sztaki.hu/gasuc/index.php?m=7&s=1
![Page 30: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/30.jpg)
30
EMMIL Workflow structure
GEN
SEQ
COLL
SEQSEQSEQ
Parameter study grid jobs
Grid job: parameter field
generator
Collector
P-GRADE Portal
![Page 31: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/31.jpg)
31
Profile Page
Every user has its own Profile
![Page 32: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/32.jpg)
32
Buyer: Product Management
![Page 33: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/33.jpg)
33
Buyer: Create new Auction
![Page 34: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/34.jpg)
34
List of available Auctions
![Page 35: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/35.jpg)
35
3PL’s bid taking
![Page 36: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/36.jpg)
36
Downloading Results
![Page 37: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/37.jpg)
37
Set up the most optimal supplier chain
Log in as buyer supplier, or logistic service provider. Create auctions or take your bids
EMMIL P-GRADE Procurement Portal views
Parameter study optimization workflow is automatically generated and executed
Best buyer-seller-logistic service provider pairs discovered, result
presented in an Excel file
Download rendered images
![Page 38: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/38.jpg)
38
EMMIL P-GRADE Procurement Portal•Buyers profile•Buyer’s product management•Buyer starts new auction•Supplier places bid•Supplier auction is closing•3PL places bid•3PL auction is closing
Results
![Page 39: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/39.jpg)
39
Content1. SEE-GRID-SCI Tools & Applications
1. Tools1. USGIME2. CWRE
2. Applications1. NMMC3D2. SRA
2. SEE-GRID2 Applications1. FEM2.5D2. EMMIL
3. EGEE Applications1. OMNeT++2. ABC, MPI-FD-FDTD, TINKER, ...
![Page 40: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/40.jpg)
40
OMNET++
OMNeT++ is a public-source, component-based, modular, discrete event simulation environment. •Aim: Use of grid infrastructure for computing network simulations, queuing network simulations•Gridification:
•OpenSim Ltd.•LPDS @ SZTAKI
•Important used/developed features• Application specific portlets• Parameter Study type solution• Parrot usage• Service like, easy-to-use login (non-gridsphere based authentication), captcha supported automatic user creation
•More detailed informationhttp://www.lpds.sztaki.hu/gasuc/index.php?m=6&r=4
![Page 41: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/41.jpg)
41
OMNET++ workflow
![Page 42: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/42.jpg)
42
Two types of OMNET portal usageOMNeT++ user portal•User accounts exist for 1 week•Can handle NED files that use INET and Queuing module sets from OMNeT++•No binary come from end user
•Portal does grid operations with one fixed certificate
OMNeT++ developer portal•Permanent user accounts•Can handle custom OMNeT++ modules and NED files that handle such modules•Binaries come from end users
•Users are authenticated based on their personal certificates
![Page 43: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/43.jpg)
43
OMNeT++ portal
![Page 44: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/44.jpg)
44
•ABC - Solving the Schrodinger equation for triatomic systems using time independent method (Department of Chemistry, University of Perugia, Italy)•RWavePR - Solving the Schrodinger equation for triatomic systems using time dependent method (Department of Chemistry, University of Perugia, Italy)•MPI-FD-FDTD - Numerical modeling of ElectroMagnetic field distribution in human tissues (University of Manchester, United Kingdom)•TINKER Conformer Generator - Molecular modeling for QSAR studies for drug development with TINKER external library (LPDS @ SZTAKI)•…
Other applications/services examples based on P-GRADE Portal
![Page 45: SEE-GRID and EGEE Portal applications](https://reader036.vdocuments.mx/reader036/viewer/2022062804/56814c47550346895db94ac0/html5/thumbnails/45.jpg)
45
Thank you for your attention!Questions?