Baltic Grid Event, Vilnius, 2004-10-07 - 1

NE ROC Sweden

• Interaction, Integration and Interface with other grid projects and infrastructures• SWEGRID

• Six 100 cpu clusters at 6 sites• Up to 1/3 of the resources available for egee• Six sites using ARC (Nordugrid)• Three sites LCG2

• ARC aka NorduGrid • Used on SWEGRID for primarily for Atlas VO but a number of other users have joined

• Nordic Data Grid Facility• Until end 2004 competence and software development

• EuroGrid (Codine)• Parallab (Bergen) expertise on enabling of applications and grid technologies

• More…

Baltic Grid Event, Vilnius, 2004-10-07 - 2

NE ROC Sweden

HPC2N

PDC

NSC

3

National Supercomputer Center, NSC

Linköping University, Sweden

• Established 1989

• 10 full time and 3 half time employees

• EGEE: Leif Nixon and Johan Gunnarsson

• More than 250 users from the Swedish academic HPC community.

• Partnerships with

• Saab AB

• Swedish Meteorological and Hydrological Institute

4

National Supercomputer Center, NSC

Linköping University, Sweden

• HPC resources

• Cluster resources: more than 850 proc.

• High speed interconnects: Infiniband, Scali

• Shared memory resources: SGI3K, 128 proc

• Organizes the annual workshop on Linux Clusters for Supercomputing, LCSC

5

Grid activities at NSC

• First Grid activities at NSC were initiated 2002.

• SweGrid, GRID test bed for computing and storage

• technical manager, Niclas Anderson, NSC

• NSC is representing Sweden in Grid Deployment Board of the LHC Computing Grid

• Parterns in EU-FP6 grid related projects:

• EGEE, Enabling Grids for E-science in Europe

• ENACTS, Technology watch programme

• HPC4U, Highly Predicable Clusters For Internet Grids

HPC2N 2004 all rights reserved

HPC2N – Some History° 1989 – 95: Supercomputing Center North

° Bank grant (IBM 3090VF-600J)° 1996: HPC2N consortium established

° HPDR contract, KAW grant (IBM SP - knut)° 1997-2002 Grants from HPDR, FRN and VR° 2003– VR/SNIC grants, SweGrid (ingrid)° HPC systems financed by grants from

° Knut and Alice Wallenberg Foundation (knut, alice, and sarek)

° Kempe Foundations (seth)

HPC2N 2004 all rights reserved

Research and Development #1

° Public Domain Software Libraries° HPC systems demand software that utilize their special

architectures efficiently° Software contributions and international

collaboration:LAPACK, ScaLAPACK, SLICOT, IBM-ESSL

° Novel algorithms for deep memory hierarchies° Recursive blocked algorithms, hybrid data formats, with

IBM T.J. Watson Res. Center

° NICONET - Numerics in Control Network (EC)° Web computing environment

HPC2N 2004 all rights reserved

Research and Development #2

° VR/SNIC: Generic Grid research for resource management, portals and algorithms° Resource brokering° Accounting and bookkeeping

° HPC2N Portal SNIC Portal° Web site for submitting jobs, job status information,

access to data files, project management, grid access etc.

° VISTA - Visual Interactive Simulation - Tools and Applications° with VRlab, EC Mål 1 funding

9

PDC

Per Öster <per@pdc.kth.se>

10

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

Background

• Research in parallel computation since about 1985

• Formalized as a Center at KTH in 1990

• Successfully competed for the national HPC center in 1995

• Assumed role as main national center in 1996

• Successful review of center buildup in the fall of 1996

• HPDR closed in 1998. One-year continuation funding 1999 – 2002. First three-year award from SNIC in 2003.

11

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

Representative R&D Projects• EDG – EGEE (EU)• NextGrid (EU)• VR-IT Grid Research (VR)

SGAS, Grid Accounting System

• SweGrid (SNIC, KA Wallenberg)• Jaco3: Java and Corba Collaborative Computing

environment (EU)• EnsCUBE: European Numerical Services for SMEs (EU)• Neurogenerator (EU), Neurodisseminator (EU)• BINS (SSF)• Universe (EU)• Virtual Fires (EU)• FHS (Swedish National Defense College)• SEPTools (EU)• PDCTTN (EU)

12

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

Collaborations• Globus Alliance• Global Grid Forum• European Grid Support Center• International Summer School on Grid Computing• Gelato Federation• LACSI• HP• IBM (KTH Open Source Lab, IBM Research)• Intel• PSCI (Parallel Scientific Computing Institute)• KCSE (KTH Computational Science and Engineering

centre)• VIC (Visualization, Interaction and Communication

centre)

13

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

High-Performance Networking

• Distributed simulation at SC97, San Jose (Sunet, NorduNet, Startap, and Internet2)

• Interactive distributed virtual reality at Alliance‘98 (NCSA, Utah, EVL, UH, PDC, Sunet, NorduNet, Startap, NSF and Internet2) strong influence on Nordunet transatlantic upgrade schedule, UCAID and Eurolink agreements

• Distributed Visualization ENVIS @SC99 (Exhibit, PDC)• Computational Steering at iNET2000, Yokohama (PDC,

UH, EVL, Sunet, NorduNet, Startap, and APAN)• λ-technology for tele-microscopy (NorduNet, Surfnet,

Starlight, Internet2, KI, UCSD/NCMIR)

14

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

• ImmersaDesk 1996 (Alliance)• VR-Cube 1998• Innovative Projects

Technology• An extensible simulation and navigation system “Navier”• A simulation environment for spatial sound

Applications• High-performance visualization of CFD• Visualization and computational steering of very large CEM data sets• High quality visualization of architectural models• Visualization of fires in tunnels (EU project starting 2001)• Virtual Exhibits, Art

• Undergraduate Advanced Visualization Courses • Advanced CAVE workshop, October 2001,

with CAVE Research Network support

Visualization

15

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

Storage services• Space data (Telefoton, Odin, Pamela):

Data repository for the research satellite Odin (260 GB raw data, 270GB processed data, Growth 220 GB/yr collaboration between SE, FI, CA, FR)

• Genomics:Data repository for SSF Genotyping

Laboratory at UU (Data Migration service)• Mutual back-ups PDC – HPC2N (~12 TB)• Brain Images (Neurogenerator):

Data repository and data analysis of PET and fMRI images (a few MB/image, 10 – 100 GB/object, 10 – 100 TB/study)

• Human Proteome Resource, 30 TB 2004, possibly 300TB by 2007 (10,000 anti-bodies, 30 GB/anti-body)

• Amanda 5 TB 2004, 15 – 20 TB 2005• Pamela, ~7TB/yr• SweGrid• SNIC, ~5 TB/yr

16

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

Computer Systems at PDC

17

NE ROC Technical MeetingAmsterdam, October 28-29, 2004

OpenAFS/Arla ECCE PSEs Web portals Gridapps Kerberos travel-kit TSM

User applications

Gaussian Jaguar ABAQUS Fluent StarCD NWChem MacroModel Matlab GeneHunter DL-Poly CHARMM GAMESS Dalton GROMACS Numerical Libraries TotalView Vampir TAU PAPI

Robot

Servers Disk

Switches100/1k/10k

Routers

Computeresources

AFS GPFS Lustre PVFS HSM/DMF TSM

Kerberos Packet filtering

FTP WEB DNS MAIL SSH PKI Grid services

NetCDF HDF4 HDF5 MPI

PDC HSMcommands

SRBBatch system

EASYCompilersDebuggers

MyrinetInfiniband

Fabri

cServ

ices

Tools

Computers Storage Networking

Use

rC

lients

“lambda”

Tape

LAPIGM

Applic

ati

ons

Baltic Grid Event, Vilnius, 2004-10-07 - 18

NE ROC Items for Discussion

Support• Single point of contact?

• Six 100 cpu clusters at 6 sites• Up to 1/3 of the resources available for egee• Six sites using ARC (Nordugrid)• Three sites LCG2

• ARC aka NorduGrid • Used on SWEGRID for primarily for Atlas VO but a number of other users have joined

• Nordic Data Grid Facility• Until end 2004 competence and software development

• EuroGrid (Codine)• Parallab (Bergen) expertise on enabling of applications and grid technologies

• More…