co-funded by the european union summit... · co-funded by the european union fenix user forum...
TRANSCRIPT
![Page 1: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/1.jpg)
Co-funded bythe European Union
![Page 2: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/2.jpg)
Co-funded bythe European Union
Fenix User Forum meetingParallel Session 1
![Page 3: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/3.jpg)
Fenix User Forum meeting – outline
Welcome and introduction Anne Nahm, JUELICH
ICEI services overview and update Jacques-Charles Lafoucriere, CEA
Examples for how to use ICEI Alex Upton, CSCS
Fenix User Forum Javier Bartolomé, BSC
Discussion and questions Cristiano Padrin, CINECA
![Page 4: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/4.jpg)
• BSC (Barcelona, ES)
• CEA (Bruyeres-le-Chatel, FR)
• CINECA (Bologna, IT)
• CSCS (Lugano, CH)
• JSC (Jülich, DE)
Introduction: Fenix & ICEI
5 supercomputing centres (PRACE Hosting Members)
Build the Fenix infrastructure
Project partners in ICEI*
* Interactive Computing E-Infrastructure for the Human Brain Project
-> Specific Grant Agreement under the umbrella of the HBP Framework Partnership Agreement
![Page 5: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/5.jpg)
Introduction: Concept of Fenix
Layered approach for e-infrastructure service provisioning:
HBP Platform/EBRAINS Services
that build on/use
Fenix Infrastructure Services
Fenix Infrastructure Services for
HBP and European researchers
![Page 6: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/6.jpg)
Introduction: Access to resources and Fenix User Forum
• Access to Fenix Infrastructure Services:
25 % of available resources are reserved for HBP
Resources need to be requested
Light-weight review process for small projects
• The Fenix User Forum = Opportunity for you as a user to engage
fenix-ri.eu🌐
![Page 7: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/7.jpg)
ICEI services overview and updateJacques-Charles Lafoucriere (CEA)
![Page 8: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/8.jpg)
Fenix infrastructure – overview
• Federated computing and data services for European researchers
• Data storage and scalable computing resources in close proximity to each other and tightly integrated
• Service-oriented provisioning of resources, aiming to
• Meet the requirements of various science communities
• Form a basis for the development and operation of community-specific platform tools and services
• Federation of infrastructure services to optimize for data locality, enhance availability and broaden variety of services
![Page 9: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/9.jpg)
Fenix infrastructure – User resources (1)
• Scalable Computing Services
• Access to Europe's largest HPC systems
• Large parallel simulations or data analysis
• Interactive Computing Services
• No delay access to single servers
• Interactive use
• Virtual Machine Services
• VM deployment service
• User defined VM allocation time
![Page 10: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/10.jpg)
Fenix infrastructure – User resources (2)
• Active Data Repositories
• Site-local data store
• File based interface (parallel file systems)
• Object storage interface (OpenStack swift)
• Archival Data Repositories
• Federated data store for long-term storage
• Object store interface (OpenStack swift)
![Page 11: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/11.jpg)
Fenix infrastructure – Infrastructure services (1)
• Authentication and Authorization Infrastructure (AAI)
• Central user identification and authentication
• Used to access Fenix/ICEI resources
• Fenix User and Resource Management Service (FURMS)
• Central management of user roles and membership
• Community resource allocation and accounting
![Page 12: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/12.jpg)
Fenix infrastructure – Infrastructure services (2)
• Data Location and Transfer Services
• Enable Fenix users to locate their data
• Enable Fenix users to move their data between centres
• Data Mover Services
• Enable Fenix users to move data inside centres between Data Repositories
• Same way to move data in all centres
![Page 13: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/13.jpg)
Fenix infrastructure – Usages
• Compute and data analysis
• Interactive usage (“on demand”)
• Store data with different classes of service
• Data comes from simulation or from instruments
• Run user-defined virtual machines
• For permanent services
• For some pre-defined time for a specific service or data processing
![Page 14: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/14.jpg)
Fenix infrastructure – Available resources
Resources at other centres will become available within the next months
See details at https://fenix-ri.eu/infrastructure/resources
Service ComponentICEI Total Allocation
(100%)Available Resources
(quarterly)1
Scalable Compute Piz Daint Multicore 250 nodes 465’375 node-hrs
Scalable + Interactive
ComputePiz Daint Hybrid 400 nodes 744’600 node-hrs
Virtual Machines OpenStack IaaS 35 servers 35 servers
Long-term StoragePOSIX, Object and
Tape4 PB 4 PB
Temporary StorageLow-Latency
Storage Tier80 TB 80 TB
1 Amount of available resources is subject to change
Fenix infrastructure services are currently available at CSCS:
![Page 15: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/15.jpg)
Examples for how to use ICEIAlex Upton (CSCS)
![Page 16: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/16.jpg)
What is ICEI being used for?
23 projects from HBP members that are making use of ICEI resources at CSCS
• These are approximately categorised as follows:
• 7 ‘small’ scalable compute projects (up to 4,999 hours per quarter)
• 7 ‘medium’ scalable compute projects (between 5,000 and 19,999 node hours per quarter)
• 4 ‘large’ scalable compute projects (20,000+ node hours per quarter)
• 5 ‘cloud compute’ projects (using Pollux OpenStack)
• Wide variety of projects, ranging from neurorobotics to cerebellum modelling to neuromorphic computing front-end
![Page 17: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/17.jpg)
Examples of running projects
• The next slides, detail three examples of running projects
• ich002: Full-scale hippocampus model (PI: M. Migliore)
• ich006: NEST network construction and simulation (PI: H. E. Plesser)
• ich009: Neuromorphic Computing Front-end Services (PI: A Davison)
• The offering of ICEI/Fenix services supports variety of uses across multiple fields of neuroscience
![Page 18: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/18.jpg)
ich002: Full-scale hippocampus model
• Detailed model of rat Hippocampus CA1 region with 460,000 neurons, includes input projections from CA3 region
• Studies conditions under which travelling waves of activity at theta rhythm emerge and how they interact with external inputs to perform cognitive functions
• Major and unique contribution to the field
• Model requires a minimum of 25,000 cores (approx. 700 nodes) to run on the Piz Daint multicore partition
![Page 19: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/19.jpg)
ich002: Full-scale hippocampus model
In simulation above from the HBP Hippocampus Team, 0.5 secs of simulation time generated 1Tb of data and required 2hr15min to run
![Page 20: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/20.jpg)
ich006: NEST network construction and simulation
• Simulations are essential in neuroscience, specifically the NEST simulator is a key tool for network simulation in HBP
• This project tests, benchmarks and optimises NEST network construction and simulation for the benefit of users of large scale cellular level simulation
• Comprehensive set of benchmarks with a focus on connectivity generation, automated using the JUBE tool
• Performance issues in NEST 2.16.0 identified and addressed, which have been subsequently removed in NEST 2.18.0
![Page 21: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/21.jpg)
ich006: NEST network construction and simulation
Above plot shows the performance of different versions of NEST on Piz Daintusing different numbers of virtual processes
![Page 22: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/22.jpg)
ich009: Neuromorphic Computing Front-end Services
• Migration of neuromorphic computing servers from commercial provider to ICEI resources
• Amongst others, the following is running on the ICEI VMs:
• Job Queue REST API
• Resource Manager REST API
• Benchmarking REST API
• Collaboratory apps inc. Job Manager, PyNN Network Builder, Benchmark results viewer and Job statistics dashboard
• Before end of SGA2, plan to deploy load balancer in front of the Job Queue API, and to deploy a centralised logging/monitoring server (based on the ELK stack)
![Page 23: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/23.jpg)
ich009: Neuromorphic Computing Front-end Services
![Page 24: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/24.jpg)
Fenix User ForumJavier Bartolomé (BSC)
![Page 25: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/25.jpg)
Fenix User Forum
An online forum and set of relevant engagement activities directed to users
Objectives:
To establish a communication channel between Fenix resource providers and Fenix users on:
Current and future user needs
Experiences and best practices for using the Fenix infrastructure
User satisfaction
![Page 26: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/26.jpg)
Fenix User Forum
An online forum and set of relevant engagement activities directed to users
Members:
Fenix users (including current, potential and rejected users)
Fenix resource providers
EBRAINS Infrastructure Allocation Committee (IAC) and other members of resource allocation committees
Other people interested in using ICEI/Fenix infrastructure services
![Page 27: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/27.jpg)
Fenix User Forum: Using the platform
Post content, ask
questions, make
comments, participate
in discussions
Access documentation and
presentations
Join events like
webinars and Fenix
User Forum
meetings
![Page 28: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/28.jpg)
Fenix User Forum: Signing up
Sign up by submitting a form
on the Fenix webpage
https://fenix-ri.eu/infrastructure/fenix-user-forum
![Page 29: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/29.jpg)
Discussion and questionsCristiano Padrin (CINECA)
@Fenix_RI_eu
fenix-ri.eu🌐
Contact:
![Page 30: Co-funded by the European Union Summit... · Co-funded by the European Union Fenix User Forum meeting Parallel Session 1. ... and to deploy a centralised logging/monitoring server](https://reader033.vdocuments.mx/reader033/viewer/2022060212/5f0511db7e708231d4111bd9/html5/thumbnails/30.jpg)
Co-funded bythe European Union