ECEE Enabling Clouds for eScience The open collaboration spot for cloud projects in Europe www. Scientific-cloud.org ke Edlund, PhD KTH-SICS Cloud Innovation Center Vilnius ke Edlund Coordinator KTH-SICS Cloud Innovation Center (C!C)[1] Managing Partner SICS Seed Accelerator[2] Leading VENUS-C Scientific and International Cooperation[3] Coordinating ECEE (see this presentation)[4] December 2010: completed the NEON project (Northern Europe Cloud Computing) [1][2][3][4] Why ECEE? Many initiatives with similar goals Accelerate the learning process Share the load Cross border and cross project services www. Scientific-cloud.org Vilnius Whos in? So far.VENUS-CItaly, Germany, UK, Spain, Sweden, Greece, Israel StratusLabFrance, Greece, Switzerland, Spain, Ireland NGSUnited Kingdom GRNET cloudGreece SARA cloudThe Netherlands UCMSpain as part of the OpenNebula Project SEECCISlovenia, Croatia, Serbia, Bosnia and Herzegovina, Montenegro, Kosova, FYRo Macedonia, Albania, Romania, Bulgaria CESGASpain as part of the Open Cirrus project NEONSweden, Norway, Denmark, Finland, Iceland BalticCloudEstonia, Latvia, Lithuania, Belarus, Poland Participated in workshops: VISION project Vilnius Collaboration cross European projects Initiated in September 2009 at EGEE09 Meet twice a year 1 st workshop OGF28, Munich, March 2010 2 nd workshop EGI TF, Amsterdam, Sept 2010 3 rd workshop EGI UF, Vilnius, April 2011 www. Scientific-cloud.org Vilnius Workshops example 1 hr Industry presentations 2 hr Detailed findings - project-by-project, sharing specific findings, and respective roadmap 1 hrDiscussion, pointing at common challenges and how to share the load, to update common high-level roadmap www. Scientific-cloud.org Vilnius Sharing experiences examples Sharing experiences from using different cloud solutions private and public Security issues, issues with network topologies Sharing experiences from management of private and hybrid clouds Sharing user experiences Users - hard to find good representatives that have the time to participate Open source vs closed source - pros and cons Pricing - how to compete, how to estimate, what are the risks www. Scientific-cloud.org Vilnius Looking at common challenges - examples Investigate how to build a cloud storage infrastructure that supports the use of clouds for scientific applications. Investigate if a machine provisioning interface like that of Amazon's EC2 coupled with a library of scientific appliances is of value to European academic research communities. www. Scientific-cloud.org Vilnius Looking at common challenges Identify the economic value of cloud computing Understand the economic implications of moving parts of HPC onto cloud infrastructures. -Estimate the fraction of current HPC compute jobs that could realistically be executed on clouds -Estimate the cost of building and operating a cloud facility of the same capacity as the above percentage of the total current resources -Estimate possible cost reductions achievable by scaling out peak loads to commercial clouds -Compare cost of a private cloud facility with a commercial cloud -Estimate savings in scenarios with -Commercial clouds when aiming at direct peering (data transfer cost) -Allocating their spare capacity at a reduced price www. Scientific-cloud.org Vilnius Big variety among ECEE projects: NEON www. Scientific-cloud.org Supporting Multiple Basic Research Disciplines Biomedicine (3): Integrating widely used tools for Bioinformatics, System Biology and Drug Discovery into the VENUS-C infrastructure. Civil Protection & Emergencies (1): Early fire risk detection, through an application that will run models on the VENUS-C infrastructure, based on multiple data sources. Civil Engineering (2): Support complex computing tasks on Building Information Management for green constructions and dynamic building structure analysis. Data for Science (1): Integrating computing through VENUS-C on data repositories. In particular focus will be on Marine Biodiversity through Aquamaps. 7even User Scenarios Extending eScience Applications through Open Call: 20,000 funding each, in addition to Azure Compute, Storage and Network Resources porting applications to the cloud - education and training - scalability tests Extending eScience Applications through Open Call: 20,000 funding each, in addition to Azure Compute, Storage and Network Resources porting applications to the cloud - education and training - scalability tests Big variety among ECEE projects: VENUS-C HPC CloudHPC System Fast & Large RAM, CPU, Storage, Network IAAS, PAAS, SAAS Graphic User Interface Standards: OCCI, CDMI Portal for user collaboration Documentation, Fora & Wiki User Projects Ticket system VM repository Usergroups Life Sciences & Humanities (Ecology, Geography, Bioinformatics, psychology, Linguistics) Sciences (Physics, CS, Chemistry) More every day HPC Cloud Open Cloud Standards for System Interoperability Laptop Workstation HPC Systems Sara Neon Blue Open Standards OCCI (OGF) CDMI (SNIA) Open Standards provide interoperability between all available systems to ensure maximal freedom of choice Big variety among ECEE projects: StratusLab Provides complete, open-source IaaS cloud distribution. Focus on grid resource centers: Allow collaborative science with dynamic cloud resources Use of grid authn/authz mechanisms Demonstrate: Certified grid site over a StratusLab cloud InfrastructuresCertified EGI grid site running at GRNET. Reference cloud infrastructure for user feedback. Support at for help and Release (v0.3)Logging and security enhancements. Prototype Marketplace for shared images. Use of VOMS proxies. Inclusion of OpenNebula 2.2. Big variety among ECEE projects www. Scientific-cloud.org Public Private IaaS SaaS ? SUMMARY - ECEE An open collaboration between cloud projects All contributing projects are welcome to join. Meet twice a year (as ECEE) to share experiences and roadmaps initiated September 2009 ECEE is a complement to the project-to-project collaborations bringing in many often very different - projects to the same meeting ECEE is in contact with the SIENA Roadmap Advisory Board to act as interoperability-now feedback group to the SIENA Roadmap work. www. Scientific-cloud.org Vilnius www. Scientific-cloud.org Vilnius FutureGrid: An Experimental Computing Grid and Cloud Test-Bed Karolina Sarnowska-Upton, University of Virgina BiG Grid HPC Cloud Floris Sluiter, SARA Venus-C Architecture Hakan Soncu, Venus-C/EMIC StratusLab - Current Status and Plans Cal Loomis, StratusLab/IN2P3 ECEE Agenda (after lunch) Thank you! ke Edlund www. Scientific-cloud.org Vilnius