the chasm of cyberinfrastructures

of 38 /38
The Chasm of Cyberinfrastructures Harold Teunissen et al. #I2SUMMIT14, April 2014 A Dutch Perspective

Author: harold-teunissen

Post on 11-Nov-2014

210 views

Category:

Education


5 download

Embed Size (px)

DESCRIPTION

The Cyber Infrastructure (CI) vision has been around for a couple of years. The development of such infrastructure requires a radical design philosophy and a foundation to build upon. It needs the development of an architecture that defines the components, their organizations and their interactions. Since the CI has an international scope and connections, this specification will as much as possible be done in international cooperation and leads to international standards and agreements. The main challenge of a CI is to provide an unified and standardized way for the composition of trustworthy, multi-domain and on-demand services for an international research group (or virtual organization). These services can be network resources, storage and HPC, but also collaboration tools for writing papers and exchanging research data. The CI demands a form of service orchestration where virtualization and management of services and resources in a distributed, heterogeneous environment is essential.

TRANSCRIPT

  • 1. The Chasm of Cyberinfrastructures Harold Teunissen et al. #I2SUMMIT14, April 2014 A Dutch Perspective
  • 2. Early adopters 2The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 3. Serving Dutch Higher Education 3The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 4. The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfra Corp. All ICT activities for Higher Education and Research in the Netherlands are under one umbrella 4 Shared Professional Services Scientic Computing & Data Commercial ICT Products & Services National Research & Education Network eScience Collaboration and Tools
  • 5. Core Elements 5The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Adapted from: Berman, 2001 & Lippincott, 2011 CYBERINFRASTRUCTURE People & Training Broadband Network Connectivity Large Databases & Libraries InstrumentationHigh Performance Computing Collaboration
  • 6. Big Hype 6The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 7. 2005 130 EB 2010 1,227 EB 2015 7,910 EXABYTE 2020 1,000 ZETABYTE? 2000 Out or in control? 7The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 8. Entropy 8The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. KNOWLEDGE CHAOS Too Big Data Required Processing Power AmountofData Max. Available Processing Power
  • 9. Long tail of science 9The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. # of researchers Scale Large Scale, Multi- Disciplinary and Complex Small Scale but getting complexer ACCELERATION
  • 10. Secret of their success 10The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 11. Vision of Cyberinfra 11The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 12. Glueing the components 12The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. GLUE
  • 13. or just patchwork? 13The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 14. Network BNetwork A Network C Just within our reach 14The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 15. We started building 15The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. http://static4.depositphotos.com/ 1000992/514/i/950/ depositphotos_5146031-Laboratory- glassware.jpg
  • 16. Generic resource broker 16The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 17. The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Interfacing to domain specic resource brokers Aggregation of available resources provided by specic brokers Authorisation based on federated identity attributes Advance reservation Reporting and monitoring Scheduling Brokering Accounting Auditing Ultimate functionality 17
  • 18. Technical Challenges 18The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 19. Organizational Dierences 19The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 20. Financial Hurdles 20The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 21. How to eat an elephant? 21The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 22. ENLIGHTEN YOUR RESEARCH The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Enlighten your research 22 Radio Astronomy Pulsar Research Climate Modeling for Scientist and Decision Makers CineGRID 4K+ Video Distribution Testbed Next Generation DNA Sequencing Jungle Computing Centralized Imaging for Large Scale Population Imaging Contest
  • 23. SURF Outreach & Support 23The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 24. Erasmus MC TU Delft WUR RUG Life Science Grid Cluster LUMC AMC VU MC Complete Genomics, LA, CA. (BGI) BGI, Hong Kong EYR3 : NG DNA SQ 24The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 25. Big Data Big Deal! - #tnc2013 - Maastricht, NL Chasm 25The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Source: Georey A. Moore c.s. Techies Visionaries Pragmatics Conservatives Laggards Chasm WAITING TO HAPPEN ...solutions and convenience ...technology and performance time #ofcustomers
  • 26. Big Data Big Deal! - #tnc2013 - Maastricht, NL Bandwidth on demand 26The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Source: Georey A. Moore c.s. Techies Visionaries Chasm ALMOST HAPPENING time #ofcustomers The Rest 7-9 YEARS 20142006 2009 2016
  • 27. Rethinking the vision 27The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3
  • 28. Virtualization of resources 28The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Infastructure Virtualization Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3
  • 29. Coordinated virtualization 29The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Infastructure Virtualization Physical Infrastructure Layer Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization Data Center (Storage & Compute) Network Constellation Science DMZ S3
  • 30. Link to the applications 30The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3 Cyberinfastructure as a Service Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization
  • 31. Orchestration of infrastructure 31The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization
  • 32. Inspired by: Brocade, DS of the Future & S. Peng et al., DSaaS, 2013 Cyberinfrastructure as a Service 32The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization CIaaS
  • 33. Inspired by: Brocade, DS of the Future & S. Peng et al., DSaaS, 2013 Standards and implementations 33The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization CIaaS OpenFlow FortNOX Fresco NSI OSCARS FlowScale Beacon FlowVisor OpenStack OCCI Maestro vSphere Hypervisor
  • 34. Ideal world 34The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Inspired by: S. Peng et al., 2013 Cyberinfastructure as a Service Infastructure Virtualization Physical Infrastructure Layer CIaaS Data Center Network Science DMZ S3 Virtual Collaboration
  • 35. Quite a challenge 35The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Infastructure Virtualization Physical Infrastructure Layer Data Center Network Science DMZ S3 Domain I Domain II Domain III Domain IV Domain V CIaaS Virtual Collaboration
  • 36. ? Federation of CIaaS 36The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfrastructure as a Service Infastructure Virtualization Physical Infrastructure Layer Virtual Data Center Composition & Orchestration Virtual Data Center Operation & Management Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization Data Center Network Science DMZ S3 ?
  • 37. Big Data Big Deal! - #tnc2013 - Maastricht, NL Outlook 37The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Innovation Trigger Peak of Inated Expectation Through of Disillusions Slope of Enlightment Plateau of Productivity Software Dened Networking SDN VIRTUALIZATION SDx time Expectations Source: Gartner July 2013 JULY 2013 5-10 YEARS 2-5 YEARS TO REACH PLATEAU LESS THAN 2 YEARS OpenFlow OpenStack
  • 38. [email protected] haroldteunissen