Download - RCUK Cloud Workshop
![Page 1: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/1.jpg)
Supporting research in the Cloud: Our experiences and future directionsSimon WoodmanDigital InstituteNewcastle University
![Page 2: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/2.jpg)
Digital Institute• In 2001, NEReSC was formed to help researchers
– £17M funding • Bioinformatics, Neuroscience, Aging & Health, Chemical Engineering,
Transport, Video archiving– Core UK e-Science funding programme
• Became the Digital Institute– Similar remit but more diverse: Humanities, Medical Science, BIM– £40M funding
• Provided computing aspect of many research projects• Frequently same requirements
![Page 3: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/3.jpg)
ResearchWorld-leading
Teaching Specialist
Skills& Knowledge
Engagement
Impact on Industry &
Public Sector
Innovation Cycle
Cloud Innovation CentreEvents, engagement &partnerships
EPSRC Centre for Doctoral training in Cloud Computing for Big DataDeveloping thenext generation of leaders
World-leading Research in Cloud computing & data analytics
Digital Institute
![Page 4: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/4.jpg)
Having 100s of machines available to process data
doesn’t automatically help
![Page 5: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/5.jpg)
Building a data management and processing platform
• An environment to store, manage and process data– Every project needed this, volumes growing– Open Source
• A platform that can operate in a number of different locations– Laptop– On Premise– On a cloud provider (Amazon and MS)
• An expandable system– API to connect other software– Data processing code can be added
• A platform for our academic research– Scalability, data management, provenance
![Page 6: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/6.jpg)
![Page 7: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/7.jpg)
![Page 8: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/8.jpg)
![Page 9: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/9.jpg)
![Page 10: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/10.jpg)
Provenance
![Page 11: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/11.jpg)
![Page 12: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/12.jpg)
Features of e-SC• Data storage– Cloud: infinite scale
• Data processing– Best-of-breed open source tools (R / Octave)
• Provenance– Audit of everything performed
• Scalability– Easy to run at large scale
• External communications– Rich APIs
![Page 13: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/13.jpg)
All our projects have significant storage, processing and
collaboration needs
Use of the platform
Movement monitoring
Collaboration
ModellingStroke rehabilitation
Care home design
![Page 14: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/14.jpg)
Cap Ex v Op Ex
![Page 15: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/15.jpg)
Service Provision v Research
![Page 16: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/16.jpg)
One eScience Central to rule
them all.
![Page 17: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/17.jpg)
Learning from Industry - DevOps
The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win. Gene Kim, Kevin Behr, George Spafford. ISBN 0988262509
![Page 18: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/18.jpg)
Cloud Innovation Centre
• £1M funding from DCMS
• Offerings– Training– Architecture Reviews– Consultancy– KTPs– Cloud time
• £700k Private and Public Cloud infrastructure
![Page 19: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/19.jpg)
Cloud Computing for Big Data CDT
• £7M funding from EPSRC• 60 Students • 5 years
• High level of industry engagement
Cloud Computing
Bayesian Statistics
Group Projects Internships
Thesis
Retreats
Professional Skills
![Page 20: RCUK Cloud Workshop](https://reader035.vdocuments.mx/reader035/viewer/2022081605/587114cc1a28abac6d8b6b01/html5/thumbnails/20.jpg)
Challenges• Past– Cost of on-boarding– Scaling
• Present– Licensing– Researchers doing Sys Admin
• Future–Manage the relationship with Central IT– Staff costs/time