Road to Private Cloud mit OpenStack Projekterfahrungen
Andreas Kress Enterprise Architect Oracle Sales Consulting DOAG Regio Nürnberg/Franken 20. April 2017
Copyright © 2016, Oracle and/or its affiliates. All rights reserved.
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OpenStack Short Introduction
4 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Cloud Computing: State of the Enterprise What’s Driving Enterprises to Cloud Systems?
• Cloud Benefits IT Consumers
– Agility through self-service automation
–On-demand provides OpEx vs. CapEx options
• Cloud Benefits IT Providers – Better capacity planning and asset utilization
– Centralized monitoring and reporting
–Manage IT as a collection of provided services
• Not surprising: Many Enterprises have, or are looking to either deploy new clouds, or shift to cloud based management for existing infrastructure
DOAG Regio Nürnberg/Franken 5
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OpenStack Overview
• Open source cloud software
– Generic solution for IaaS, PaaS and SaaS
–Modular architecture • Web portal for cloud admins and self-service users
• Cloud services exposed through APIs
• CLI, Python libraries, ...
• Combines compute, network and storage resources – Self-service dashboard
– Services exposed through REST APIs
What is OpenStack?
Single Management Pane
VM VM VM
Virtualized Data Center Resources
6 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 7
OpenStack in Action
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 8
OpenStack in Action
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Drivers for OpenStack Cloud Infrastructure What’s exciting customers about OpenStack?
• Broad Industry Adoption and Participation in the Community
–Over 400 companies involved!
• Rich technology Ecosystem
– Provides choice / freedom to leverage underlying Compute, Storage, Networking Infrastructure
• “Standardized” Cloud API layer
– Abstracts higher level Cloud Software & Services from Undercloud infrastructure specifics
9 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OpenStack Use Cases – Heterogeneous IaaS
• Oracle Solaris Zones Based Compute
– SPARC and x86
– Centralized management
10
Consolidate Oracle Solaris and SPARC in existing OpenStack cloud
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
• Out-of-the-Box Ready to Use
– Lots of work to configure underlying infrastructure • Overall Integration
• Lots of moving parts
• Dependent on expertise, experience, vendors, maturing technology
• Mature
– Aggressive release cycle; short support lifespan
– Update capability is limited, often “rip and replace”
– However, it is improving
• Free
–OpenSource does not mean free
– Large investment to set up and support environment
11
What OpenStack is not…
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 12
Overview of Core Components
OpenStack Services
Component Description
Nova Compute virtualization
Cinder Block storage
Neutron Software defined networking
Keystone Authentication between cloud services
Glance Image management and deployment
Horizon Web based dashboard
Swift Object storage
Heat OpenStack Orchestration
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 13
OpenStack Logical Architecture with Service Names
Neutron
Cinder
Nova Glance Swift
Keystone
Horizon
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Horizon
Cloud Management
Nova Compute Virtualization
Neutron Cloud Networking
Cinder/Swift Cloud Storage
Glance Image Deployment
14
OpenStack Basic Picture
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Agenda
Motivation
Road to the Cloud
– Technical Architecture
– Solution Design
– Challenges
Exemplary Project Plan
Lessons Learned
1
2
3
4
A 15 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Motivation
• Reduce Deployment Time and Efforts
• Enable Self-Service
• Standardization and Reduce of Complexity
• Provisioning of Multiple Heterogenous Clouds
• One Management Tool for Multiple Clouds
• Unified Application Deployment Model
• Reduce Costs
Multiple Cloud Strategy
16 A DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Further Requirements
• Standardize API Interfaces
• Complete. Pre-Assembled. Preconfigured.
• Vendor Certified and Guaranteed Interoperability
• One Support Contract for all Components
• Secure by Default
• Isolated Cloud with Dedicated Secured Entry Points
• Optimized for Oracle Workload
17 A DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Private Cloud Vision – DBaaS Example
Target Design
Self-Provision
Database Service
Private Cloud
Converged
Infrastructure
Monitor
Dedicated Cloud for
Oracle DBaaS €€€
Public/
Hybrid Cloud Future
Option
Cost Allocation
& Chargeback
Create, Clone/
Snap, Terminate
A 18 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Private Clouds with Oracle
19
Engineered Systems
Best-of-Breed
• Standardized Cloud Mgmt SW • Common API • DIY Infrastructure
• DIY Infrastructure • DIY Cloud Mgmt SW • DIY API
• Ready-Made Stack • Purpose-Built System • Best Performance
OpenStack
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Road to the Cloud
• Planning the Cloud (Architecture)
• Designing the HW Infrastructure
• Orchestration
• HA-/DR-Konzept
• Performance
• Other Challenges and more
20 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Use Cases
• User Access
– Cloud Networking
– Flat Networking
• Ressource Assignment - Example: Storage – Shared Storage
– Local Storage (Segregation)
• Workload Type
– Data Driven (High IOPS Demand) – e.g. Database
– Compute Intensive (High CPU Demand) – e.g. HPC
– Transactional Workload (High Memory Demand) - e.g. Application Server
21 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Cloud Networking with Shared Storage
Converged Cloud Architecture
22
Network Node
Storage Network
Cloud Network
Compute Node
Compute Node
Compute Node
Compute Node
Compute Node
Shared Storage
Public Network
D DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Cloud Networking with Shared Storage
Converged Cloud Architecture
23
Network Node
Storage Network
Cloud Network
Compute Node
Compute Node
Compute Node
Compute Node
Compute Node
Shared Storage
Public Network
Op
enSt
ack
Net
wo
rk
Utilities Controller
OpenStack Controller
and Cloud Controller
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Cloud Networking with Shared Storage
Converged Cloud Architecture
24
Network Node
Storage Network
Cloud Network
Compute Node
Compute Node
Compute Node
Compute Node
Compute Node
Shared Storage
Public Network
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Flat Networking with Shared Storage
Flat Cloud Architecture
Storage Network
Compute Node
Compute Node
Compute Node
Compute Node
Compute Node
Shared Storage
Public Network
Cloud Network
D
Public and Cloud Network
25 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Flat Networking with Local Storage
Flat Cloud Architecture
Compute Node
Compute Node
Compute Node
Compute Node
Compute Node
Storage Network
Shared Storage
D 26
Public and Cloud Network
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Road to the Cloud
• Planning the Cloud (Architecture)
• Designing the HW Infrastructure
• Orchestration
• HA-/DR-Konzept
• Performance
• Other Challenges and more
A 27 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Converged Infrastructure
• Grouping Multiple Information Technology Components
• One Single, Optimized Computing Package
• Components may include
–Networking Equipment
– Data-Storage Devices
– Servers
– IT Infrastructure Management
– Automation
–Orchestration
Source: https://en.wikipedia.org/wiki/Converged_infrastructure
A 28 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Patch Panel Patch Panel Patch Panel
CCI Infrastructure with Oracle Design Decisions
10
20
30
40
Patch Panel
Server • SPARC Server • x86 Server
Operating System • Oracle Solaris • Oracle Linux
Storage • DAS • NAS • SAN
Network • 10 GbE • Infiniband
Cloud Mgnt Package
A 29 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
CCI Infrastructure Logical View Flat Cloud Architecture
Compute Nodes
Shared Storage
Storage Nodes
...
Storage NW Op
enSt
ack
Net
wo
rk
VM
Mgnt Nodes
Pu
blic
& C
lou
d N
W
Cloud Mgnt Pack
Public and Cloud Network
CCI Rack
* System Management Network not shown
A 30
VM
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Private Cloud Appliance Integrated Hardware Accelerates Time to Value
Compute Infrastructure
• Scalable from 2-25 nodes
• Up to 19.2TB aggregate memory drives VM density
• Optimized for Oracle Applications
• Supports any Linux, Oracle Solaris and Windows applications
Network Infrastructure
• High speed low latency networking between all components
• Fully configured fabric networking, no setup required
• Integrates with existing Ethernet and Storage networks
Management Infrastructure
• Pre-configured, redundant management servers
• Oracle VM templates downloadable
• ZFS storage system for Management Storage
Networking
Management
31
Fabric Interconnect
Fabric Interconnect
Compute Nodes
Compute Nodes
Management Nodes
Management Storage
Ethernet Switch
Infiniband Expansion
Infiniband Expansion
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
• Expansion with Identical Racks • Expansion with Compute and Storage Racks
Multi-Rack Scaling
32
Base Rack
Rack 4 Rack 2 Rack 3 Base Rack
Compute Expansion
Compute Expansion
Storage Expansion
Com-pute
Stor-age
Net-work
Com-pute
Stor-age
Net-work
Com-pute
Stor-age
Net-work
Com-pute
Stor-age
Net-work
Com-pute
Stor-age
Net-work
Com-pute
Com-pute
Stor-age
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Design Considerations
• Build a Cloud with Oracle Solaris OpenStack
– Fully Supported, Enterprise Ready Software Stack
–Optimized for Oracle Database Workload
• Lock-Down the Cloud – Public Network Access Restricted to OpenStack Instances
– Separated Access to Infrastructure Components and Control Logic (The Undercloud)
• Virtualize the Workload. Virtualize the Control Logic
– Power the Infrastructure and the Workloads with Solaris Zones
Make it Secure and Easy to Maintain
D 33 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
A Short Recap
OpenStack Logical Architecture
Neutron
Cinder
Nova Glance Swift
Keystone
Horizon
D 34 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Havana (11.2), Juno (11.2 SRU10), Kilo (11.3 SRU9)
Oracle OpenStack for Oracle Solaris
Zones & Kernel Zones
Nova
Compute Virtualization
Elastic Virtual Switch
Neutron
Cloud Networking
ZFS File System
Cinder/Swift
Cloud Storage
Glance
Image Deployment
Unified Archives
Heat
Orchestration
Unified Archives
Ironic Bare Metal
Deployment SPARC/x86
Horizon
Cloud Management
35 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Road to the Cloud
• Planning the Cloud (Architecture)
• Designing the HW Infrastructure
• Orchestration
• HA-/DR-Konzept
• Performance
• Other Challenges and more
D 36 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Orchestration of an Oracle Solaris OpenStack Cloud
• Automate the "Undercloud" Infrastructure Creation (AI)
• Automate and Standardize the "Undercloud" (= OpenStack) Configuration
• Enable Cloud LifeCycyle Management with Boot Environments (BE)
Setup and Configure the Cloud in Minutes not Days
Creating a Replicable Setup
37 D DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Road to the Cloud
• Planning the Cloud (Architecture)
• Designing the HW Infrastructure
• Orchestration
• HA-/DR-Konzept
• HA-/DR-Concepts • Cloud Control Pane
• Application
A 38 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
High Availabilty of the Undercloud
• Failover Cluster
– Clustered Services
– Solaris Kernel Zones
– Failover Zones with Oracle Solaris Cluster
• Scalable Services
– Distributed Services
– Solaris Kernel Zones
– Client Driven Service Selection
Make the Infrastructure High Available
39
Management Node
OpenStack Controller
Utilities Controller
Management Node
Oracle Solaris Cluster
Failover Cluster
Failover Cluster
OpenStack Controller
Utilities Controller
A
Management Node
OpenStack Controller
Utilities Controller
Management Node
Loadbalancer
OpenStack Controller
Utilities Controller
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
High Availabilty of the Application
• Run Multiple Independent Clouds
• Example: Oracle Database
– Replication via Oracle Active Data Guard
• Example: Oracle Weblogic
–Weblogic internal Cluster Functionality
Make the Service High Available
40 A
Data Guard
Primary Data Center
Failover Data Center DB
Prod Cloud
DB DR
Cloud
Replication
Primary Data Center
Failover Data Center
Web Web Web Web Web
Traffic Manager
Web
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Road to the Cloud
• Planning the Cloud (Architecture)
• Designing the HW Infrastructure
• Orchestration
• HA-/DR-Concepts
• Performance
• Other Challenges and more
• Performance • Network Access Concept
• Storage Access Concept
D 41 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Cloud Networking Flat Networking
Performance Aspects of Cloud Architectures
42 D
Cloud Network Access
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Shared Storage Local Storage
Performance Aspects of Cloud Architectures
43 D
Cloud Storage Access
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Further Performance Aspects
• Network Virtualization
– VxLAN or Tagged VLAN
• Virtualization Type for Guests
–Non-Global Zones, Kernel Zones, LDoms
• Storage Considerations – iSCSI or NFS
– Shared Storage Access
– DIY or Buy Storage Node
Networking and Storage
D 44 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Road to the Cloud
• Planning the Cloud (Architecture)
• Designing the HW Infrastructure
• Orchestration
• HA-/DR-Concepts
• Performance
• Further Challenges to Consider
D 45 DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Exemplary Project Plan
• Schedule Depends on:
– Knowledge Level: Customer, Vendor, Partner
– Target Design (Technology)
– Level of Corporate IT Maturity
– Commitment and Engagement of the Users
– Ability to Adapt Changes
46
PoC Test/Dev PreProd Production
Learning Learning Learning Learning
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Lessons Learned
• Start with a Clear Vision
• Establish a Team
– Project Sponsor, Customer (IT Dept & Users), Vendor and Partner
• Proof of Concept Matters
– Check what Really Works and Constantly Rethink and Rework Concepts
–Match Expectations, Requirements and Cloud Features
• The Road to Cloud is more than just Creating the Cloud Infrastructure
– Creating Images, Defining Flavors/Shapes, Software Deployment
– "Cloudifying" Internal Processes
• Engage and Convince the Prospective Users Early
47
Teamwork
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Backup Slides
DOAG Regio Nürnberg/Franken 48
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 49
Private Cloud: Deploy with Engineered Systems
Integrated Platform Systems
(Exadata, Exalogic, Exalytics)
• High-Performance Middleware, Database, Apps
Integrated Infrastructure Systems (Private Cloud Appliance)
• General-Purpose Distributed Workloads
Management SW
Servers
Network
Storage
Apps/Middleware
Integrated Server/Storage/Network/Management
Single Vendor Sale and Support
Single SKU/Complete System/Support
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Private Cloud Appliance Integrated Hardware Accelerates Time to Value
Compute Infrastructure
• Scalable from 2-25 nodes
• Up to 19.2TB aggregate memory drives VM density
• Optimized for Oracle Applications
• Supports any Linux, Oracle Solaris and Windows applications
Network Infrastructure
• High speed low latency networking between all components
• Fully configured fabric networking, no setup required
• Integrates with existing Ethernet and Storage networks
Management Infrastructure
• Pre-configured, redundant management servers
• Oracle VM templates downloadable
• ZFS storage system for Management Storage
Networking
Management
50
Fabric Interconnect
Fabric Interconnect
Compute Nodes
Compute Nodes
Management Nodes
Management Storage
Ethernet Switch
Infiniband Expansion
Infiniband Expansion
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Elastic Infrastructure for Multi-Tenancy
Wire Once Infrastructure • Connect any VM dynamically to any IO resource
• Prewired for simplicity, add compute nodes on demand
• Dynamically create up to 8 networks per Tenant-Group
Increased Flexibility • Deploy and grow applications as your needs change
• Create isolated groups for applications
• Improve app to app communication
Software Upgradable System • Appliance features added as SW, no HW changes needed
• System managed as a single resource to patch and upgrade
Integrated Software Defined Networking
Software Defined Network
51 DOAG Regio Nürnberg/Franken
Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |
Private Cloud Appliance Orchestration
52
Fabric Interconnect
Fabric Interconnect
Compute Nodes
Compute Nodes
Management Nodes
Management Storage
Ethernet Switch
Networking
Management
Infiniband Expansion
Infiniband Expansion
• Orchestrated Hardware Bringup • Inserts all servers in an Oracle VM
Manager server pool • Configures external networking
(set IP address, etc.) • Performs periodic back-up of
Private Cloud Appliance
OVM Manager
• VM and hypervisor (Xen) resource management
• VM network / storage configuration
Dual, redundant PCA management nodes with automatic failover PCA
Controller
• Cloud management (self service, metering and chargeback, etc.) for one or multiple PCAs
• Hardware resource management • Database, middleware, apps
management • Software management,
configuration and compliance management
• Plugin with Oracle VM Manager for full stack management
Enterprise Manager
Compute
Compute
DOAG Regio Nürnberg/Franken
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 53 DOAG Regio Nürnberg/Franken