openstack and bare metal run kubernetes on fast...1 run kubernetes on openstack and bare metal fast...
TRANSCRIPT
![Page 1: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/1.jpg)
1
Run Kubernetes on OpenStack and Bare Metal
Fast
Ramon Acedo RodriguezSenior Principal Product Manager, Red Hat
OPEN
INFRASTRUCTURE SUM
MIT | SHAN
GHAI, NOVEM
BER 4-6 2019
![Page 2: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/2.jpg)
2
OPTIO
NAL SECTION
MARKER O
R TITLE
Open Hybrid CloudVision
![Page 3: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/3.jpg)
3 BARE METAL VIRTUAL PRIVATE CLOUD
The Open Hybrid CloudThe 4 Footprints
PHYSICAL VIRTUALPRIVATECLOUD
PUBLICCLOUD
APP APP APP APP
![Page 4: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/4.jpg)
Goal: Give developers the freedom to innovate faster across on-premises and public clouds
4 BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
PHYSICAL
APP APP APP APP
VIRTUALPUBLICCLOUD
VM CC C
On-premises
Kubernetes-powered Open Hybrid Cloud
![Page 5: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/5.jpg)
5 BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
VIRTUAL
Containers | VMs | Serverless Apps
BARE METAL PRIVATE CLOUD PUBLIC CLOUDS
Kubernetes on OpenStack is focused on the private cloud
![Page 6: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/6.jpg)
6
Kubernetes on OpenStack
Introduction
![Page 7: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/7.jpg)
7 VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
DATACENTRE
WORKLOADDRIVEN
PROGRAMMATIC API DRIVEN
ACROSS INFRASTRUCTURE
DEEPLYINTEGRATED
Why Kubernetes on OpenStack?Open, scalable, managed, workloads.
SCALE OUT
SOLID FOUNDATION
![Page 8: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/8.jpg)
8
Kubernetes on OpenStack Integrations
![Page 9: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/9.jpg)
Kubernetes and OpenStack Are Complementary
Consumption of resourcesProvides the container platform layer
Exposition of resourcesProvides the infrastructure layer
complementary
![Page 10: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/10.jpg)
Kubernetes on OpenStack Key Integration Points
![Page 11: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/11.jpg)
Kubernetes on OpenStack Integration Example: Cinder
![Page 12: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/12.jpg)
OpenShift on OpenStack Logical Architecture
![Page 13: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/13.jpg)
13
Installation RequirementsOpenShift on OpenStack
![Page 14: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/14.jpg)
Requirements in your OpenStack Platform
Red Hat OpenStack Platform 13 (Queens)
3 Master nodes● At least 16 GB RAM, 4 vCPUs and 25 GB Disk
At least 2 worker nodes● A least 8 GB RAM, 2 vCPUs and 25 GB Disk
Object Storage (Swift)
CoreOS image
OpenStack Resources:● Floating IPs: 2● Security Groups: 3● Security Group Rules: 60● Routers: 1● Subnets: 1● RAM: 112 GB● vCPUs: 28● Volume Storage: 175 GB● Instances: 7● Swift containers: 2● Swift objects: 1● Available space in Swift: at least 10 MB
https://github.com/openshift/installer/blob/master/docs/user/openstack/README.md
![Page 15: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/15.jpg)
15
OpenShift Internal Load Balancing and DNS
![Page 16: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/16.jpg)
DNS
● CoreDNS and mDNS run on all nodes
Internal DNS and Load Balancing
Load Balancing
● HAProxy + keepalived on master nodes
● Use of keepalived VIPs for:
○ Internal API○ Ingress traffic to workloads○ Internal DNS requests
The openshift-installer will configure internal Load Balancing & DNS
https://github.com/openshift/installer/blob/master/docs/design/openstack/networking-infrastructure.md
![Page 17: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/17.jpg)
17
Kuryr-Kubernetes SDNSDN for OpenShift on OpenStack
![Page 18: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/18.jpg)
Kuryr improves the network performance of pods when running on OpenStack.
SDN solution using Kubernetes Container Network Interface (CNI) and OpenStack Neutron.
Provides interconnectivity between Kubernetes pods and OpenStack virtual instances
Kuryr-Kubernetes Logo
Kuryr-Kubernetes CNI
18
![Page 19: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/19.jpg)
Recommended when
● Neutron tenant networks are used for OpenShift Application Nodes
Not recommended when
● Using only OpenStack VLAN-based provider networks (Kuryr not needed)
● Many OpenShift services and few hypervisors:○ For each OpenShift service, Octavia will run a VM with a
load balancer in it
When to use Kuryr
19
Requires
● OpenStack Queens or newer● Octavia Load Balancer● Neutron Trunk Ports
![Page 20: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/20.jpg)
Kuryr Internal Architecture
20
Kuryr integrates with Neutron and Octavia
Pods are connected via Kuryr CNI to Neutron
Kuryr creates Load Balancers with Octavia for the Kubernetes services
![Page 21: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/21.jpg)
21
Bandwidth tests between pods on the same hypervisor show slightly better performance
Kuryr Performance ComparisonPerformance test done with OpenShift 3.11 / Kubernetes 1.11 and OpenStack Queens
![Page 22: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/22.jpg)
22
Bandwidth tests between pods on different hypervisors show up to 9x performance improvement
Kuryr Performance ComparisonPerformance test done with OpenShift 3.11 / Kubernetes 1.11 and OpenStack Queens
![Page 23: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/23.jpg)
23
Kuryr Performance Comparison Blog PostPerformance test done with OpenShift 3.11 and OpenStack Queens
https://blog.openshift.com/accelerate-your-openshift-network-performance-on-openstack-with-kuryr
![Page 24: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/24.jpg)
24
Reference Architecture
![Page 25: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/25.jpg)
OpenShift on OpenStack Reference ArchitectureCurrent: OSP 13 LTS and OCP 3.11 with Kuryr | Next: OSP 13 LTS and OCP 4.3 with Kuryr
25 https://access.redhat.com/documentation/en-us/reference_architectures/2019/html-single/deploying_red_hat_openshift_container_platform_3.11_on_red_hat_openstack_platform_13
![Page 26: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/26.jpg)
26
Ways to Install Kubernetes on
OpenStackIntroduction
![Page 27: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/27.jpg)
27 BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
VIRTUALBARE METAL PRIVATE CLOUD
Full Stack AutomationSimplified, opinionated
Installer-provisioned OpenStack resources (IPI)
Pre-existing InfrastructureUser-provisioned
OpenStack resources (UPI)
Kubernetes Installation with OpenShift 4 on OpenStackInstallation Experiences
![Page 28: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/28.jpg)
28 BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
VIRTUALBARE METAL PRIVATE CLOUD PUBLIC CLOUDS
Installer Provisions:
Networks
Internal Load Balancers1
Internal DNS1
OpenStack Instances
Red Hat CoreOS
CoreOS Ignition Configs
OpenShift Nodes
OpenShift Cluster Resources
Full Stack Automation InstallationDeploying OpenShift on OpenStack with installer-provisioned infrastructure (IPI)
Red Hat OpenStack Platform
Overcloud
OpenShift Cluster
. . .
openshift-install
1External Load Balancers (routing) and external DNS servers are provided by the user
![Page 29: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/29.jpg)
29 BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
VIRTUALBARE METAL
User Provisions:
Networks
Internal Load Balancers1
Internal DNS1
OpenStack Instances
Red Hat CoreOS
CoreOS Ignition Configs
OpenShift Nodes
OpenShift Cluster Resources
Installing on Pre-existing InfrastructureDeploying OpenShift on OpenStack with user-provisioned infrastructure (UPI)
openshift-install
User provisioned resources
Red Hat OpenStack Platform
Overcloud
OpenShift Cluster
. . .
![Page 30: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/30.jpg)
30 VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
Installing on OpenStack DocumentationUser-provisioned Infrastructure | Installer-provisioned Infrastructure
USER PROVISIONED INFRASTRUCTURE
INSTRALLER- PROVISIONED INFRASTRUCTURE
https://github.com/openshift/installer/blob/master/docs/user/openstack/README.mdhttps://github.com/openshift/installer/blob/master/docs/user/openstack/install_upi.md
![Page 31: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/31.jpg)
OpenShift 4.2 on OpenStack
31 try.openshift.com
![Page 32: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/32.jpg)
32
OpenStack Bare MetalIronic Introduction
![Page 33: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/33.jpg)
Bare Metal On-Trend
OpenStack User Survey 2017
Among users who run Kubernetes on OpenStack, adoption of Ironic is even stronger with 37% relying on it.
OpenStack User Survey 2018
![Page 34: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/34.jpg)
Popular Use Cases
Kubernetes on Bare Metal
High-Performance Computing
Direct Access to Dedicated Hardware Devices
Big Data and Scientific Applications
Bare Metal On-Trend
![Page 35: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/35.jpg)
OpenStack Bare Metal Service - IronicHardware Lifecycle Management
Hardware InspectionServers and Network Switches (via LLDP)
OS Image ProvisioningSupporting qcow2 images
Routed Spine/Leaf NetworkingProvisioning over routed networks
Multi-TenancyWith network isolation between tenants
Node Auto-discovery
Broad Power Management SupportRedfish, iDrac, iRMC, iLo, IPMI, oVirt, vBMC
![Page 36: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/36.jpg)
36
OpenStack Bare MetalFeatures
![Page 37: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/37.jpg)
Tenant-Dedicated NetworksInstead of a shared flat network
Provisioning Over an Isolated Network
Switch Ports Dynamically ConfiguredAt deployment time and on termination
Link Aggregation L2 Switch
BM
NIC NIC
LAG
bond
Configured by ML2 plug-in
Configured by cloud-init using
metadata
L2 Switch
BM
NIC
VLANs set by by ML2 plug-in
BM
NIC
L2 Switch
Multi-Tenant Support with Isolation Between TenantsAvailable from OpenStack Queens
![Page 38: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/38.jpg)
Multi-Tenant Support with Isolation Between TenantsAvailable from OpenStack Queens
Neutron ML2 Networking-Ansible Driver
Multiple Switch Platforms in a Single ML2 DriverLeveraging the Networking Ansible modules
Available in OpenStack Queens | Red Hat OpenStack Platform 13OSP 13 Long Life Support
Provisioning Network is configured in the switch
Boot BM on Tenant
Network
ML2 Plug-in Configures
Switch
BM is Provisioned
ML2 Plug-in Configures
Switch
Tenant Network is configured in the switch
BM is ready
L2 Switch
BMNIC
BMNIC
![Page 39: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/39.jpg)
spine switch
Bare Metal
Bare Metal
Bare Metal
Bare Metal
Bare Metal
Bare Metal
Bare Metal
Bare Metal
Bare Metal
Bare Metal
spine switch spine switch
L3 routed networks
ToR/leaf switch
Bare Metal
Ironic Node
Ironic Node
Ironic Node
Bare Metal
ToR/leaf switch ToR/leaf switch
DHCP Relay DHCP Relay DHCP Relay
L3 routed networks
L3 Spine and Leaf TopologiesIronic provisioning bare metal nodes over routed networks
DHCP RelayAllowing PXE booting over L3 routed networks
L3 Routed Networks (Spine/Leaf Network Topologies)Available from OpenStack Queens IPv6 Support being added to OpenStack Train and above
![Page 40: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/40.jpg)
BIOS Configurationsdocs.openstack.org/ironic/latest/admin/bios.html
Get and Set BIOS SettingsRetrieve and apply BIOS settings via CLI or REST API. The desired BIOS settings are applied during manual cleaning.
Settings Applied During Node CleaningThe desired BIOS settings are applied during manual cleaning
[{ "name": "hyper_threading_enabled”, "value": "False" }, { "name": "cpu_vt_enabled", "value": "True" }]
![Page 41: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/41.jpg)
Ironic Inspector Nodes Auto-Discovery
Just Power On the NodesNodes PXE boot from the provisioning network used by Ironic
Automatic Node InspectionNodes boot from the network and their hardware is inspected
Nodes Automatically Registered with IronicAfter inspection they are registered with Ironic and ready to be deployed
Use Rules to Set Node Properties E.g. set Ironic driver (iDrac, Redfish…) based on inspection data, set BMC credentials, etc.
cat > rules.json << EOF[ { "description": "Set the vendor driver for Dell hardware", "conditions": [ {"op": "eq", "field": "data://auto_discovered", "value": true}, {"op": "eq", "field": "data://inventory.system_vendor.manufacturer", "value": "Dell Inc."} ], "actions": [ {"action": "set-attribute", "path": "driver", "value": "idrac"}, {"action": "set-attribute", "path": "driver_info/drac_username", "value": "root"}, {"action": "set-attribute", "path": "driver_info/drac_password", "value": "calvin"}, {"action": "set-attribute", "path": "driver_info/drac_address", "value": "{data[inventory][bmc_address]}"} ] }]EOF
$ openstack baremetal introspection rule import rules.json
Data collected during inspection
E.g: Use the the idrac driver and its credentials if a Dell node is detected
![Page 42: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/42.jpg)
Redfish Support in Ironic
API-driven Remote Management PlatformManage large amounts of physical nodes via API. redfish.dmtf.org
Included in Modern BMCsMost vendors support Redfish in the latest models
Supported in IronicIntroduced in OpenStack Pike, along with the Sushy library
Improvements in OpenStack Train and BeyondOut-of-band inspection of nodes, boot from virtual media (without DHCP) and BIOS configurations
openstack baremetal node create \ --driver redfish \ --driver-info redfish_address=https://example.com \ --driver-info redfish_system_id=/redfish/v1/Systems/CX34R87 \ --driver-info redfish_username=admin \ --driver-info redfish_password=password
![Page 43: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/43.jpg)
43
OpenShift on OpenStack-Managed
Bare MetalDeployment of Kubernetes on the metal
![Page 44: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/44.jpg)
Kubernetes Cluster
Kubernetes on Bare MetalDeploy Kubernetes on OpenStack-managed bare metal nodes
OpenShift Installer
Master Node
Worker Node
Worker Node
Deploy OpenShift
OpenStack with Ironic
https://docs.openshift.com/container-platform/4.2/installing/installing_bare_metal/installing-bare-metal.html
![Page 45: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/45.jpg)
45
Metal3Deployment of Kubernetes on the metal
![Page 46: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/46.jpg)
46 BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
VIRTUAL
Containers | Serverless Apps
BARE METAL PRIVATE CLOUD PUBLIC CLOUDS
Metal3 is focused on Kubernetes on bare metal
![Page 47: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/47.jpg)
Metal3
Metal Kubed, bare metal host provisioning for Kubernetes
Metal3 Kubernetes Operators FrameworkIronic
Metal3 enables bare metal host management with Kubernetes.
![Page 48: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/48.jpg)
48
Metal3 runs on Kubernetes.
And is managed through Kubernetes interfaces.
Metal3
Metal Kubed, bare metal host provisioning for Kubernetes
![Page 49: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/49.jpg)
49
Actuator allows Kubernetes to get Machines the same way it would in a public cloud, using the Kubernetes cluster-api
Operator uses Ironic behind the scenes to manage the physical hardware represented as BareMetalHost objects.
MACHINE CONTROLLER
BARE-METAL ACTUATOR
BARE METAL OPERATOR
Bare Metal Management PodsBare Metal Management PodsBARE-METAL MANAGEMENT PODS
Metal3
Metal Kubed, bare metal host provisioning for Kubernetes
Ironic
![Page 50: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/50.jpg)
50
Try it:
http://metal3.io/try-it.html
Install OpenShift using it:
https://github.com/openshift/installer/blob/master/docs/user/metal/install_ipi.md
Metal3
Metal Kubed, bare metal host provisioning for Kubernetes
![Page 51: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/51.jpg)
51
SummaryKubernetes on OpenStack
![Page 52: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/52.jpg)
52 VIRTUAL PRIVATE CLOUD PUBLIC CLOUDS
Run Kubernetes on OpenStack and Bare Metal Fast
Install Kubernetes on OpenStackhttps://github.com/openshift/installer/blob/master/docs/user/openstack/README.mdhttps://github.com/openshift/installer/blob/master/docs/user/openstack/install_upi.md
Kuryr performancehttps://blog.openshift.com/accelerate-your-openshift-network-performance-on-openstack-with-kuryr
Reference Architecturehttps://access.redhat.com/documentation/en-us/reference_architectures/2019/html-single/deploying_red_hat_openshift_container_platform_3.11_on_red_hat_openstack_platform_13
Ironic Bare Metalhttps://access.redhat.com/documentation/en-us/red_hat_openstack_platform/13/html-single/bare_metal_provisioning/index
Metal3 metal3.io
![Page 53: OpenStack and Bare Metal Run Kubernetes on Fast...1 Run Kubernetes on OpenStack and Bare Metal Fast Ramon Acedo Rodriguez Senior Principal Product Manager, Red Hat EMBER 4-6 2019 3](https://reader030.vdocuments.mx/reader030/viewer/2022041001/5ea116423d8de5688765d082/html5/thumbnails/53.jpg)
53
Red Hat is the world’s leading provider of enterprise
open source software solutions. Award-winning
support, training, and consulting services make Red
Hat a trusted adviser to the Fortune 500.
Thank you