“multisysta/virtualizationseminar/mava_cloud.pdf · openstack markku vajaranta 13.4.2016 32 •...

“Multi-tenant, highly

scalable, performant, fault-

tolerant, scriptable

virtualization platform for

lazy researchers“

Markku Vajaranta

(53 slides)

“Multi-tenant, highly

scalable, performant, fault-

tolerant, scriptable

virtualization platform for

lazy researchers“

-

As we use to say

Acknowledgements

• Thanks to: Kristian Köhntopp, Cloud Architect at

SysEleven GmbH Openstack reality check :

http://www.slideshare.net/isotopp/openstack-reality-

check-dach-tag-edition

• Thanks to the Department of Pervasive Comp. For the

playground

• Thanks to Otto Hylli for Openstack slides and guide

(http://docs.openstack.org/admin-guide/index.html)

13.4.2016 Markku Vajaranta 3

http://www.slideshare.net/isotopp/openstack-reality-check-dach-tag-edition











Terminology

• IaaS, infrastructure as a service. E.g.

Openstack cloud. VMWare ESXi server.

• DFS, Distributed filesystem

• SW, Switch


Use case #1 - VMs for

research and development


Use case #2 VMs for students


Use case #3 – Student VMs


Multi-tenant

• Different permissions

• Different needs

• Different virtual machine requirements


High Scalable

• Did you see the amount of VMs on the use

cases?

– Not always

• Different use cases


Performant

• Did you see the amount of VMs on the use

cases?

• Peaks might occur e.g. in surveillance VMs in

research tenant


Scriptable

• Would you like to copy manually those 81

VMs ?

• Copy, Delete, Restore


Virtualization platform(s)

software stuff

• VMWare

• Xenserver

• Openstack

• HPE Helion

Eucalyptus

• KVM

• Microsoft Hyper-V


• LXC

• OpenVZ

• Docker

• Vagrant

Hold the horses!

• What is that we want ?


• Any VM, Anywhere


• Infrastructure as Code


VMWare

• Multi-tenant

• High scalable

• Performant

• Fault-tolerant

• Scriptable

• Virtualization platform


VMWare

• Multi-tenant

– Active Directory

– vSphere centralized management

– Costly licenses

– Management in 5.5. through vmware vsphere

client for Windows or WebUI

• in 6.x through WebUI


VMWare

• High Scalable

– Several Servers

– In 5.5.x requires fiber channel database

– 6.x can have VSAN

– Networking using virtual switches


VMWare

• Performant

– One HP Gen8 can handle

100 machines nicely

2x Xeon E5-2640 and 160Gb Ram

– resource pools

– Fast VM deployment… NOT


VMWare

• Fault-tolerant

– Live migration to host

– Requires FC disks

– Requires costly enterprise licenses

– Can though occur automatically


VMWare

• Scriptable

– NOT

– vSphere Management Assistant (VMA)

machine (SLES)

– Microsoft powershell


VMWare, VMA

source /opt/vmware/vma/bin/vifptarget -s seclab-esxi2.sec.rd.tut.fi

for i in {3801..3827}

do

vlan_number=$i

vlan_name=VLAN-$i-Shellshock_LAB

echo $vlan_number

echo $vlan_name

vicfg-vswitch -A $vlan_name vSwitch1

vicfg-vswitch -v=$vlan_number -p $vlan_name vSwitch1

done


VMWare, Powershell

$nameOfFW="Shellshock_FW_"

$nameOfXP="Shellshock_XP_"

$nameOfUBUNTU="Shellshock_UBUNTU_"

$nwPRE="VLAN-"

$nwPOST="-Shellshock_LAB"

$first_VLAN=3801

$last_VLAN=3827

for($i=$first_VLAN; $i -le $last_VLAN; $i++)

{

$nameIs=$nameOfUBUNTU + $i

$nwIs=$nwPRE + $i + $nwPOST

New-VM -name $nameIs -template TEMPLATE_piglet_Ubuntu_Apache -Resourcepool shellshock

Get-VM $nameIs | Get-NetworkAdapter -name "Network adapter 1" | Set-NetworkAdapter -NetworkName $nwIs -Confirm:$false

}


VMWare

• Virtualization platform

– Did I say about the licenses?

– Yearly renewal! (in academic licence)

– Clear separation for each single different

component in bigger environment


Xenserver

• Pros

– Scriptability

– Open source

– Pools

– Migration

– Xen-orchestra

brings the WebUI

and cloud-init

– Openvswitch


• Cons

– Scriptability

– VM deployment

– Management SW

only for Windows

– FC, iSCSI NFS

– Messy component

structure

– User policies

Xenserver, OVS


Xenserver, scripting


For i in {1..100}

do

xe vm-clone vm="$TEMPLATE" new-name-label="$NAME_$i“

done

DFS


• GlusterFS + iSCSI / NFS

• Ceph

GlusterFS


• http://www.gluster.org/community/documentation/index.php/Setting_Volumes

Openstack

• Very popular IaaS cloud

• Great number of great developers

• Used widely in industry


Openstack

• Pros

– Scriptable through

API

– Fast VM

deployment

– True multi-tenant

– High-scalable

– Performant


• Cons

– Networking messy

– Installation messy

– * messy

– Big needs for HW

– Storage

Openstack


• Mirantis

• Foreman

• Ubuntu openstack cloud

– Requirements • At least five machines with two disks

• Two machines with x2 network interfaces (NICs)

• A dedicated switch to create a private cloud LAN

• Internet access through a router on that LAN

Openstack


Openstack


• Ridiculous requirements

• Must do everything manually, the whole stack

• Networking is terrible. Not gonna work. Using

floating IP and GRE(Generic routing

encapsulation)

• ”Where is my VM?”

• If network or storage has a bug, everything

stops.

LXC / Docker / OpenVZ

• Not a VM environment

• Scriptable

• Fast to deploy – development tools

• User control since tools used through bash

• Fault-tolerant.. err

• Networking?



• LXC Networking



nano /var/lib/lxc/MavaHOST/config

# Network configuration

lxc.network.type = veth

lxc.network.flags = up

lxc.network.link = br0

lxc.network.hwaddr = 00:ca:fe:07:49:ba

lxc.network.ipv4 = 192.168.14.5/24

lxc.network.ipv4.gateway = 192.168.14.1

# autostart configuration

lxc.start.auto = 1

lxc.start.delay = 5


Vagrant + Oracle Virtualbox

• Fast to deploy directly from command line

• True VM

• Scriptable

• Fault tolerance as bad as LXC etc case

• Networking even more horrible. Not possible

in Virtualbox since Vagrant utilizes Cloudinit

and requires NAT interface


Lets forget the software and grab a

To see what we have and what we need


So, What did we need?

• Multi-tenant, highly scalable, performant,

fault-tolerant, scriptable virtualization platform

for lazy researchers

• Any VM, Anywhere

• Infrastructure as a code


So, What did we REALLY

need?

• User control

• Easy management

• Good network, several VLANs

• High availability for VMs

• Fast VM deployment

• Scriptability


Hardware to build it

• 2 identical servers

– Enough of RAM and CPU

– 10Tb disk per machine

– 6 Nics, 2x10Gb + 4x1Gb


What does it look like


And the software review

• VMware

• Openstack

• Xenserver


And the solution

• Debian: Platform, scriptability

• AD: User control

• KVM/XEN: Virtualization

• GlusterFS: Storage

• OpenvSwitch: Networking

• Vagrant/Cloudinit/??: for deployment


Questions ?


“multisysta/virtualizationseminar/mava_cloud.pdf · openstack markku vajaranta 13.4.2016 32 •...

Documents