philip duff toby alcock. management stamp
TRANSCRIPT
![Page 1: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/1.jpg)
Building a Fully Automated Cloud with System Center and Hyper-VPhilip DuffToby Alcock
MDC332A
![Page 2: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/2.jpg)
What the marketing stuff says
![Page 3: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/3.jpg)
What you really need to doHardware management processStorage DesignsNetwork designs Application installationApplication ElasticityBackend integration (Legacy)Application modelsSecurity
And stuff . . .
![Page 4: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/4.jpg)
AgendaWhat we builtOutline the overall solution and some of the concepts in building large multi-tenant cloud
What worked well from MicrosoftOf the many pieces of software, what saved us
What did not workWhen we hoped Microsoft would solve our problem, and they didn’t
What we wished we had usedThe bits of technology that looked like they solved our issues
What we had to build ourselvesIn building something like this, what are the bits that nobody will give you
![Page 5: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/5.jpg)
What this session is• This is a shopping list, please take away what
you need
• This was a service provider cloud, not all concepts will relate directly to the Enterprise
• We assume you know most of the products we are discussing
• We are going to discuss our experiences, mileage may vary
![Page 6: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/6.jpg)
Marketing slide free zone
![Page 7: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/7.jpg)
What we built
![Page 8: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/8.jpg)
What we built• Enterprise Class Business Productivity• SharePoint, Exchange and Lync
• Supporting services • Active Directory, FIM, UAG, SQL, ADLDS, Hyper-V, VMM, OpsMgr, Orchestrator, etc etc
• Provides a dedicated instance• All VM’s are dedicated to one customer• Management and Infrastructure are shared• Ensures security and allows for basic customization
• Cloud based service• Low cost to manage• Elastic resources based on customer demand
![Page 9: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/9.jpg)
Datacenters and Stamps
Virtual Fabric
OperationsManager
VMM Orchestrator ConfigurationManager
ManagementStamp
![Page 10: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/10.jpg)
Customer StampsManagementStamp
Customer Stamp
Customer Stamp
![Page 11: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/11.jpg)
The big missing partManagementStamp
OperationsManager
VMM Orchestrator ConfigurationManager
Customer Stamp
Customer Stamp
Auto PilotSystem
Telemetry
Actions
External
Input
![Page 12: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/12.jpg)
What needs to be in the Auto Pilot• How to provision new services• How to keep services within Desired
Configuration• What to do with specific alerts• Attempt Auto repair• Change the desired configuration
• Maintenance Tasks and Scheduling• Elasticity The goal of the Auto
Pilot isto reduce human
interaction
![Page 13: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/13.jpg)
What worked well from Microsoft
![Page 14: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/14.jpg)
What worked well• Lots of stuff
• Server Placement• Microsoft virtual switch and VMM
networking• Bare Metal (with some help) • Orchestrator (powershell)
![Page 15: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/15.jpg)
Server Placement
![Page 16: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/16.jpg)
Virtual Machine Manager Networks
Management
Domain iSCSI Public Cluster
Management
Domain iSCSI Public Cluster
Management
Domain iSCSI Public Cluster
Management
Domain iSCSI Public Cluster
![Page 17: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/17.jpg)
Virtual Machine Manager Networks
![Page 18: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/18.jpg)
Virtual Machine Manager NetworksLogical networksHost AdaptersPort ProfilesHost TrunksVirtual SwitchesVM NetworksPort ClassifcationsEtc etc etc
![Page 19: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/19.jpg)
VMM Bare Metal Deployment
![Page 20: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/20.jpg)
Orchestrator (with powershell)• Stay as modular as you can• Need to start with a well defined structure• Need a configuration repository store
![Page 21: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/21.jpg)
What we FULLY automatedDeployment, installation and configuration of• Windows Server• Exchange • Lync• SharePoint• ADLDS• System Center OpsMgr Gateway and Orchestrator Runbook
Server• SQL 2012, mirrored, shipped and AlwaysOn• Forefront Identity Manager• Certificate requests• Active Directory Domain services• Create domain and load GPO
![Page 22: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/22.jpg)
Orchestrator Runbooks
Business Process Runbooks
Domain Runbooks
Domain Runbooks
Domain Runbooks
Worker Runbook
s
![Page 23: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/23.jpg)
Some quick help points• Use the VMM powershell command to run
3.0• Create a standard of error handling• Well documented for process for new
Orchestration• Automate validation steps• Unit Test, Functional Test, and then Test
again• Runbook tester is ok for debugging, it is not a test tool
• Codeplex IP SCORCH Dev Orchestrator• And more codeplex packs, SQL etc
![Page 24: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/24.jpg)
What did not work
![Page 25: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/25.jpg)
What did not work wellUAGService TemplatesMicrosoft best practice for sizingNIC TeamingFibre attachVersion control in OrchestratorThird party virtual switches
![Page 26: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/26.jpg)
What does UAG stand for?
U
A
G
![Page 27: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/27.jpg)
What does UAG stand for?
Unified
Access
Gateway
![Page 28: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/28.jpg)
What does UAG stand for?
Un
Automatable
Garbage
![Page 29: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/29.jpg)
What we could not automateUAG configuration
Needed to be manually configured every deployment
Lync topology builderNeeded to be run by hand for support from
MSFT
![Page 30: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/30.jpg)
VMM Service Templates
Service Template — Multi-Tier .NET Application
Web
Scale-Out Rules
IIS
HW Profile OS Profile App Profile
App
Scale-Out Rules
App Server
Data
Scale-Out Rules
Microsoft SQL Server
MSDeploy package
and configuration settings
App-V package and configuration
settings
SQL Server data-tier application (DAC)
package and configuration
settingsW2K8.VHD OS Settings
HW Profile OS Profile App Profile HW Profile OS Profile App Profile
Networking Load Balancer
![Page 31: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/31.jpg)
What we wished we had used
![Page 32: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/32.jpg)
What we wish we had usedPVLANSMBData Protection ManagerSoftware load balancersHyper-v ReplicaWindows Azure Pack
![Page 33: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/33.jpg)
Attaching shared storage to guest clusters• Need to keep the size of the VM portable• Large amounts of storage on Exchange and SQL• Large numbers of LUNS connected
• Need to be able rebalance guests across Hosts and Clusters
• Need to dynamically add and remove storage
• Want to take advantage of SAN based features
• De-Dupp, Thin Provisioning, Hierarchical Storage Management (Tiering)
![Page 34: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/34.jpg)
Live migration maintaining Fibre Channel connectivity
Virtual Fibre Channel in Hyper‑V
Hyper‑V host 1 Hyper‑V host 2
Worldwide Name Set B
Worldwide Name Set A
Worldwide Name Set B
Virtual machineVirtual machineLIVE MIGRATION• Unmediated access to a storage area
network (SAN)
• Hardware-based I/O path to virtual hard disk stack
• N_Port ID Virtualization (NPIV) support
• Single Hyper‑V host connected to different SANs
• Up to four Virtual Fibre Channel adapters on a virtual machine
• Multipath I/O (MPIO) functionality
• Live migration
Access Fibre Channel SAN data from a virtual machine
Worldwide Name Set A
![Page 35: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/35.jpg)
SMB file share
35
Improvements• Faster and simultaneous migration
• Live migration outside a clustered environment
• Store virtual machines on a File Share
VM VM
Target host
Live migration setup
SMB network storage
IP connection
Configuration data
Memory pages transferred
Memory content
MEM
ORY
MEM
ORY
Modified pages transferred
Modified memory pages
Storage handle movedLive migration based on server message block (SMB) share
VM
![Page 36: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/36.jpg)
Shared Virtual Disk on Scale-Out File Server
• Example:• Two VMs• Two Hyper-V nodes• Separate disks for OS• Shared disk for data
• VHDX files sit on a Scale-Out File Share
![Page 37: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/37.jpg)
Attaching shared storage for guest clusters
Virtual
Fibre
adapters
Shared
CSV on
SMB s
hareV
S
![Page 38: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/38.jpg)
Benjamin ArmstrongPrincipal Program Manager LeadVirtual PC
![Page 39: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/39.jpg)
Attaching shared storage for guest clusters
Virtual
Fibre
adapters
Shared
CSV on
SMB s
hareV
S
![Page 40: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/40.jpg)
Couple of other quick questions
Hyper-threading
Time Sync
R2 and Drivers
![Page 41: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/41.jpg)
What we had to build ourselves
![Page 42: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/42.jpg)
What we had to build ourselvesThe cloud auto pilot
elasticity and deploymentjob scheduling
SQL deploymentOrchestration resilience (error and restart tech)
![Page 43: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/43.jpg)
Related contentBreakout Sessions (session codes and titles)
Hands-on Labs (session codes and titles)
Product Demo Stations (demo station title and location)Related Certification Exam
Find Me Later At...
![Page 44: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/44.jpg)
Developer Network
Resources for Developers
http://msdn.microsoft.com/en-au/
Learning
Virtual Academy
http://www.microsoftvirtualacademy.com/
TechNet
Resources
Sessions on Demand
http://channel9.msdn.com/Events/TechEd/Australia/2013
Resources for IT Professionals
http://technet.microsoft.com/en-au/
![Page 45: Philip Duff Toby Alcock. Management Stamp](https://reader035.vdocuments.mx/reader035/viewer/2022062322/56649dc35503460f94ab5595/html5/thumbnails/45.jpg)
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.