automating arcgis for server configurations using chef and the … · 2016-08-04 · agenda •why...
TRANSCRIPT
![Page 1: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/1.jpg)
Automating ArcGIS for Server Configurations
using Chef and the Admin APICherry Lin
Bill Major
Pavel Bobov
![Page 2: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/2.jpg)
Agenda
• Why Web GIS Automation
• Chef and Web GIS Automation
• Getting Started with a Sample using Chef and the Admin API
• Deployment Options
• Define Your Own Web GIS Deployment Configurations
• Upgrading a Distributed Deployment using Chef Server
• Chef Web GIS Automation Tips
Very new at 10.3.1
![Page 3: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/3.jpg)
What is DevOps?
• Software development method that stresses communication, collaboration
(information sharing and web service usage), integration, automation and
measurement cooperation between software developers and other information-
technology (IT) professionals.
• Organizations are looking to automate and become more efficient at administration
• Reliable deployments and upgrades (DEV TEST PROD)
![Page 4: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/4.jpg)
Why Web GIS automation
![Page 5: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/5.jpg)
This..
Desktop Web Device
Server Online Content
and Services
Portal
![Page 6: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/6.jpg)
Web GIS
Standard
…GEE
… …
Quickly turns into this..
Desktop Web Device
GIS Server
Sites
Online Content
and Services
Portal
Desktop/Pro
ArcGIS
Web Adaptor
ArcGIS
Web Adaptor
ArcGIS
Data
Store/Big
Data Store
![Page 7: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/7.jpg)
• Reliable infrastructure
- Repeatable
- Testable
• Fast Disaster Recovery
• Moving between data centers
RecoveryProduction
Dev QA
Business critical deployments
![Page 8: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/8.jpg)
ArcGIS
ArcGIS
ArcGIS
Cloud Environments
Quick configuration with Disposable machines
Rapid Auto-Scaling
Simplifies moving VMs between data centers
![Page 9: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/9.jpg)
Everybody
Simplifies deployment and upgrade procedures
Focus more on GIS tasks
Prepares for larger scale and clouds
From Esri: Ready-to-use tools with minimum
requirements to start
![Page 10: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/10.jpg)
Chef and Web GIS Automation
![Page 11: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/11.jpg)
Chef
• Chef platform consists of open source and commercial products
that automate infrastructure, applications, compliance, and the
DevOps workflow
• One of the fast growing IT automation platforms
• Supported on Windows and Linux
• Open source (Ruby based)
![Page 12: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/12.jpg)
Some Chef Components
• Cookbook - defines a scenario and contains recipes required
to support an installation/configuration scenario.
- Recipe - defines everything required to configure a
particular part of a system.
- Attribute – defines individual parameters to use during
an installation/configuration; used to override the default
installation settings.
• Chef-server vs client
![Page 13: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/13.jpg)
Esri and Chef
• Esri develops and releases via GitHub Chef cookbooks that can be used for
automation, deployments, and DevOp scenarios.
http://server.arcgis.com/en/portal/latest/administer/linux/scripting-portal-for-arcgis-
administration.htm
• Also Esri makes available AWS Cloudformation Templates that use Chef for
deployments http://arcgisstore1041.s3.amazonaws.com/5686/docs/index.html
![Page 14: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/14.jpg)
Supported ArcGIS Software
• ArcGIS Server
• ArcGIS Data Store
• Portal for ArcGIS
• ArcGIS Web Adaptor
• And other Esri Software:
- ArcGIS Pro
- ArcGIS Desktop
- ArcGIS License Manager
- ArcGIS GeoEvent Extension for Server
![Page 15: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/15.jpg)
Tested platforms
• Windows 7, 8.1, 10
• Windows Server 2008 and Windows Server 2008 R2
• Windows Server 2012 and Windows Server 2012 R2
• RHEL 6.5
• RHEL 7.0
• Ubuntu LTS 14.04 (when deploying ArcGIS for Server on Amazon Web Services)
![Page 16: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/16.jpg)
How do I get started with Esri provided Cookbooks?Install ArcGIS Server on a local Windows server
1. Visit https://github.com/Esri/arcgis-cookbook and clone/download the latest
version.
2. Extract to local workstation, e.g. D:\chef.
3. Install Chef client from https://downloads.chef.io/chef-client/
4. Edit a cookbook JSON file you are interested in running, e.g. D:\chef\roles\arcgis-
server-windows.json
5. Run chef cookbook: "chef-client -z -j D:\chef\roles\arcgis-server-windows.json“
https://github.com/Esri/arcgis-cookbook/wiki/Get-Started-With-ArcGIS-Cookbook
![Page 17: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/17.jpg)
Creating Attributes JSON file to run CookbookInstall ArcGIS Server on a local Windows server
{
"arcgis":{
"run_as_password":"Run_As_Pa$$w0rd",
"run_as_user":"arcgis",
"version":"10.4.1",
"server":{
"admin_username":"admin",
"admin_password":"changeit",
"keystore_file":"C:\\keystore\\mydomain_com.pfx",
"keystore_password":"changeit",
"directories_root":"C:\\arcgisserver",
"setup":"C:\\ArcGIS\\10.4.1\\ArcGIS_Server\\Setup.exe",
"authorization_file":"C:\\ArcGIS\\10.4.1\\Authorization_Files\\Server_Ent_Adv.prvc",
}
},
"run_list":[
"recipe[arcgis-server::system]",
"recipe[arcgis-server::server]"
]
}
![Page 18: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/18.jpg)
ArcGIS for Server and Map
Services Deployment using
Chef and Admin API
![Page 19: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/19.jpg)
What did Chef just do?
• ArcGIS Server:
• Install
• Authorize
• Create site based on parameters
• Published 2 Map Services from SD files
• Published additional 2 Map Services from SD files
• Why would you want to use Chef to publish Map Services?
• Mass publication of staged Service Definition files
• Auto-scaling environment
• Disaster Recovery scenarios
![Page 20: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/20.jpg)
Web GIS Deployment Options
![Page 21: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/21.jpg)
Multi-Machine Server GIS
![Page 22: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/22.jpg)
All-In-One Web GIS Deployment
• What chef does:
1. Uninstall and cleanup your machine if needed.
2. ArcGIS Server: Install; Authorize; Create site.
3. WA: Install; Configure to IIS; Configure for ArcGIS Server.
4. Data Store: Install; Register it with ArcGIS Server.
5. Portal for ArcGIS: Install; Authorize; Create Portal.
6. WA: Install; Configure for Portal.
7. Federate ArcGIS Server with Portal.
8. Set the ArcGIS Server as the hosting Server.
![Page 23: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/23.jpg)
Highly Available Web GIS Deployment
on Two machines
• Two machines
• Highly Available Portal for ArcGIS
• Server Site architecture
• Highly Available ArcGIS Data Store
• File Server machine
![Page 24: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/24.jpg)
Web GIS Software –
All on Different Machines
Registered
![Page 25: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/25.jpg)
Upgrade from Previous Version
10.4
10.4.1
![Page 26: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/26.jpg)
Other ArcGIS Software
![Page 27: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/27.jpg)
Define Your Own Web GIS
Deployment Configurations
![Page 28: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/28.jpg)
ArcGIS Cookbook Recipes
• system Ensures system requirements
• all_installed Installs Server, Data Store, Portal, and Web Adaptors
• iis Enables required IIS features and configures HTTPS binding
• server Installs and configures ArcGIS Server
• server_wa Installs Web Adaptor and configures it with ArcGIS
Server
• portal Installs and configures Portal for ArcGIS
• portal_wa Installs Web Adaptor and configures it with Portal
for ArcGIS
• datastore Installs and configures ArcGIS Data Store
• egdb Registers GeoDatabases with server
• Federation_server Federates ArcGIS Server with Portal for ArcGIS
![Page 29: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/29.jpg)
• Recipe
- Attributes
- Action
• Property Settings: Attibutes
• Run-list
ArcGIS Cookbook Recipe
![Page 30: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/30.jpg)
Define You Own PropertiesDefine You Own
![Page 31: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/31.jpg)
Define You Own Run List
![Page 32: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/32.jpg)
Distributed Deployment
• Login to every machine and run Chef-Client
• Chef-Server
- Central repository
- Assign roles to every machine
- Run the recipes/updates accordingly
- Setting up:
- By yourself or
- Hosted solution
![Page 33: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/33.jpg)
Demo:
Upgrade a Distributed
Web GIS Deployment
using Chef Server
![Page 34: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/34.jpg)
webgis-primary
10.4
webgis-secondary
10.4
FS
10.4.1
10.4.1Demo:
![Page 35: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/35.jpg)
Advanced Chef Deployment Options
Combine with other
community cookbooks
Pick the recipes you need
Take ready to use ArcGIS cookbooks
Write new recipes
Write your own cookbook
![Page 36: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/36.jpg)
Disconnected Environment Considerations
• Make sure you have proper Esri license files staged for use
• ArcGIS installations in a common location for access
• Setting up your own Chef Server for distributed deployments
• Having Chef Client installation staged for installation
![Page 37: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/37.jpg)
Key Point about Web GIS Chef Automation
• Automate Your Manual Work
• Work with other automation tools
• Doesn’t require programing skills
• Need up front investment
- Design
- Configuration
- Testing
• Repeatable
- Success in production environment
- Smaller downtime in production
- Faster recovery
![Page 38: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/38.jpg)
Please take our SurveyYour feedback allows us to help maintain high standards and to help presenters
Find the session you want to review
Find your event in the Esri Events App
Scroll down to the bottom of the session
Answer survey questions and submit
![Page 39: Automating ArcGIS for Server Configurations using Chef and the … · 2016-08-04 · Agenda •Why Web GIS Automation •Chef and Web GIS Automation •Getting Started with a Sample](https://reader031.vdocuments.mx/reader031/viewer/2022013021/5f1c06ac9bc97622a43ddc12/html5/thumbnails/39.jpg)