Download - Zabbix conference2015 daisukeikeda
![Page 1: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/1.jpg)
TIS Inc. Daisuke IKEDA11 September,2015
Riga,Latvia
Advanced SysOps by using HyClops
Copyright © 2015 TIS Inc. All rights reserved. -1-
![Page 2: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/2.jpg)
AgendaAbout myself
- Server Engineer working at OSS promotion officeZabbix Conference “2012” and then
- Released HyClops for Zabbix
Approaching to Advanced SysOps with OSS ecosystem- Autonomous SysOps at cloud,multi-cloud, container based env.
Our Activity 2012-2015- Cooperation with Job Management tool and Zabbix- Proxy setting automation tool etc..
HyClops roadmap 1.0- The architecture will be improved more Pluggable.- Add features monitoring detail info from AWS
Agenda
Copyright © 2015 TIS Inc. All rights reserved. -2-
![Page 3: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/3.jpg)
Daisuke IKEDATIS Inc.
OSS Promotion Office
(Main)Provide Zabbix support service. Search for the way of effective SysOps.
I wrote a Zabbix book in Japanese(2014)
About Myself
Copyright © 2015 TIS Inc. All rights reserved. -3-
Belongs To
Division
My work
RecentActivities
http://www.amazon.co.jp/dp/4774162884
![Page 4: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/4.jpg)
Talked about
“Zabbix for Hybrid Cloud Management”
Zabbix Conference 2012
Copyright © 2015 TIS Inc. All rights reserved. -4-
![Page 5: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/5.jpg)
Released “HyClops for Zabbix”July 12, 2013
And then
Copyright © 2015 TIS Inc. All rights reserved. -5-
Released at
GitHub URL https://github.com/tech-sketch/hyclops
License GPL version 2
This tool achieves...
- Auto registration of AWS or vSphere info - Show instance list at Zabbix Dashboard- Operate for multi instances on Zabbix Dashboard
![Page 6: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/6.jpg)
HyClops screen capture
Copyright © 2015 TIS Inc. All rights reserved. -6-
AWS or vSpherestatus summary
![Page 7: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/7.jpg)
HyClops screen capture
Copyright © 2015 TIS Inc. All rights reserved. -7-
AWS or vSpherestatus summary
Operate tosome instances
popup
![Page 8: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/8.jpg)
HyClops screen capture
Copyright © 2015 TIS Inc. All rights reserved. -8-
Connect to SSH servervia GateOne
![Page 9: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/9.jpg)
Make a change
Copyright © 2015 TIS Inc. All rights reserved. -9-
Only enough?
Integration & Automation
![Page 10: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/10.jpg)
Make a change
Copyright © 2015 TIS Inc. All rights reserved. -10-
Not enough!
![Page 11: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/11.jpg)
Advanced SysOps
Our concepts
Copyright © 2015 TIS Inc. All rights reserved. -11-
Change Infrastructure
Change Requirement
Physical Virtual Cloud Multi-cloud Container
Evaluate the each server resource
Service
Evaluate the service status
![Page 12: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/12.jpg)
OSS Ecosystem
Our concepts
Copyright © 2015 TIS Inc. All rights reserved. -12-
Zabbix
JobManagement
IncidentManagement
DataAnalytics
LogDataCollector
![Page 13: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/13.jpg)
Copyright © 2015 TIS Inc. All rights reserved. -13-
Activities in 2012-2015
![Page 14: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/14.jpg)
1. CloudModule for Zabbix
Activity in 2012-2015
Copyright © 2015 TIS Inc. All rights reserved. -14-
GitHub URL https://github.com/ike-dai/zabbix-cloud-module
SlideshareURL
http://www.slideshare.net/ikedai/cloudmodule-for-zabbix
Zabbix
CloudModule Delta
cloud
AWS
Loadable Modulecloud.instance.discovery
cloud.metric.discovery
CloudCache(Shared memory)
cloud.instance.infocloud.metric
![Page 15: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/15.jpg)
2. HyClops JobMonitoring
Activity in 2012-2015
Copyright © 2015 TIS Inc. All rights reserved. -15-
[Monitoring]Zabbix
[JobController]JobScheduler
GitHub URL https://github.com/tech-sketch/hyclops_jm
This tool achieves...
- Monitoring Job elapse time - Monitoring Job failure information- Adjust trigger automatically in executing some jobs
Cooperation
![Page 16: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/16.jpg)
Auto Adjust Zabbix trigger
Activity in 2012-2015
Copyright © 2015 TIS Inc. All rights reserved. -16-
Zabbix
ChangeTrigger Job
ReturnTrigger Job
Main Job
ChangeTrigger JobTemplate
ReturnTrigger JobTemplate
Job Template
Original Trigger
Disable
Temp Trigger
Create
e.g.) CPU Util >70%
via Zabbix API
timeline
e.g.) CPU Util >90%
Enable
Delete
JobScheduler
![Page 17: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/17.jpg)
JobScheduler
[Reference] About JobScheduler
Copyright © 2015 TIS Inc. All rights reserved. -17-
What?
Who?
Features
OSS Job control software (GPL ver.2)
SOS GmbH in Berlin, Germany
JobScheduler Engine
JobScheduler Engine
HA or Cluster support
JobScheduler Agent
SSH Agent
Agent or Agentless support
Advantage More detailed job controllingAll operation are executed by JobScheduler API
http://www.sos-berlin.com
![Page 18: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/18.jpg)
Copyright © 2015 TIS Inc. All rights reserved. -18-
3. Proxy scheduler
Other activity
GitHub URL https://github.com/ike-dai/proxy_scheduler_for_zabbix
Scheduler
Zabbix
rules.json
{ "agent_ip": { "proxy-01": { "from": "10.1.1.1", "to": "10.1.2.20" }, “proxy-02": { "from": "10.1.2.21", "to": "10.2.1.40" } }}
Execute caller_schedule.py
Read rule from rule.json
Decide target proxy
Register the proxy settingvia Zabbix API(host.update)
Modify the agent config(zabbix_agentd.conf)
Action
Source: Auto RegistrationOperations: Remote command
caller_schedule.py <params>
![Page 19: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/19.jpg)
Copyright © 2015 TIS Inc. All rights reserved. -19-
HyClops roadmap
![Page 20: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/20.jpg)
Improve the Base architecture
HyClops roadmap
Copyright © 2015 TIS Inc. All rights reserved. -20-
Message Queue
Message Queue
1. Discovery
….
2.PreOperation 3.Registration
AWS Discovery
Job Discovery
Target Proxy Discovery
….
Filter Operation
Machine Learning
Operation…
.
Zabbix APIRegistration
Zabbix SenderRegistration
Zabbix LLDRegistration
….
![Page 21: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/21.jpg)
Towards Advanced SysOps
HyClops roadmap
Copyright © 2015 TIS Inc. All rights reserved. -21-
- Job execution target- Point of failure in Service trouble
etc....
e.g.)Auto decision
Effective use of Zabbix.
Auto collect cloud info orjob info via HyClops
Generate synergy withsome data at the system centered on HyClops
Now
![Page 22: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/22.jpg)
HyClops 1.0- Improve the base architecture- Enhance the AWS monitoring feature
- AWS service discovery plugin- AWS EC2/RDS/ELB/CloudWatch discovery
HyClops 1.0 features
Copyright © 2015 TIS Inc. All rights reserved. -22-
![Page 23: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/23.jpg)
Mailing [email protected]
<Please send e-mails.>
GitHub repositoryhttps://github.com/tech-sketch/hyclops
<Please send issues or Pull requests.>
Please contact us!
Copyright © 2015 TIS Inc. All rights reserved. -23-
![Page 24: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/24.jpg)
Questions?
Q&A
Copyright © 2015 TIS Inc. All rights reserved. -24-
![Page 25: Zabbix conference2015 daisukeikeda](https://reader031.vdocuments.mx/reader031/viewer/2022030309/58f2d7371a28ab20218b456b/html5/thumbnails/25.jpg)
Thank You!
The End
Twitter : @ike_daiFacebook: https://www.facebook.com/ikedai
Copyright © 2015 TIS Inc. All rights reserved. -25-