big data in the cloud - splunk · big data in the cloud aws emr and splunk analytics for hadoop...

10

Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer, Splunk September, 2017 | Washington, DC

Upload: others

Post on 21-May-2020

6 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

Big Data In The CloudAWS EMR and Splunk Analytics for Hadoop

Patrick Shumate | Solutions Architect, AWSSimon O’Brien | Staff Sales Engineer, Splunk

September, 2017 | Washington, DC

Page 2: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

During the course of this presentation, we may make forward-looking statements regarding future events or the expected performance of the company. We caution you that such statements reflect our current expectations and estimates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward-looking statements, please review our filings with the SEC.

The forward-looking statements made in this presentation are being made as of the time and date of its live presentation. If reviewed after its live presentation, this presentation may not contain current or accurate information. We do not assume any obligation to update any forward looking statements we may make. In addition, any information about our roadmap outlines our general product direction and is subject to change at any time without notice. It is for informational purposes only and shall not be incorporated into any contract or other commitment. Splunk undertakes no obligation either to develop the features or functionality described or to include any such feature or functionality in a future release.

Splunk, Splunk>, Listen to Your Data, The Engine for Machine Data, Splunk Cloud, Splunk Light and SPL are trademarks and registered trademarks of Splunk Inc. in the United States and other countries. All other brand names, product names, or trademarks belong to their respective owners. © 2017 Splunk Inc. All rights reserved.

Forward-Looking Statements

THIS SLIDE IS REQUIRED FOR ALL 3 PARTY PRESENTATIONS.

Page 3: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

Who Are We?The two dudes on the stage, of course…

Page 4: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

whoami

▶ Patrick Shumate• AWS solutions architect• Beer drinker• BBQ cooker• Virginia based

▶ Simon O’Brien• Splunk staff sales engineer• Beer drinker• BBQ eater• From Brisbane, Australia

Page 5: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

Who You Are?And what you (hopefully) already know…

Page 6: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

Why Are We Here?Because AWS and Splunk make big data analysis easy…

EMR

S3

Analytics for Hadoop

Page 7: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

© 2017 SPLUNK INC.

Plato

“I never thought big data analytics could be so easy. I can deploy this

whole platform in minutes!”

Page 8: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

© 2017 SPLUNK INC.

▶ Start with the blog post:• https://www.splunk.com/blog/2016/

10/30/how-to-splunk-analytics-for-hadoop-on-amazon-web-services-elastic-map-reduce.html

• Just google it!

▶ Check out Splunk docs▶ Check out AWS docs▶ Practice with open data sets▶ Link to VIDEO – tinyurl?

Further Reading And ContentSome other assets to help you…

Page 9: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

Demo Time

Page 10: Big Data In The Cloud - Splunk · Big Data In The Cloud AWS EMR and Splunk Analytics for Hadoop Patrick Shumate | Solutions Architect, AWS Simon O’Brien | Staff Sales Engineer,

© 2017 SPLUNK INC.

Don't forget to rate this session in the .conf2017 mobile app

Thank You

Splunk & AWS · PDF fileAmazon Elasticsearch Service Kinesis ... for full push-based architecture. Lambda can be configured to push data to a ... Use Case Kinesis Firehose Splunk AWS

Splunk のご紹介 - hitachi.co.jp · Splunkの歴史. 5 . 2006 . Splunk 1 . Splunk 2 . 2007 . Splunk 3 . 2009 . Splunk 4 . 2010 . Splunk 4.1 . 2011 Splunk 4.2 . App for Enterprise

AWS Log Collection into Splunk Integrated with AWS Control

Ted Shumate - Chord Concepts

Splunk For IT Operational Intelligence · • Splunk Apps –Splunk App for VMware –Splunk Apps for Citrix & Hyper V –Splunk App for Microsoft Exchange –Splunk App for Active

Splunk Enterprise 6.5.0 Splunk Enterprise 보안

Splunk conf2014 - Splunk for Data Science

Splunk Enterprise on the AWS Cloud - · PDF fileAmazon Web Services – Splunk Enterprise on the AWS Cloud February 2017 Page 3 of 21. Costs and Licenses. You are responsible for the

SoM 2017 report 04 - BigPandastart.bigpanda.io/.../images/State_of_Monitoring_2017_report.pdf · Enterprise SMB Top monitoring tools SolarWinds Nagios AWS Cloudwatch Spiceworks Splunk

Integrating AVANAN with AWS S3 for Splunk logs - Part One · > Select “Report security events to Splunk” if you want all new security events to be uploaded (recommended). > Select

How Comcast Turns Big Data into Real-Time Operational Insights Raanan Dagan, Big Data Solutions, Splunk Patrick Shumate, CDN Engineering, Comcast Copyright

Security and Analytics Environment on the AWS Cloud … · Page 1 of 27 Security and Analytics Environment on the AWS Cloud with Palo Alto Networks and Splunk Quick Start Reference

Splunk Spark Integration - GitHub Pageslitaotao.github.io/files/4. splunk_spark.pdf · Splunk Spark Integration ... • Splunk"products:""! Splunk"Enterprise"! ... splunk_spark Created

Splunk talk at the AWS Big Data Meetup in Palo Alto on Nov 17 2015

Security Investigation and Rapid Response Using Splunk and ... · Enter Splunk Splunk Enterprise and Splunk Cloud provide an analytics-driven approach to security on the AWS Cloud

Integrating Splunk And AWS Lambda...Integrating Splunk And AWS Lambda Big Results @ Fast-Food Prices Gary Mikula| Senior Director, Cyber & Information Security Siddhartha Dadana |

Splunk Enterprise on the AWS Cloud - Cloud Object … Web Services – Splunk Enterprise on the AWS Cloud September 2017 Page 2 of 23 Step 2. Subscribe to the Splunk Enterprise AMI

AWS Loft London: Finding the signal in the noise - Effective SecOps with Sophos & Splunk Cloud

Splunk JAWS-UG 横浜支部　AWSとセキュリティ　- re: Play -

Splunk for AWS (Bagels and Bytes)

stackArmor Security MicroSummit - AWS Security with Splunk

Splunk For IT Operational Intelligenceuploads.integrity360.com/1425903243-Splunk-for-IT-Operations.pdf · • Splunk Apps –Splunk App for VMware –Splunk Apps for Citrix & Hyper

Building*acloudMbased* SIEMwith*Splunk* Cloud*and*AWS* · Aug*08*08:26:54*snort.acmetech.com*{TCP} ... invokedBy section identifies the AWS service making request on behalf of the

Splunk App for AWS at Creative Artists Agencyfiles.meetup.com/4507922/Splunk App for AWS at... · First and foremost - replicating current AWS success in Azure to continue to provide

Using splunk to manage aws – gaining transparency into cloud computing aws summit london 2016

Splunk vs. ELK The Risk Focus Way · The difference between Splunk and Elastic at a usage level is neatly illustrated with the case of public cloud billing analyses. For AWS and Google

Splunk conf2014 - Onboarding Data Into Splunk

JAWSUG Tokyo 20130802 Tracking minecraft game user events on AWS EC2 with Splunk

SplunkingYour Mobile Apps - .conf19 | Splunk · Introducing Splunk for Mobile Intelligence (Splunk MINT) Deploying Splunk MINT – Intro to SDKs – Getting Started Using Splunk MINT

Integrating AVANAN with AWS S3 for Splunk logs - Part Two · • Note: The AWS configuration is similar to part 1, but the Splunk AWS app requires way more permissions that Avanan

Splunk conf2014 - Splunk Monitoring - New Native Tools for Monitoring your Splunk Deployment

FINAL SCFp876345 Patrick Shumate AWS Automating ... - …...The Splunk AR framework flags an AWS instance as suspicious. A Splunk AR action passes this instance along to an API endpoint

Installing Splunk Enterprise on AWS · Deploying Splunk Enterprise on AWS Instance Setting Up EC2 Instance Virtual machines on AWS EC2, also called instances, have many advantages

Referent / Redner Benjamin Tiggemann · 2015-07-08 · Splunk for Exchange Splunk for Enterprise Security* Splunk for Vmware Splunk for PCI Compliance* Splunk for Windows Splunk for

AWS Agility + Splunk Visibility Cloud Success Splunk App ...AWS Agility + Splunk Visibility = Cloud Success ... More Secure Than Your On-Premises Environment ... CloudWatch Metrics