efficient big data solutions: how to maximize results with less effort and lower costs

73
© 2014 PSC Group, LLC

Upload: jim-vaselopulos

Post on 27-Jan-2015

107 views

Category:

Technology


4 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 2: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 3: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Do you know who this is?

Page 4: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Big Data Today

Page 5: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Agenda – Big Data v Complexities of Terabyte Storage

v Storage Array Networks

v Ultra-Fast Networking Requirements

v Data Warehouse Basics

v Analytics Tool Recommendations – Hadoop?

v Ad-hoc Reporting

v Back-up Strategies

Page 6: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

v Complexities of Terabyte Storage

v Storage Array Networks

v Ultra-Fast Networking Requirements

v Data Warehouse Basics

v Analytics Tool Recommendations

v Ad-hoc Reporting

v Back-up Strategies

Agenda – Big Data

stop thinking like a geek

Page 7: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 8: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

For Production

From Consumption

Our Focus needs to be on Information Consumption

© 2014 PSC Group, LLC

Page 9: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

We exist to help others make better decisions.

© 2014 PSC Group, LLC

Page 10: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Real vs. Perceived Value

If we just provide the INFORMATION…

v Do we care if the message is received?

v Do we care if the message is understood?

v Do we care if the proper action is taken?

v Are we JUST providing information or are we helping the business to achieve a result?

Page 11: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 12: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

What is our

Delivering Information CONDUIT

COMMUNICATOR

PARTNER

Describing a Situation

Guiding the User

Knowledge

Information

Wisdom

Page 13: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

What is our

Delivering Information CONDUIT

COMMUNICATOR

PARTNER

Describing a Situation

Guiding the User

Knowledge

Information

Wisdom

Page 14: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

What is our

Delivering Information CONDUIT

COMMUNICATOR

PARTNER

Describing a Situation

Guiding the User

Knowledge

Information

Wisdom Better Relationship between Business & IT

Page 15: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Seems Logical…���but it’s just not that easy

© 2014 PSC Group, LLC

Page 16: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Impediments to Success v Statistics

v Attention

v Perception

v Motivation

v Extreme Speed

v Information Overload

Page 17: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Compelling Influences

Page 18: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Statistics of Statistics v Who has taken a statistics class?

v Who has applied the scientific method at work?

v Who wishes their staff would?

v Who has recently done a Chi-squared test?

v Who has recently peformed a t-test?

v Who has done a correlation analysis?

v Who has done a regression analysis?

Page 19: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

A man is described as meek, shy, tidy and helpful…

Page 20: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

A man is described as meek, shy, tidy and helpful…

Is he more likely to be a librarian or a farmer?

Page 21: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Statistics FAIL

Page 22: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Statistics FAIL

Don’t Assume the People with the Statistics Understand Statistics

Page 23: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Statistics Success v Large Global Insurance Firm

v Large Investments/Improvements in Network

v Perceived Network Sluggishness by Users

v Sr. Management Getting Negative Feedback

v We Executed a Large Statistical Analysis

v Compared Technical Data & User Surveys

v Suprising & Statistically Significant Finding!

Page 24: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Attention?

Page 25: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Paying Attention?

In our distracted world, people often miss critical changes

Page 26: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

What Letter Is This?

Page 27: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

What Letter Is This?

C T

Page 28: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Are you sure?

C T T E

Page 29: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Are you sure?

C T T E

CONTEXT is VERY IMPORTANT

Page 30: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Motivation

Distractions CONFLICTS Choices

© 2014 PSC Group, LLC

Page 31: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

In 60 Seconds… v  1 new definition in urban dictionary

v  1600+ reads on Scribd

v  13,000+ hours of music streaming on Pandora

v  12,000+ new ads posted on Craigslist

v  370,000+ minutes of voice calls on Skype

v  98,000+ Tweets

v  320+ new Twitter accounts

v  100+ new LinkedIn accounts

v  1 new associatedcontent article published

v  6,600+ new pictures uploaded on Flikr

v  50+ WordPress downloads

v  125+ WordPress plugin downloads

v  695,000+ Facebook status updates

v  79,364 Facebook wall posts

v  510,040 Facebook comments

v  1,700+ Firefox downloads

v  694,445 Google search queries

v  168 million emails are sent

v  60+ new blogs

v  1,500+ new blog posts

v  70+ domains registered

v  600+ new YouTube videos

v  25+ hours of duration of new YouTube videos

v  100+ questions asked on the Internet

v  40+ questions answered on the Internet

v  13,000+ iPhone applications downloaded

v  20,000+ new posts on Tumblr

Page 32: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Which one would you read?

Page 33: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

The Pace of Business is Incredibly Fast

Page 34: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 35: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

It’s all about

processing the Past INFORMATION

predicting the Future

Observing the Present KNOWLEDGE

WISDOM The VELOCITY of Information is Increasing

CONTEXT facilitates consumption DELIVERY method favors speed

Page 36: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

All Efficient Systems/Processes want Matching Velocities

Page 37: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Don’t let Precision���Slow You Down

Page 38: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Information Velocity

is a function of

ACCURACY, CONTEXT

and DELIVERY

Page 39: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Information Overload

Page 40: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Multi-Tasking?

Page 41: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Our Changing World

Page 42: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

The Real Deal?

Page 43: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Training vs. Frequency

TRAI

NING

FREQUENCY OF EXECUTION

Page 44: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Zombie Systems

Page 45: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 46: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

500mph?

Page 47: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

© 2014 PSC Group, LLC

Page 48: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

© 2014 PSC Group, LLC

Page 49: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

In-Race Adjustments

Page 50: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

v A simple business process is running a race

v A simple metric is the distance x(t) you cover

v To measure success you need to know your position at time t

v In order to improve you need to know distance and time… which gives you velocity v(t) = δx/δt

v And if you take that one step further you get acceleration a(t) = δv/δt

v This is great because changes in acceleration are an early warning system – Predictive Analytics!

WARNING! Calculus Content

Page 51: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

© 2014 PSC Group, LLC

Page 52: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 53: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Context, Context, Context Business Processes & Time, Location, etc.

Interpret & Present Visually Interpret Results & Reveal Change!

It’s all about TIME Velocity, Accuracy & Half-Life

Split Times & Training Information that is useful DURING the race

CLEAR

EASY

RELEVANT

ACTIONABLE

Page 54: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC © 2010 PSC Group, LLC

Location

GPS

Proximity

Social Network

Tools

You were on fire tonight!

© 2014 PSC Group, LLC

Page 55: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Technology alone does not provide context CONTEXT is the product of

Environment & Information

Right TIME, Right PLACE, Right PERSON

© 2014 PSC Group, LLC

Page 56: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 57: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Page 58: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Inside Sales - Quoting

Accounts Receivable Clerk

Customer

Page 59: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

The focus should be on the business processes���NOT the Technology

v Do you have a written inventory of key business processes?

v Do you know expected completion times?

v Do you collect any split-times?

v Do you benchmark against others?

v Do you benchmark internally?

Page 60: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Split-Times are the Key to

RESULTS

Page 61: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Annur & Panel – SPOT ON!

People

Process

Technology

Page 62: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Context, Context, Context Business Processes & Time, Location, etc.

Interpret & Present Visually Interpret Results & Reveal Change!

It’s all about TIME Velocity, Accuracy & Half-Life

Split Times & Training Information that is useful DURING the race

CLEAR

EASY

RELEVANT

ACTIONABLE

Page 63: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Big Data Pattern Quiz

v 12 Days

v 32 Years

v 32,000 Years

Page 64: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Big Data Pattern Quiz

v 12 Days ≈ 1 Million Seconds

v 32 Years ≈ 1 Billion Seconds

v 32,000 Years ≈ 1 Trillion Seconds

Page 65: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

$100

Page 66: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

$10,000

Page 67: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

$1 Million

Page 68: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

$100 Million

Page 69: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

$1 Billion

Page 70: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

$1 Trillion

Page 71: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

$1 Trillion

Page 72: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC

Our National Debt

Page 73: Efficient Big Data Solutions: How to Maximize Results with Less Effort and Lower Costs

© 2014 PSC Group, LLC