cloudcamp chicago lightning talk "simplicity, storytelling and big data" - craig booth,...

9
Simplicity, Storytelling & Big Data Craig Booth What I Wish I Knew About Big Data On Day One.

Upload: cloudcamp-chicago

Post on 27-Jul-2015

67 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science

Simplicity, Storytelling & Big Data

Craig Booth

What I Wish I Knew About Big Data On Day One.

Page 2: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science

My Backgrounddata driven science

30+ journal articles; complex analytics on 10s of TB of data

data powered storytelling

Page 3: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science
Page 4: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science

lumière léger

Page 5: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science
Page 6: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science
Page 7: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science

Credit: Josh Bloom Henrik Brink of wise.io

Page 8: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science

“…more than 2000 hours of work in order to come up with the final combination of 107 algorithms that gave them this prize”

Xavier Amatriain and Justin Basilico, Netflix

Page 9: CloudCamp Chicago lightning talk  "Simplicity, Storytelling and Big Data" - Craig Booth, Data Engineer at Narrative Science

“We evaluated some of the new methods offline but the additional accuracy gains that we measured did not seem to justify the engineering effort needed to bring them into a production environment.”

Xavier Amatriain and Justin Basilico, Netflix

Expla

inabil

ity

Imple

mentab

ility

Accur

acy

Can I c

ommun

icate

resu

lts?

How lo

ng w

ill it

take m

e to

build

?Can

I tole

rate

some e

rrors?