cloudcon data mining presentation

24
CloudCon, Tuesday, October 2 nd , 11am

Upload: brian-johnson

Post on 06-Dec-2014

429 views

Category:

Documents


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: CloudCon Data Mining Presentation

!!

!

CloudCon, Tuesday, October 2nd, 11am

Page 2: CloudCon Data Mining Presentation

Every Second – in over thousands of Categories

Page 3: CloudCon Data Mining Presentation

www.wallpapertimes.com

$’s per year in incremental revenue

Value > Cost

Page 4: CloudCon Data Mining Presentation

Big

Page 5: CloudCon Data Mining Presentation

Detail

Page 6: CloudCon Data Mining Presentation

structured

incremental storage

processing

change

Volume

Variety Velocity DATA

semi-structured un-structured

Page 7: CloudCon Data Mining Presentation

Data Warehouse + Behavioral

Data Warehouse

Semi-Structured SQL++

Structured SQL

Low End Enterprise-class System

Contextual-Complex Analytics Deep, Seasonal, Consumable Data Sets

Production Data Warehousing Large Concurrent User-base

Enterprise-class System

Unstructured Java/C++/Pig/Hive

Structure the Unstructured Detect Patterns

Commodity Hardware System

8+PB 60+PB 40+PB

Hadoop

Analyze & Report

Discover & Explore

Page 8: CloudCon Data Mining Presentation

!   Data Growing Faster

Page 9: CloudCon Data Mining Presentation
Page 10: CloudCon Data Mining Presentation

10

questions later

structure later

(<$0.04/GB, <$80/2TB)

single HDFS instances >50PB

Value > Cost

Data

Page 11: CloudCon Data Mining Presentation

Designing for the Unknown >85% of analytical workload is NEW & Unknown The metrics you know are cheap The metrics you don’t know are expensive – but high in potential ROI Exploration & Testing are core pillars of an analytics-driven

organization

Page 12: CloudCon Data Mining Presentation

•  Impact

Page 13: CloudCon Data Mining Presentation
Page 14: CloudCon Data Mining Presentation

!"#$ %$& '()*+,"-+ .-)/01$2& 3-#$4! 5"*2"$, 5"*2&4! 6*77"$, 6*77&4! 82*+6$22"$, 82*+6$22&4! 9-77"+7 9-74! :",;"+7/,#"8<$2 :",;/,#"8<$2,4% )*+$=, )*+$=="+74% )2-#$8#"-+ )2-#$8#$24% ="+"+7 ="+$54% *+">*#"-+ *+">*#$54% #218<, #218<"+74% $57"+7 $57$,4% +$#, +$##"+7

Page 15: CloudCon Data Mining Presentation

!"#$ %$& '()*+,"-+ .-)/01$2& 3-#$4! 5"*2"$, 5"*2& 6*7)"2$/5"*2"$,4! 8*99"$, 8*99& )*#*9-+"*/8*99"$, 9--5/:-2/)*#*9-+"*/8*99&;/+-#/9--5/*<-+$4! =2*+8$22"$, =2*+8$22& #>$/=2*+8$22"$,4! ?-99"+9 ?-9 ?-99"+9/,#2-<<$24! :",>"+9/,#"=@$2 :",>/,#"=@$2, :",>"+9/,#"=@$2 ,)-2#,/6,A/@"5,/2--7,4% )*+$<, )*+$<<"+9 :$+=$/)*+$<,4% )2-#$=#"-+ )2-#$=#$2 7=*:$$/#-#*</)2-#$=#"-+/BCDB ,=2$$+/)2-#$=#$2/",/#-)/4!/E1$2&4% <"+"+9 <"+$5 )"+@/<"+"+9/=>*+9"+9/8*94% *+"7*#"-+ *+"7*#$5 *+"7*#"-+/=$<4% #21=@, #21=@"+9 =-29"/#21=@,4% $59"+9 $59$, 9*25$+/$59"+94% +$#, +$##"+9 )12,$/+$#,

Page 16: CloudCon Data Mining Presentation
Page 17: CloudCon Data Mining Presentation
Page 18: CloudCon Data Mining Presentation

www.wallpapertimes.com

$’s per year in incremental revenue

Value > Cost

Page 19: CloudCon Data Mining Presentation
Page 20: CloudCon Data Mining Presentation
Page 21: CloudCon Data Mining Presentation

Toys and Hobbies ATC > Artist trading card in ART ATC > Automatic Tool Change in Business and Industrial

Page 22: CloudCon Data Mining Presentation

German Compound Words •  German compound words can be arbitrarily created and extremely long

Adidastrainingsanzug (Adidas track suit) Rindfleischetikettierungsüberwachungsaufgabenübertragungsgesetz

(beef labeling regulation & delegation of supervision law) •  Syntactically, words can be combined and split in many ways. •  Some words shouldn’t be de-compounded.

beiden (both) – bei(at) den(the) •  Too many candidates for

Granitpflastersteine (granite paving stones) Granit(granite) pflastersteine(cobblestones) Granit(granite) pflaster(paving/band-aid) steine(stones)

•  Binding characters Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de) Hochzeitschuhe (129 hits on ebay.de).

Page 23: CloudCon Data Mining Presentation

Synonyms  derived  from  top  queries  in  item  query  clusters  texas  instruments  ba  ii  plus   /  ba  ii  plus  brighton  handbag   brighton  purse  lenovo  x200   thinkpad  x200  king  bedspread   king  coverlet  rockabilly  dress   swing  dress  1963  ford  falcon   63  falcon  jessica  simpson  hair  extensions   jessica  simpson  hairdo  

 Abbrevia7ons/acronym  derived  from  query  transi7ons  

stanford  ky   stanford  kentucky  dc  sub   dc  subwoofer  snowboard  helmet  l   snowboard  helmet  large  motorcycle  cam   motorcycle  camera  diamond  amp   diamond  amplifier  

Page 24: CloudCon Data Mining Presentation