cloudera wrangle 2015

Download Cloudera Wrangle 2015

Post on 13-Apr-2017

291 views

Category:

Documents

0 download

Embed Size (px)

TRANSCRIPT

  • Condense Fact from the Vapor of NuanceMike Conover, Ph.D. Staff Data Scientist, LinkedIn

  • Good Problems

  • UnambiguousConcrete Response Variables

    Ad Clicks Real Estate Pricing

    Flower Species

  • Qualitative Multidimensional

    Non-Euclidean

    Expertise

    Nebulous

    TrustSerendipity Sentiment

  • High-Fidelity Proxy Variables Crowdsourcing / In-House Evaluation

    Tip of the Spear

    Operationalize

    All models are wrong, but some are useful.George Box

  • Execution

  • Quality Control

  • Scale is the Premise

  • Spectrum

  • Qualitative Evaluation

    Heteroscedasticity Stratified Sampling

    Temporal Factors

  • Confirmation Bias

  • Fit to Print

  • LightweightNarrative Frame Toy Examples Propaganda

    Given enough eyeballs, all bugs are shallow.Eric S. Raymond

  • InfrastructureNotebooks

    Model Viewers Soup to Nuts

  • Ship It!

  • Devils BargainFeature Transformations Transcription Errors Model Specification

  • Power ToolsSingularity Somethings Wrong. Go.

    Spark & MLLib + Notebooks

  • Condense Fact from the Vapor of NuanceMike Conover, Ph.D. Staff Data Scientist, LinkedIn

  • BiomorphsIterating on Response Variables