data science introduction

29
Data Science Introduction Gang Tao

Upload: gang-tao

Post on 15-Jan-2017

257 views

Category:

Engineering


0 download

TRANSCRIPT

Page 1: Data Science Introduction

Data Science Introduction

Gang Tao

Page 2: Data Science Introduction

What is Data Science

Page 3: Data Science Introduction
Page 4: Data Science Introduction

Data Science Flow

Page 5: Data Science Introduction

Statistics and Probability

Page 6: Data Science Introduction

Admit Gender Dept Freq

Admi.ed Male A 512

Rejected Male A 313

Admi.ed Female A 89

Rejected Female A 19

Admi.ed Male B 353

Rejected Male B 207

Admi.ed Female B 17

Rejected Female B 8

Admi.ed Male C 120

Rejected Male C 205

Admi.ed Female C 202

Rejected Female C 391

Admi.ed Male D 138

Rejected Male D 279

Admi.ed Female D 131

Rejected Female D 244

Admi.ed Male E 53

Rejected Male E 138

Admi.ed Female E 94

Rejected Female E 299

Admi.ed Male F 22

Rejected Male F 351

Admi.ed Female F 24

Rejected Female F 317

56%44%

acceptec rejected

65%

35%

Men

Women

Page 7: Data Science Introduction

Simpsons Paradox

Page 8: Data Science Introduction

45%

16%

18%11%

Page 9: Data Science Introduction

Machine Learning

Page 10: Data Science Introduction

Data Mining or Machine Learning

Page 11: Data Science Introduction
Page 12: Data Science Introduction
Page 13: Data Science Introduction

Key Tools

• Classification

• Regression

• Cluster

• Data Reduction

Page 14: Data Science Introduction

Classification and Regression

Page 15: Data Science Introduction

Cluster

Page 16: Data Science Introduction

Data Reduction

Page 17: Data Science Introduction

Process of ML

Page 18: Data Science Introduction

Understand Data

Page 19: Data Science Introduction
Page 20: Data Science Introduction
Page 21: Data Science Introduction
Page 22: Data Science Introduction

Data Scientist

Page 23: Data Science Introduction

What is Data Scientist

• Know which question to ask

• Understand the data

• Know how to interpret the data

• Works in a team

Page 24: Data Science Introduction
Page 25: Data Science Introduction

How to become a data scientist ?

Page 26: Data Science Introduction
Page 27: Data Science Introduction
Page 28: Data Science Introduction

Data is Tricky