linear classifiers & classification lecture...

Lecture 15 - 15-Nov-2016

Lecture 15: Linear Classifiers & Classification

1

Lecture 15 - 15-Nov-2016

Linear Regression

2

Slide Credit: Iasonas Kokkinos

Lecture 15 - 15-Nov-2016

Linear Regression

3

Slide Credit: Iasonas Kokkinos

Lecture 15 - 15-Nov-2016

Linear Regression

4

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

5

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

6

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

7

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

8

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

Why not closed form?

9

Lecture 15 - 15-Nov-2016

Linear Regression

Example

Y = X

w = 0

1. p = 1 -> 11.1. w’ = lr*1

2. p = -1 -> -12.1. w’ = lr*1

3. p = 2 -> 23.1. w’ = lr*4

10

Lecture 15 - 15-Nov-2016

Linear Regression

11

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

What can we learn?

12

Lecture 15 - 15-Nov-2016

Linear Regression

● XOR Example○ Picture○ Logic “features”○ Layers

● Why “layers”?

13

Lecture 15 - 15-Nov-2016

Linear Regression

14

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

15

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

16

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Linear Regression

17

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Model Complexity

18

Slide Credit: Iasonas Kokkinos

Lecture 15 - 15-Nov-2016

Linear Regression

19

Slide Credit: Pedro Domingoss

Lecture 15 - 15-Nov-2016

Images?

20

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

21

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

22

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

23

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

24

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

25

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

26

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

27

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

28

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

29

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

30

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

31

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

32

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Images?

33

Slide Credit: CS231N

Lecture 15 - 15-Nov-2016

Decision Trees

34

Lecture 15 - 15-Nov-2016

Decision Trees

35

Slide Credit: Pedro Domingoss

XOR Example