tuesday january 18, 2011 - penn mathryblair/math240/papers/lec1_18.pdf · 2011-01-17 · tuesday...

25
Math 240: Matrix Operations and Linear Systems Ryan Blair University of Pennsylvania Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 1 / 13

Upload: others

Post on 20-Mar-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Math 240: Matrix Operations and Linear Systems

Ryan Blair

University of Pennsylvania

Tuesday January 18, 2011

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 1 / 13

Page 2: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Outline

1 Review of Last Time

2 Matrix Operations

3 Systems of Linear Equations

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 2 / 13

Page 3: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Review of Last Time

A Quick Review

Definition

A matrix is a rectangular array of numbers or functions

1 2 34 5 67 8 9

Matrix Operations

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 3 / 13

Page 4: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Review of Last Time

A Quick Review

Definition

A matrix is a rectangular array of numbers or functions

1 2 34 5 67 8 9

Matrix Operations

1 Matrix Addition: (aij)m×n + (bij)m×n = (aij + bij)m×n

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 3 / 13

Page 5: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Review of Last Time

A Quick Review

Definition

A matrix is a rectangular array of numbers or functions

1 2 34 5 67 8 9

Matrix Operations

1 Matrix Addition: (aij)m×n + (bij)m×n = (aij + bij)m×n

2 Scalar Multiplication: k(aij)m×n = (kaij )m×n

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 3 / 13

Page 6: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Review of Last Time

A Quick Review

Definition

A matrix is a rectangular array of numbers or functions

1 2 34 5 67 8 9

Matrix Operations

1 Matrix Addition: (aij)m×n + (bij)m×n = (aij + bij)m×n

2 Scalar Multiplication: k(aij)m×n = (kaij )m×n

3 Matrix multiplication: The ij entry is the dot product of the i-th rowof the matrix on the left with the j-th column of the matrix on theright.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 3 / 13

Page 7: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Finishing Matrix Operations

Operation: Transpose

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 4 / 13

Page 8: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Finishing Matrix Operations

Operation: Transpose

Notation: AT

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 4 / 13

Page 9: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Finishing Matrix Operations

Operation: Transpose

Notation: AT

Defined: Always

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 4 / 13

Page 10: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Finishing Matrix Operations

Operation: Transpose

Notation: AT

Defined: Always

Performed: Rows of A become columns of AT and columns of A becomerows of AT .

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 4 / 13

Page 11: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Special Matrices

Definition

A matrix is symmetric if AT = A

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 5 / 13

Page 12: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Special Matrices

Definition

A matrix is symmetric if AT = A

Definition

A matrix is square if it is of size n × n.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 5 / 13

Page 13: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Special Matrices

Definition

A matrix is symmetric if AT = A

Definition

A matrix is square if it is of size n × n.

Definition

A matrix A is diagonal if it is square and the only non-zero entries are ofthe form aii for some i .

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 5 / 13

Page 14: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Special Matrices

Definition

A matrix is symmetric if AT = A

Definition

A matrix is square if it is of size n × n.

Definition

A matrix A is diagonal if it is square and the only non-zero entries are ofthe form aii for some i .

Definition

The identity matrix of dimension n, denoted In, is the n × n diagonalmatrix where all the diagonal entries are 1.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 5 / 13

Page 15: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Matrix Properties

Let A and B be m × n matrices. Let k and p be scalars.

1 A + B = B + A

2 A + (B + C ) = (A + B) + C

3 k(A + B) = kA + kB

4 (k + p)A = kA + pA

Let 0 be the m × n matrix of all zeros

1 A + 0 = A

2 A − A = 0

3 kA = 0 implies k = 0 or A = 0.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 6 / 13

Page 16: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

More Matrix Properties

1 A(BC ) = (AB)C

2 A(B + C ) = AB + AC

3 (A + B)C = AC + BC

4 k(AB) = (kA)B = A(kB)

5 ImA = A

6 AIn = A

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 7 / 13

Page 17: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Matrix Operations

Even More Matrix Properties

1 (AT )T = A

2 (kA)T = kAT

3 (A + B)T = AT + BT

4 (AB)T = BTAT

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 8 / 13

Page 18: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Systems of Linear Equations

Human beings have needs.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 9 / 13

Page 19: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Systems of Linear Equations

Human beings have needs. One of those needs is make every system

linear.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 9 / 13

Page 20: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Systems of Linear Equations

Human beings have needs. One of those needs is make every system

linear.

Linear systems are essential to finding quantatative or approximatesolutions to any problem that can be stated mathematically

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems Tuesday January 18, 2011 9 / 13

Page 21: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Solutions to linear systems

Not every linear system has a unique solution.

Definition

A linear system is called consistent if it has a solution, it is calledinconsistent if it does not have a solution.

There are three possibilities:

1 The system has ∞-many solutions.

2 The system has a unique solution.

3 The system has no solution.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear SystemsTuesday January 18, 2011 10 / 13

Page 22: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Solving a linear system

The standard way is to use elementary operations to isolate each variable.

The elementary operations are:

1 Multiply an equation by a non-zero constant.

2 Add a non-zero multiple of one equation to another.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear SystemsTuesday January 18, 2011 11 / 13

Page 23: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Echelon Forms

Definition

A matrix is in row-echelon form if

1 Any row consisting of all zeros is at the bottom of the matrix.

2 For all non-zero rows the leading entry must be a one. This is calledthe pivot.

3 In consecutive rows the pivot in the lower row appears to the right ofthe pivot in the higher row.

Definition

A matrix is in reduced row-echelon form if it is in row-echelon form andevery pivot is the only non-zero entry in its column.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear SystemsTuesday January 18, 2011 12 / 13

Page 24: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Row Operations

We will be applying row operations to augmented matrices to find solutionsto linear equations. This is called Gaussian or Gauss-Jordan elimination.

Here are the row operations:

1 Multiply a row by a number.

2 Switch rows.

3 Add a multiple of one row to another.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear SystemsTuesday January 18, 2011 13 / 13

Page 25: Tuesday January 18, 2011 - Penn Mathryblair/Math240/papers/Lec1_18.pdf · 2011-01-17 · Tuesday January 18, 2011 Ryan Blair (U Penn) Math 240: Matrix Operations and Linear Systems

Systems of Linear Equations

Row Operations

We will be applying row operations to augmented matrices to find solutionsto linear equations. This is called Gaussian or Gauss-Jordan elimination.

Here are the row operations:

1 Multiply a row by a number.

2 Switch rows.

3 Add a multiple of one row to another.

Key Fact: If you alter an augmented matrix by row operations youpreserve the set of solutions to the linear system.

Ryan Blair (U Penn) Math 240: Matrix Operations and Linear SystemsTuesday January 18, 2011 13 / 13