45
TEST FOR DEFINITENESS OF MATRIX Sylvester’s criterion and schur’s complement

test for definiteness of matrix

  • Upload
    nitza

  • View
    50

  • Download
    0

Embed Size (px)

DESCRIPTION

test for definiteness of matrix. Sylvester’s criterion and schur’s complement. outline. Why we test for definiteness of matrix? detiniteness . Sylvester’s criterion Schur’s complement conclusion. Why we test for definiteness of matrix?. Many application Correlation matrix - PowerPoint PPT Presentation

Citation preview

Page 1: test for definiteness of matrix

TEST FOR DEFINITENESS OF MA-TRIX

Sylvester’s criterion and schur’s complement

Page 2: test for definiteness of matrix

outline Why we test for definiteness of matrix? detiniteness. Sylvester’s criterion Schur’s complement conclusion

Page 3: test for definiteness of matrix

Why we test for definiteness of matrix?

Many application Correlation matrix

Factorization Cholesky decomposition.

classification

Page 4: test for definiteness of matrix

submatrix k x k submatrix of an n x n matrix A

deleting n − k rows and n − k columns of A Principal submatrix of A

deleted row indices and the deleted column indices are the same

leading Principal submatrix of Aprincipal submatrix which is a north-west corner of the ma-

trix A Principal minor : determinant of principal submatrix Leading principal minor : determinant of leading prin-

cipal submatrix

Page 5: test for definiteness of matrix

definiteness

Page 6: test for definiteness of matrix

Positive definite matrix Definition

A nxn real matrix M is positive definite if Equivalence at real symmetric martix M

All eigenvalues of M > 0 All leading principal minor > 0 All diagonal entries of LDU decomposition >

0 There exist nonsingular matrix R s.t

Page 7: test for definiteness of matrix

Negative definite matrix Definition

A nxn real matrix M is negative definite if Equivalence at real symmetric martix M

All eigenvalues of M < 0 All leading principal minor of even size > 0

and all leading principal minor of odd size < 0 All diagonal entries of LDU decomposition <

0

Page 8: test for definiteness of matrix

Positive semi-definite matrix

Definition A nxn real matrix M is positive semi-defi-

nite if Equivalence at real symmetric martix M

All eigenvalues of M ≥ 0 All principal minor ≥ 0 All diagonal entries of LDU decomposition ≥

0 There exist possibly singular matrix R s.t

Page 9: test for definiteness of matrix

Negative semi-definite matrix

Definition A nxn real matrix M is negative semi-defi-

nite if Equivalence at real symmetric martix M

All eigenvalues of M ≤ 0 All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 All diagonal entries of LDU decomposition ≤

0

Page 10: test for definiteness of matrix

Indefinite matrix Definition

A nxn real matrix M indetinite if and

Page 11: test for definiteness of matrix

Sylvester’s criterion

Page 12: test for definiteness of matrix

Positive definite matrix Definition

A nxn real matrix M is positive definite if Equivalence at real symmetric martix M

All eigenvalues of M > 0 All leading principal minor > 0 All diagonal entries of LDU decomposition >

0 There exist nonsingular matrix R s.t

Page 13: test for definiteness of matrix

Negative definite matrix Definition

A nxn real matrix M is negative definite if Equivalence at real symmetric martix M

All eigenvalues of M < 0 All leading principal minor of even size > 0

and all leading principal minor of odd size < 0 All diagonal entries of LDU decomposition <

0

Page 14: test for definiteness of matrix

Positive semi-definite matrix

Definition A nxn real matrix M is positive semi-defi-

nite if Equivalence at real symmetric martix M

All eigenvalues of M ≥ 0 All principal minor ≥ 0 All diagonal entries of LDU decomposition ≥

0 There exist possibly singular matrix R s.t

Page 15: test for definiteness of matrix

Negative semi-definite matrix

Definition A nxn real matrix M is negative semi-defi-

nite if Equivalence at real symmetric martix M

All eigenvalues of M ≤ 0 All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0 All diagonal entries of LDU decomposition ≤

0

Page 16: test for definiteness of matrix

Sylvester’s criterion A nxn real symmetric matrix M is positive definite

iff All leading principal minor > 0 A nxn real symmetric matrix M is negative definite

iff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0

A nxn real symmetric matrix M is positive semi- definite iff All principal minor ≥ 0

A nxn real symmetric matrix M is positive definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0

Page 17: test for definiteness of matrix

Sylvester’s criterion A nxn real symmetric matrix M is positive

semi- definite iff all leading principal mi-nor ≥ 0 : False!

/ex/

all leading princi-pal minor ≥ 0

Exist 1 negative eigenvalue.It is not positive definite

Page 18: test for definiteness of matrix

positive definite A nxn real symmetric matrix M is positive

definite iff All leading principal minor > 0

sufficient conditionreal symmetric matrix M is positive definite⇒ let ⇒

⇒ kxk size leading principal minor

Page 19: test for definiteness of matrix

positive definite A nxn real symmetric matrix M is positive

definite iff All leading principal minor > 0

necessary condition kxk size leading principal minor⇒ kth diagonal entry of LDU decomposition⇒

⇒ real symmetric matrix M is positive definite

Page 20: test for definiteness of matrix

negative definite A nxn real symmetric matrix M is negative

definite iff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0

sufficient conditionreal symmetric matrix M is negative definite⇒ let ⇒

⇒ kxk size leading principal minor if k is even if k is odd

Page 21: test for definiteness of matrix

negative definite A nxn real symmetric matrix M is negative defi-

nite iff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0

necessary condition ⇒ i-th diagonal entry of LDU decomposition⇒

⇒ real symmetric matrix M is negative definite

Page 22: test for definiteness of matrix

positive semi-definite A nxn real symmetric matrix M is positive

semi-definite iff All principal minor ≥ 0

sufficient conditionreal symmetric matrix M is positive semi-definite⇒ le

is posi-tive semi-definite

⇒ principal minor

Page 23: test for definiteness of matrix

positive semi-definite A nxn real symmetric matrix M is positive

semi-definite iff All principal minor ≥ 0

necessary conditionprincipal minor

⇒ let

Page 24: test for definiteness of matrix

positive semi-definite A nxn real symmetric matrix M is positive

semi-definite iff All principal minor ≥ 0

necessary condition

Page 25: test for definiteness of matrix

positive semi-definite A nxn real symmetric matrix M is positive

semi-definite iff All principal minor ≥ 0

necessary condition

⇒ real symmetric matrix M is positive semi-definite

Page 26: test for definiteness of matrix

negative semi-definite A nxn real symmetric matrix M is negative

semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0

sufficient conditionreal symmetric matrix M is negative semi-definite⇒ let⇒

is nega-tive semi-definite

⇒ principal minor

Page 27: test for definiteness of matrix

negative semi-definite A nxn real symmetric matrix M is negative

semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0

necessary conditionprincipal minor

⇒ let⇒

Page 28: test for definiteness of matrix

negative semi-definite A nxn real symmetric matrix M is negative

semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0

necessary condition

Page 29: test for definiteness of matrix

negative semi-definite A nxn real symmetric matrix M is negative

semi-definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0

necessary condition

⇒⇒

⇒ real symmetric matrix M is negative semi-definite

Page 30: test for definiteness of matrix

Schur’s complement

Page 31: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

is positive definite iff and are both positive definite.

If is positive definite, is positive semi-defi-nite iff is positive semi-definite

If is positive definite, is positive semi-defi-nite iff is positive semi-definite

Page 32: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

sufficient condition is positive definite Let

⇒ and are both positive definite.

Page 33: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

necessary condition and are both positive definite.

Page 34: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

necessary condition ⇒

is positive definite

⇒ is positive definite

Page 35: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

sufficient condition is positive definite Let

⇒ and are both positive definite.

Page 36: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

necessary condition and are both positive definite.

Page 37: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

necessary condition ⇒

is positive definite

⇒ is positive definite

Page 38: test for definiteness of matrix

Schur’s complement

If is positive definite, is positive semi-definite iff is positive semi-definite

sufficient condition is positive semi-definite Let

⇒ is positive semi-definite.

Page 39: test for definiteness of matrix

Schur’s complement

If is positive definite, is positive semi-definite iff is positive semi-definite

necessary condition is positive definite. Is positive semi-definite

Page 40: test for definiteness of matrix

Schur’s complement

If is positive definite, is positive semi-definite iff is positive semi-definite

necessary condition ⇒

is pos-

itive definite

⇒ is positive semi-definite

Page 41: test for definiteness of matrix

Schur’s complement

If is positive definite, is positive semi-definite iff is positive semi-definite

sufficient condition is positive semi-definite Let

⇒ is positive semi-definite.

Page 42: test for definiteness of matrix

Schur’s complement

If is positive definite, is positive semi-definite iff is positive semi-definite

necessary condition is positive definite. Is positive semi-definite

Page 43: test for definiteness of matrix

Schur’s complement

If is positive definite, is positive semi-definite iff is positive semi-definite

necessary condition ⇒

is pos-

itive definite

⇒ is positive semi-definite

Page 44: test for definiteness of matrix

Sylvester’s criterion A nxn real symmetric matrix M is positive definite

iff All leading principal minor > 0 A nxn real symmetric matrix M is negative definite

iff All leading principal minor of even size > 0 and all leading principal minor of odd size < 0

A nxn real symmetric matrix M is positive semi- definite iff All principal minor ≥ 0

A nxn real symmetric matrix M is positive definite iff All principal minor of even size ≥ 0 and all principal minor of odd size ≤ 0

Page 45: test for definiteness of matrix

Schur’s complement

is positive definite iff and are both positive definite.

is positive definite iff and are both positive definite.

If is positive definite, is positive semi-defi-nite iff is positive semi-definite

If is positive definite, is positive semi-defi-nite iff is positive semi-definite