16
Probability Calculus Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS cont. INDEPENDENCE OF RANDOM VARIABLES

Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Probability Calculus

Anna Janicka

lecture IX, 3.12.2019

RANDOM VECTORS – cont.

INDEPENDENCE OF RANDOM VARIABLES

Page 2: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Plan for Today

1. Marginal distributions – cont.

2. Expected values of functions of random

vectors

3. Covariance, correlation

4. Expected value, variance of random

vectors

5. Independence of random variables

properties and characteristics of

independent RV

Page 3: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Marginal distributions – (cont.)

Marginal distributions of continuous RV:

If marginals are continuous, then the joint

distribution need not be

Page 4: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Characteristics of random vectors

1. Expected values of functions of the

components of a RV:

2. Examples

Page 5: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

The covariance and correlation coefficient

3. Definitions

Page 6: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Covariance and correlation coefficient – cont.

4. Properties:

invariance to shifts

bilinearity of the covariance

variance as a special case

simplifying formula:

capture the linear relationship, in other

cases may be misleading

Page 7: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Correlation coefficient – properties

5. Schwarz inequality

6. Consequences for the correlation coef.

Page 8: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Expected value and covariance matrix

7. Definitions:

Page 9: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Properties of EX and the covariance matrix

8. Linearity

Page 10: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Independent RV

1. Definition of independence

2. Independence of discrete RV

Page 11: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Independent RV – cont.

3. Example

4. Independence of continuous RV

5. Examples

uniform distribution on square

uniform distribution on circle

Page 12: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Independent RV – cont. (2)

6. Transformations of RV

Page 13: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Properties of independent RV

2. Expected value of product

3. Example

4. Covariance of independent RV

5. Non-correlation

Page 14: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Properties of independent RV – cont.

6. One-way implication only!

independence non-correlation but

IS NOT TRUE!

7. Example – uniform distribution on circle

8. Sum of variances

Page 15: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS

Properties of independent RV – cont. (2)

9. Example – sum of points on dice

Page 16: Probability Calculus Anna Janicka - Uniwersytet Warszawskicoin.wne.uw.edu.pl/azylicz/pc/pc09_2019_presentation.pdf · 2019-12-02 · Anna Janicka lecture IX, 3.12.2019 RANDOM VECTORS