34
Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview 1. Motivation 1. Motivation 2. Unit 6 overview In this unit we discuss a number of topics on random variables: Methods for calculating the distribution of a function of one or more random variables, including the special case of the sum of two independent random variables The concepts of covariance and correlation between two random variables An abstract perspective under which conditional expectations are viewed as random variables Curso Unit 6: Further topics on random variables Lec. 11: Derived distributions 1. Lecture 11 overview and slides 3. Lecture 11 overview and slides This lecture develops a method for finding the distribution (PMF or PDF) of a function of one or more random variables with known distribution. 4. The PMF of a function of a discreter r.v. 5. A linear function of a continuous r.v.

Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

Probability - The Science of Uncertainty and Data Curso  Unit 6: Further topics on random variables  Unit overview  1. Motivation

1. Motivation

2. Unit 6 overview

In this unit we discuss a number of topics on random variables: 

● Methods for calculating the distribution of a function of one or more random variables, including the special case of the sum of two independent random variables 

● The concepts of covariance and correlation between two random variables 

● An abstract perspective under which conditional expectations are viewed as random variables 

Curso  Unit 6: Further topics on random variables  Lec. 11: Derived distributions  1. Lecture 11 overview and slides 

3. Lecture 11 overview and slides

This lecture develops a method for finding the distribution (PMF or PDF) of a function of one or more random variables with known distribution.

4. The PMF of a function of a discreter r.v.

5. A linear function of a continuous r.v.

Page 2: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

6. A linear function of a normal r.v.

7. A PDF of a general function

Page 3: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

8. The monotonic case

Page 4: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

9. The intuition for the monotonic case

10. The nonmonotonic example

Page 5: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

11. A function of multiple r.v.´s

Page 7: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

14. The sum of independent continuous r.v.´s

Page 8: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

15. The sum of independent normal r.v.´s

16. Covariance

Page 9: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

17. Covariance properties

Page 10: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

18. The variance of the sum of the r.v.´s

19. The correlation coefficient

20.Derivation of key properties of the correlation coefficient

21. Interpreting the correlation coefficient

Page 12: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

25. The law of iterated expectations

Page 13: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 14: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

26.Stick-breaking revisited

27. Forecast revisions

28.The conditional variance

Page 15: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 16: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 17: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

29.Derivation of the law of total variance

30.A simple example

31. Section means and variances

Page 19: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

34.The PDF of the absolute value of X

35. Derived distributed example

Page 20: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

36.Ambulance travel time

Page 21: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

37. The difference of two independent exponential r.v.´s

}

38.The sum of discrete and continuous r.v.´s

39.Using conditional expectation and variance

40.The variance in the stick-breaking problem

41. A coin with random bias

42.Widgets and crates

Page 24: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 25: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 26: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 27: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 28: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 29: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 30: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 31: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 32: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview
Page 34: Probability - The Science of Uncertainty and Data · 2019-08-05 · Probability - The Science of Uncertainty and Data Curso Unit 6: Further topics on random variables Unit overview

Curso  Unit 7: Bayesian inference  Unit overview  1. Motivation

48.Motivation

49.Unit 7 overview

In this unit, we focus on Bayesian inference, including both hypothesis testing and estimation problems. 

a) We apply the Bayes rule to find the posterior distribution of an unknown random variable given one or multiple observations of related random variables. 

b) We discuss the most common methods for coming up with a point estimate of the unknown random variable (Maximum a Posteriori probability estimate, Least Mean Squares estimate, and Linear Least Mean Squares estimate). 

c) We consider the question of performance analysis, namely, the calculation of the probability of error in hypothesis testing problems or the calculation of the mean squared error in estimation problems. 

d) To illustrate the methodology, we pay special attention to a few canonical problems such as linear normal models and the problem of estimating the unknown bias of a coin. 

50.Lecture 14 overview and slides

51. sdfs