65
Probability distributions: Who cares & why? Arnab Chakraborty Indian Statistical Institute Nov 12, 2017

Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability distributions: Who cares & why?

Arnab Chakraborty

Indian Statistical Institute

Nov 12, 2017

Page 2: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

“Snakes and Ladders” ludo

Page 3: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

“Snakes and Ladders” ludo

Page 4: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

“Snakes and Ladders” ludo

Page 5: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange ludo

1.Xnew = 0.8Xold + 0.1Ynew = 0.8Yold + 0.04

2.Xnew = 0.5Xold + 0.25Ynew = 0.5Yold + 0.4

3.Xnew = 0.355Xold − 0.355Yold +0.266Ynew = 0.355Xold +0.355Yold +0.078

4.Xnew = 0.355Xold + 0.355Yold + 0.378Ynew = −0.355Xold + 0.355Yold + 0.434

Page 6: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange ludo

1.Xnew = 0.8Xold + 0.1Ynew = 0.8Yold + 0.04

2.Xnew = 0.5Xold + 0.25Ynew = 0.5Yold + 0.4

3.Xnew = 0.355Xold − 0.355Yold +0.266Ynew = 0.355Xold +0.355Yold +0.078

4.Xnew = 0.355Xold + 0.355Yold + 0.378Ynew = −0.355Xold + 0.355Yold + 0.434

Page 7: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange ludo

1.Xnew = 0.8Xold + 0.1Ynew = 0.8Yold + 0.04

2.Xnew = 0.5Xold + 0.25Ynew = 0.5Yold + 0.4

3.Xnew = 0.355Xold − 0.355Yold +0.266Ynew = 0.355Xold +0.355Yold +0.078

4.Xnew = 0.355Xold + 0.355Yold + 0.378Ynew = −0.355Xold + 0.355Yold + 0.434

Page 8: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange ludo

1.Xnew = 0.8Xold + 0.1Ynew = 0.8Yold + 0.04

2.Xnew = 0.5Xold + 0.25Ynew = 0.5Yold + 0.4

3.Xnew = 0.355Xold − 0.355Yold +0.266Ynew = 0.355Xold +0.355Yold +0.078

4.Xnew = 0.355Xold + 0.355Yold + 0.378Ynew = −0.355Xold + 0.355Yold + 0.434

Page 9: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange thing!

●●

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.2

0.4

0.6

0.8

1.0

100

Page 10: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange thing!

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.2

0.4

0.6

0.8

1.0

500

Page 11: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange thing!

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.2

0.4

0.6

0.8

1.0

1000

Page 12: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange thing!

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.2

0.4

0.6

0.8

1.0

10000

Page 13: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A strange thing!

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.2

0.4

0.6

0.8

1.0

100000

Page 14: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Try it out yourself!

https://arnab-chakraborty.shinyapps.io/shny/

Page 15: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Another strange thing!

−2 0 2

02

46

810

100000

Page 16: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Statistical regularity

Regularity in randomness!

I Not always

I Only when we have “lots of randomness”

Natural phenomena:

I Leaves: very similar but not same

I Finger prints

Page 17: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Statistical regularity

Regularity in randomness!

I Not always

I Only when we have “lots of randomness”

Natural phenomena:

I Leaves: very similar but not same

I Finger prints

Page 18: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Why care?

1. Understanding: Probability

2. Using: Statistics

Page 19: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Why care?

1. Understanding: Probability

2. Using: Statistics

Page 20: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Why care?

1. Understanding: Probability

2. Using: Statistics

Page 21: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Histogram

Page 22: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Histogram

Page 23: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Histogram

Page 24: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Histogram

Page 25: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

0.0 0.2 0.4 0.6 0.8 1.0

01

23

Page 26: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.5

1.0

1.5

2.0

2.5

Page 27: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.5

1.0

1.5

2.0

2.5

Page 28: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.5

1.0

1.5

2.0

Page 29: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Probabilitydensity function

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.5

1.0

1.5

2.0

Page 30: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Probabilitydensity function

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.5

1.0

1.5

2.0

Page 31: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Probabilitydensity function

0.0 0.2 0.4 0.6 0.8 1.0

0.0

0.5

1.0

1.5

2.0

All continuous randomvariables have PDFs.

Page 32: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Page 33: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Page 34: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Page 35: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Page 36: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Page 37: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

Page 38: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Probability density function

All continuous randomvariable pairs have jointPDFs.

Page 39: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Molecules

Page 40: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Molecules

Page 41: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A single molecule

Page 42: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A single molecule

Page 43: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A single molecule

Page 44: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A single molecule

Page 45: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A single molecule

Page 46: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

A single molecule

Page 47: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

x , y , z are continuous random variables and so havePDFs.

In case of ”no flow”

I They have the same density (call it f (·))I They are independent.

I So joint density of x , y , z is f (x)f (y)f (z).

I f (x)f (y)f (z) does not depends only on the length of(x , y , z) and not on the direction.

Page 48: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

x , y , z are continuous random variables and so havePDFs.

In case of ”no flow”

I They have the same density (call it f (·))

I They are independent.

I So joint density of x , y , z is f (x)f (y)f (z).

I f (x)f (y)f (z) does not depends only on the length of(x , y , z) and not on the direction.

Page 49: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

x , y , z are continuous random variables and so havePDFs.

In case of ”no flow”

I They have the same density (call it f (·))I They are independent.

I So joint density of x , y , z is f (x)f (y)f (z).

I f (x)f (y)f (z) does not depends only on the length of(x , y , z) and not on the direction.

Page 50: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

x , y , z are continuous random variables and so havePDFs.

In case of ”no flow”

I They have the same density (call it f (·))I They are independent.

I So joint density of x , y , z is f (x)f (y)f (z).

I f (x)f (y)f (z) does not depends only on the length of(x , y , z) and not on the direction.

Page 51: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

x , y , z are continuous random variables and so havePDFs.

In case of ”no flow”

I They have the same density (call it f (·))I They are independent.

I So joint density of x , y , z is f (x)f (y)f (z).

I f (x)f (y)f (z) does not depends only on the length of(x , y , z) and not on the direction.

Page 52: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

Page 53: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

Page 54: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Isotropy

Page 55: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Mathematically...

f (x)f (y)f (z) = g(x2 + y 2 + z2)

f ′(x)f (y)f (z) = 2xg ′(x2 + y 2 + z2)

f (x)f ′(y)f (z) = 2yg ′(x2 + y 2 + z2)

f (x)f (y)f ′(z) = 2zg ′(x2 + y 2 + z2)

g ′(x2+y 2+z2) =f ′(x)f (y)f (z)

2x=

f (x)f ′(y)f (z)

2y=

f (x)f (y)f ′(z)

2z.

f ′(x)

xf (x)=

f ′(y)

yf (y)=

f ′(z)

zf (z)

= k , say

.

Page 56: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Mathematically...

f (x)f (y)f (z) = g(x2 + y 2 + z2)

f ′(x)f (y)f (z) = 2xg ′(x2 + y 2 + z2)

f (x)f ′(y)f (z) = 2yg ′(x2 + y 2 + z2)

f (x)f (y)f ′(z) = 2zg ′(x2 + y 2 + z2)

g ′(x2+y 2+z2) =f ′(x)f (y)f (z)

2x=

f (x)f ′(y)f (z)

2y=

f (x)f (y)f ′(z)

2z.

f ′(x)

xf (x)=

f ′(y)

yf (y)=

f ′(z)

zf (z)

= k , say

.

Page 57: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Mathematically...

f (x)f (y)f (z) = g(x2 + y 2 + z2)

f ′(x)f (y)f (z) = 2xg ′(x2 + y 2 + z2)

f (x)f ′(y)f (z) = 2yg ′(x2 + y 2 + z2)

f (x)f (y)f ′(z) = 2zg ′(x2 + y 2 + z2)

g ′(x2+y 2+z2) =f ′(x)f (y)f (z)

2x=

f (x)f ′(y)f (z)

2y=

f (x)f (y)f ′(z)

2z.

f ′(x)

xf (x)=

f ′(y)

yf (y)=

f ′(z)

zf (z)

= k , say

.

Page 58: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Mathematically...

f (x)f (y)f (z) = g(x2 + y 2 + z2)

f ′(x)f (y)f (z) = 2xg ′(x2 + y 2 + z2)

f (x)f ′(y)f (z) = 2yg ′(x2 + y 2 + z2)

f (x)f (y)f ′(z) = 2zg ′(x2 + y 2 + z2)

g ′(x2+y 2+z2) =f ′(x)f (y)f (z)

2x=

f (x)f ′(y)f (z)

2y=

f (x)f (y)f ′(z)

2z.

f ′(x)

xf (x)=

f ′(y)

yf (y)=

f ′(z)

zf (z)

= k , say

.

Page 59: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Mathematically...

f (x)f (y)f (z) = g(x2 + y 2 + z2)

f ′(x)f (y)f (z) = 2xg ′(x2 + y 2 + z2)

f (x)f ′(y)f (z) = 2yg ′(x2 + y 2 + z2)

f (x)f (y)f ′(z) = 2zg ′(x2 + y 2 + z2)

g ′(x2+y 2+z2) =f ′(x)f (y)f (z)

2x=

f (x)f ′(y)f (z)

2y=

f (x)f (y)f ′(z)

2z.

f ′(x)

xf (x)=

f ′(y)

yf (y)=

f ′(z)

zf (z)= k , say.

Page 60: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Solving

df

dx= kxf .

df

f= kxdx .∫

df

f= k

∫xdx .

log f =kx2

2+ const.

f = const × ekx2

2 .

Maxwell / Gaussian distribution.

Page 61: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Solving

df

dx= kxf .

df

f= kxdx .

∫df

f= k

∫xdx .

log f =kx2

2+ const.

f = const × ekx2

2 .

Maxwell / Gaussian distribution.

Page 62: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Solving

df

dx= kxf .

df

f= kxdx .∫

df

f= k

∫xdx .

log f =kx2

2+ const.

f = const × ekx2

2 .

Maxwell / Gaussian distribution.

Page 63: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Solving

df

dx= kxf .

df

f= kxdx .∫

df

f= k

∫xdx .

log f =kx2

2+ const.

f = const × ekx2

2 .

Maxwell / Gaussian distribution.

Page 64: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Solving

df

dx= kxf .

df

f= kxdx .∫

df

f= k

∫xdx .

log f =kx2

2+ const.

f = const × ekx2

2 .

Maxwell / Gaussian distribution.

Page 65: Probability distributions: Who cares & why? · Another strange thing!-2 0 2 0 2 4 6 8 10 100000. Statistical regularity Regularity in randomness! I Not always I Only when we have

Solving

df

dx= kxf .

df

f= kxdx .∫

df

f= k

∫xdx .

log f =kx2

2+ const.

f = const × ekx2

2 .

Maxwell / Gaussian distribution.