Upload
vidyasawant2012
View
230
Download
0
Embed Size (px)
Citation preview
8/13/2019 Probabilty theory
1/54
8/13/2019 Probabilty theory
2/54
Why do we need to study Probabilityand Random Processes
Probability theory provides a power tools to Explain Model Analyze Design
the technologies which are developed.
8/13/2019 Probabilty theory
3/54
PROBABILITY THEORY and PROBABILITYMODELs provide a tool that enables thedesigner to successfully design systems thanmust operate in RANDOM ENVIORNMENT, butnevertheless are efficient, reliable and costeffective.
8/13/2019 Probabilty theory
4/54
Examples
Signal Processing Optical Communication Wireless Communications Variability in electronic circuits. Computer network traffic.
8/13/2019 Probabilty theory
5/54
8/13/2019 Probabilty theory
6/54
Radar Communication
Signal hidden in Noise.Noise is a random signalNoise can be characterized byits probabilitistic nature.
8/13/2019 Probabilty theory
7/54
Optical Communication System Photo detector acts as the interface between optical and electronic subsystem. The number of photoelectrons produced by the photo detector depends on the
intensity of light and is modeled by POISSON RANDON VARIABLE. In deciding whether the transmitted bit is zero or one, the receiver counts the
number of photoelectrons and compares it with threshold. System performance is determined by computing the probability that the
threshold is exceeded.
8/13/2019 Probabilty theory
8/54
Wireless Communication System
In order to increase the weak signals we useAmplifiers.
These amplifiers generate thermal noise,which is added to the desired signal.
Noise has a Guassian distribution (UnderlyingPhysics)
8/13/2019 Probabilty theory
9/54
Variability in electronics circuits
Although circuit manufacturing processattempt to ensure that all items have nominalparameters values, there is always someamount of variations among items.
Using probability theory we can Estimate the average values in a batch of items
without testing all of them. Check how good is our estimate
8/13/2019 Probabilty theory
10/54
Reliability of Systems Two basic Configurationss
Series System If one component fails the entire system fails.
Parallel System
If one component fails still the system functions It is not possible to predict exactly when a component
will fail However probability theory allows us to evaluate the
MEASURES OF RELIABILITY. Average time to failure. Probability that a component is still functioning after
certain time has elapsed.
8/13/2019 Probabilty theory
11/54
Markov Chain / Markov Process
All digital communication sytems are modeledas markov process/ markov chain.
Digital circuits with internal memory such asflipflops, RAM, registers, Finite state machinesare modelled by markov process / markovchain.
8/13/2019 Probabilty theory
12/54
Queing Theory
The question that usually arises in acommunication system is queing problem.
Que : buffer which stores messages. Assume server can process one message at a
time. So if more than one message is being
processes then since the buffer has limitedspace the other messages have to wait forservice.
8/13/2019 Probabilty theory
13/54
Performance measures to be found Average number of customers (messages) in the
system (L) Average number of customers waiting in que. (Lq) Average number of customers in service (Ls) L =Lq+ Ls Average time customer spends in que (Wq)
Average time a customer spends in service (Ws) Average time a customer spends in system (W). W= Wq + Ws
8/13/2019 Probabilty theory
14/54
8/13/2019 Probabilty theory
15/54
Deterministic Experiment
An experiment whose outcome or result canbe predicted with CERTAINITY is calleddeterministic experiment.
For example: If E is the potential differencebetween the two ends of a resistor (R) , thenthe current flowing through the resistor isuniquely determined by Ohms law: I= E/R
This is a Deterministic experiment.
8/13/2019 Probabilty theory
16/54
Random Experiment
Any experiment in which ALL the outcomesare known in ADVANCE but the outcome of aPARTICULAR PERFORMANCE of theexperiment cannot be predicted with certaintyis called as Random experiment.
8/13/2019 Probabilty theory
17/54
Example of Random Experiment
Tossing a coin: Two possible outcomes (Head or Tail) But outcome of a particular toss cannot be
predicted. A fair 6 face cubic dice is rolled.
It is known that the outcome will be any of the 6possible values
But it cannot be predicted what exactly theoutcome will be, when the dice is rolled at a pointof time.
8/13/2019 Probabilty theory
18/54
Example of Random Experiment
Although the number of telephone callsreceived in a board in a 5 min interval is a non negative interger
we cannot predict exactly the number of callsin the next 5 mins.
In such cases we talk of CHANCE or thePROBABILITY (RELATIVE FREQUENCY) ofoccurrence of a particular outcome
8/13/2019 Probabilty theory
19/54
Sample space
We perform an experiment which can have anumber of different outcomes.
The sample space is the set of all possibleoutcomes of the experiment. We usually call itS.
8/13/2019 Probabilty theory
20/54
8/13/2019 Probabilty theory
21/54
Sample Space / SET
Set A contains elements a 1, a 2,an. Element a k which is an element of A can be represented as:
Element a k which is not an element of A can be represented as:
8/13/2019 Probabilty theory
22/54
Example
It is important to be able to list the outcomesclearly.
For example: if I plant ten bean seeds and count the number
that germinate, the sample space is
S = {0,1,2,3,4,5,6,7,8,9,10}.
If I toss a coin three times and record the result,the sample space is
S = {HHH,HHT,HTH,HTT,THH,THT,TTH,TTT},
8/13/2019 Probabilty theory
23/54
Examples of Sample Space
8/13/2019 Probabilty theory
24/54
8/13/2019 Probabilty theory
25/54
Example of Sample Space
8/13/2019 Probabilty theory
26/54
Sample space for variability inelectronic circuits
8/13/2019 Probabilty theory
27/54
Sample space forComputer network traffic
8/13/2019 Probabilty theory
28/54
Noise voltage is modelled by a sample spaceconsisting of all real numbers,
i.e., = (,). Outcomes: the individual numbers such as
1.5, 8, and are outcomes. Events: Subsets such as the interval
[0,5] = {v : 0 v 5} Another event would be {2,4,7.13}
8/13/2019 Probabilty theory
29/54
Event Elements or points in the sample space are called as OUTCOMES. Collection of outcomes is called : Event Event is a subset of sample space S. Event is a collection of certain sample points of S. Example: If I toss a coin three times and record the result, the sample space is
S = {HHH,HHT,HTH,HTT,THH,THT,TTH,TTT}, let A be the event more heads than tails and B the event heads on last throw. Then
A = {HHH,HHT,HTH,THH}, B = {HHH,HTH,THH,TTH}.
8/13/2019 Probabilty theory
30/54
Singleton Set
Singleton sets, that is sets consisting of a single point, are also events; e.g., {1.5}, {8}, {}
Be sure you understand the difference between the outcome 8 and the event {8}, which is the set
consisting of the single outcome 8.
8/13/2019 Probabilty theory
31/54
EVENT SAMPLE SPACE / SET which consists of all possible
outcomes of the experiment. If the sample space is the set of all triples ( b1,b2,b3),
where the bi are 0 or 1, then any particular triplet, say (0,0,0) or (1,0,1) would be
an outcome. An event would be a subset of the sample space
(universal set). such as the set of all triples with exactly one 1; i.e., {(0,0,1), (0,1,0), (1,0,0)}.
An example of a singleton event would be {(1,0,1)}.
EVENT
8/13/2019 Probabilty theory
32/54
EVENT In modeling the resistance and capacitance of the RC filter
above,
we suggested the sample space = {(r,c) : 95 r 105 and 300 c 340}.
OUTCOME: If a particular circuit has R=101 ohms and C =327 F ,
this would correspond to the outcome (101,327), which isindicated by the dot in Figure. EVENT
If we observed a particular circuit with R97 ohms andC
313 F , this would correspond to the event {(r,c) : 95 r 97 and 313 c 340}, which is the shaded region in Figure
The dot is the outcome (101,327). The shaded region is the
event {( r,c ) : 95 r 97 and 313 c 340}.
8/13/2019 Probabilty theory
33/54
EVENTS
Exhaustive events Favorable events Mutually exclusive events Equally likely events Independent events
8/13/2019 Probabilty theory
34/54
Venn Diagram Sets can be represented graphically by means of
Venn diagram. We first define a universal set S is the universal set
S={x: x is all positive integers} A subset (EVENT) A can be represented by means
of venn diagram as shown in fig. A={1,2,3,4,5,6} Then its venn diagram is as follows:
8/13/2019 Probabilty theory
35/54
Venn diagram
S={x: x is all positive integers} A={1,2,3,4,5,6}
8/13/2019 Probabilty theory
36/54
8/13/2019 Probabilty theory
37/54
8/13/2019 Probabilty theory
38/54
Equality of Sets
Two sets A and B. They are said to be equal if That is every element of B is contained in A
and every element of A is contained in B. That is sets A and B contain exactly same
elements.
8/13/2019 Probabilty theory
39/54
Example
S={x: x is all positive integers} Set A={1,2,3,4,5,6} Subset set B = {1,3,5} B is a subset of A. Whereas set C = {x:x is a positive integer 6}
and set D = {2,4,6} C and D are same since both contain the same
elements
8/13/2019 Probabilty theory
40/54
Venn diagram of above example
8/13/2019 Probabilty theory
41/54
Empty Set
A empty set is a set that contains no elements. It is denoted by NOTW: The set A={0} is not an empty set
since it contains the element 0.
8/13/2019 Probabilty theory
42/54
Set Operations / MathematicalOperations
We can build new events from old events byusing set operators.
Union Intersection Complement
8/13/2019 Probabilty theory
43/54
Union
Union of two sets A and B is a third set Cwhich includes all of the elements that are ineither A or B or both.
8/13/2019 Probabilty theory
44/54
Union
8/13/2019 Probabilty theory
45/54
Intersection
The intersection of two sets, A and B, is theset of all elements that are in both A and B."
8/13/2019 Probabilty theory
46/54
Intersection
8/13/2019 Probabilty theory
47/54
Complement of an event
8/13/2019 Probabilty theory
48/54
8/13/2019 Probabilty theory
49/54
Summary
8/13/2019 Probabilty theory
50/54
Disjoint or Mutually Exclusive Events
8/13/2019 Probabilty theory
51/54
Mutually exclusive set / event
In throwing a dice, the outcomes are mutually exclusive as occurrenceof one face excludes the occurrence of remaining 5 faces.
8/13/2019 Probabilty theory
52/54
Exhaustive Event
All possible outcomes of an experiment iscalled exhaustive event.
Example: In tossing a coin either {head} or {tail} turns up. There is no other possibility Therefore these two outcomes are exhaustive
events.
8/13/2019 Probabilty theory
53/54
Favorable Event
The number of outcomes which results to thedesired event are called favorable event.
Example: In throwing of 2 dice , the number of cases
favorable to get a sum of 6 is: (1,5); (2,4); (3,3); (4,2); (5,1) i.e there are 5 favorable cases.
8/13/2019 Probabilty theory
54/54
Equally likely event Two or more events are said to be equally likely if
the chances of their happening is equal. That is there is no preference of occurance of one
event over the other. Example:
In throwing a coin , getting a {head} or a {tail} isequally likely .
In throwing a dice getting events as {1}, {2}, {3}, {4},{5}, {6} are equally likely
Such events are called as equally likely events.