47
ESE 531: Digital Signal Processing Lec 3: January 24, 2019 Discrete Time Signals and Systems Penn ESE 531 Spring 2019 - Khanna

ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

  • Upload
    hathuan

  • View
    224

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

ESE 531: Digital Signal Processing

Lec 3: January 24, 2019 Discrete Time Signals and Systems

Penn ESE 531 Spring 2019 - Khanna

Page 2: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Lecture Outline

!  Discrete Time Systems !  LTI Systems !  LTI System Properties !  Difference Equations

3 Penn ESE 531 Spring 2019 - Khanna

Page 3: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Discrete-Time Systems

Page 4: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Discrete Time Systems

5 Penn ESE 531 Spring 2019 - Khanna

!  Systems manipulate the information in signals !  Examples

"  Speech recognition system that converts acoustic waves into text "  Radar system transforms radar pulse into position and velocity "  fMRI system transform frequency into images of brain activity "  Moving average system smooths out the day-to-day variability in a

stock price

Page 5: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

System Properties

!  Causality "  y[n] only depends on x[m] for m<=n

!  Linearity "  Scaled sum of arbitrary inputs results in output that is a scaled sum of

corresponding outputs "  Ax1[n]+Bx2[n] # Ay1[n]+By2[n]

!  Memoryless "  y[n] depends only on x[n]

!  Time Invariance "  Shifted input results in shifted output

"  x[n-q] # y[n-q]

!  BIBO Stability "  A bounded input results in a bounded output (ie. max signal value

exists for output if max ) 6 Penn ESE 531 Spring 2019 - Khanna

Page 6: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Stability

!  BIBO Stability "  Bounded-input bounded-output Stability

7 Penn ESE 531 Spring 2019 - Khanna

Page 7: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Examples

!  Causal? Linear? Time-invariant? Memoryless? BIBO Stable?

!  Time Shift: "  x[n] = x[n-m]

!  Accumulator: "  y[n]

!  Compressor (M>1):

8 Penn ESE 531 Spring 2019 - Khanna

y[n]= x[n−m]

y[n]= x[k]k=−∞

n

y[n]= x[Mn]

Page 8: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Non-Linear System Example

!  Median Filter "  y[n]=MED{x[n-k], …x[n+k]}

"  Let k=1 "  y[n]=MED{x[n-1], x[n], x[n+1]}

9 Penn ESE 531 Spring 2019 - Khanna

Page 9: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Spectrum of Speech

10 Penn ESE 531 Spring 2019 - Khanna

Speech

Page 10: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Spectrum of Speech

11 Penn ESE 531 Spring 2019 - Khanna

Speech

Corrupted Speech

Page 11: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Low Pass Filtering

12 Penn ESE 531 Spring 2019 - Khanna

Page 12: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Low Pass Filtering

13 Penn ESE 531 Spring 2019 - Khanna

Corrupted Speech

LP-Filtered Speech

Page 13: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Median Filtering

14 Penn ESE 531 Spring 2019 - Khanna

Corrupted Speech

Med-Filter Speech

Page 14: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

LTI Systems

Penn ESE 531 Spring 2019 - Khanna 15

Page 15: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

LTI Systems

16 Penn ESE 531 Spring 2019 - Khanna

!  LTI system can be completely characterized by its impulse response

!  Then the output for an arbitrary input is a sum of weighted,

delay impulse responses

y[n]= x[n]∗h[n]

Page 16: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Convolution

Penn ESE 531 Spring 2019 - Khanna

!  Convolution formula:

!  Convolution method: "  1) Time reverse the impulse response and shift it n time steps to the

right "  2) Compute the inner product between the shifted impulse response

and the input vector "  Repeat for evey n

Page 17: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Convolution Example

18 Penn ESE 531 Spring 2019 - Khanna

!  Convolve a unit pulse with itself

Page 18: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Convolution is Commutative

19 Penn ESE 531 Spring 2019 - Khanna

!  Convolution is commutative:

!  These block diagrams are equivalent

!  Implication: pick either h or x to flip and shift when convolving

Page 19: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

LTI Systems in Series

20 Penn ESE 531 Spring 2019 - Khanna

!  Impulse response of the cascade of two LTI systems:

Page 20: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

LTI Systems in Series

21 Penn ESE 531 Spring 2019 - Khanna

!  Impulse response of the cascade of two LTI systems:

!  Proof by picture

Page 21: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

LTI Systems in Parallel

22 Penn ESE 531 Spring 2019 - Khanna

!  Impulse response of the parallel connection of two LTI systems:

Page 22: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Causal System Revisited

23 Penn ESE 531 Spring 2019 - Khanna

!  An LTI system is causal if its impulse response is causal:

Page 23: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Causal System Revisited

24 Penn ESE 531 Spring 2019 - Khanna

!  An LTI system is causal if its impulse response is causal:

!  To prove, note that the convolution does not look into the future if the impulse response is causal

Page 24: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Duration of Impulse

25 Penn ESE 531 Spring 2019 - Khanna

Page 25: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Duration of Impulse

26 Penn ESE 531 Spring 2019 - Khanna

!  Example: Moving average

Page 26: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Duration of Impulse

27 Penn ESE 531 Spring 2019 - Khanna

!  Example: Moving average

Page 27: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Duration of Impulse

28 Penn ESE 531 Spring 2019 - Khanna

Page 28: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Duration of Impulse

29 Penn ESE 531 Spring 2019 - Khanna

!  Example: Recursive average

Page 29: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Duration of Impulse

30 Penn ESE 531 Spring 2019 - Khanna

!  Example: Recursive average

Page 30: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability Revisited

31 Penn ESE 531 Spring 2019 - Khanna

Page 31: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability Revisited

32 Penn ESE 531 Spring 2019 - Khanna

!  Bounded input and output:

!  Where x

∞=max x[n]

x∞<∞ and y

∞<∞

Page 32: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability Revisited

33 Penn ESE 531 Spring 2019 - Khanna

!  Bounded input and output:

!  An LTI system is BIBO stable if and only if

x∞<∞ and y

∞<∞

Page 33: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability – Sufficient Condition

34 Penn ESE 531 Spring 2019 - Khanna

Page 34: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability – Sufficient Condition

35 Penn ESE 531 Spring 2019 - Khanna

Page 35: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability – Necessary Condition

36 Penn ESE 531 Spring 2019 - Khanna

Page 36: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability – Necessary Condition

37 Penn ESE 531 Spring 2019 - Khanna

Page 37: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

BIBO Stability – Necessary Condition

38 Penn ESE 531 Spring 2019 - Khanna

Page 38: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Examples

39 Penn ESE 531 Spring 2019 - Khanna

Page 39: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Examples

40 Penn ESE 531 Spring 2019 - Khanna

Page 40: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Example

41 Penn ESE 531 Spring 2019 - Khanna

Page 41: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Example

42 Penn ESE 531 Spring 2019 - Khanna

Page 42: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

y[n]= x[k]k=−∞

n

y[n]= x[n]+ x[k]k=−∞

n−1

y[n]= x[n]+ y[n−1]y[n]− y[n−1]= x[n]

Difference Equations

!  Accumulator example

43 Penn ESE 531 Spring 2019 - Khanna

Page 43: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Difference Equations

!  Accumulator example

44 Penn ESE 531 Spring 2019 - Khanna

ak y[n− k]k=0

N

∑ = bmx[n−m]m=0

M

y[n]= x[k]k=−∞

n

y[n]= x[n]+ x[k]k=−∞

n−1

y[n]= x[n]+ y[n−1]y[n]− y[n−1]= x[n]

Page 44: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Difference Equations

!  Accumulator example

45 Penn ESE 531 Spring 2019 - Khanna

ak y[n− k]k=0

N

∑ = bmx[n−m]m=0

M

y[n]= x[k]k=−∞

n

y[n]= x[n]+ x[k]k=−∞

n−1

y[n]= x[n]+ y[n−1]y[n]− y[n−1]= x[n]

Page 45: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Example: Difference Equation

46 Penn ESE 531 Spring 2019 - Khanna

!  Moving Average System

!  Let M1=0 (i.e. system is causal)

y[n]= 1M1 +M 2 +1

x[n− k]k=−M1

M2

y[n]= 1M 2 +1

x[n− k]k=0

M2

Page 46: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Big Ideas

!  LTI Systems are a special class of systems with significant signal processing applications "  Can be characterized by the impulse response

!  LTI System Properties "  Causality and stability can be determined from impulse

response

!  Difference equations suggest implementation of systems "  Give insight into complexity of system

47 Penn ESE 531 Spring 2019 - Khanna

Page 47: ESE 531: Digital Signal Processingese531/spring2019/handouts/lec3.pdf · Speech LP-Filtered Speech Median Filtering Penn ESE 531 Spring 2019 - Khanna 14 Corrupted Speech Med-Filter

Admin

!  HW 1 posted tomorrow "  Due 2/3 at midnight "  Submit in Canvas

48 Penn ESE 531 Spring 2019 - Khanna