Acoustic ManipulationAcoustic Manipulation

Tamer Elnadytamer@svlab-asu.com

Task Definition

Input: the recorded sounds.Output: a set of manipulated sounds were produced at different levels of change.

Objective:– Calibrate the sounds used by the software– Ensure conformity with the standards of the game– Provide the right algorithm to mix different

sounds

Easy to Hard

Task Definition

1. Normalization of Sounds2. Computer Calibration3. Selective Attention4. Temporal Processing – Phoneme

Identification5. Temporal Processing – Phonic Match

Task 1: Normalization

Sounds were recorded:– At low voices– Using different levels (RMS, Gain)

They were all normalized to the same level, same gain, in both speakers (stereo sounds)5600 sound file (Automated Method)

RMS Level Variation

Gain (Background Noise) Variation

Task 2: Computer Calibration

Programmer sets voice volume in software by a number– -10000 (mute) to 0 (louder sound possible)

Computer sends volts to loudspeakerLoudspeaker converts electric current to sound that we can hear in decibels

How to relate all this?

Task 2: Computer Calibration

Absolute Calibration– Impossible– Depends on different uncontrollable factors (LS,

sound card, amplifier, headphones)

Relative Calibration– Rate of change– Accurate difference between two sounds when

played together, or in different ears

Calibration Curve– Send a certain number and measure sound

pressure level

Task 2: Computer Calibration

Variation of the computer scale with the generated sound pressure level

50

55

60

65

70

75

80

85

90

95

100

-2000 -1800 -1600 -1400 -1200 -1000 -800 -600 -400 -200 0

Computer Scale

So

un

d P

ress

ure

Le

vel (

dB

)

Acer Noah + LS

Newest + LS

Newest + HS

Acer Noah + LS 1 m

Task 3: Selective Attention

Phase I:– Signal + Noise at the same time

Phase II:– Signal in one ear and noise in the other ear

Demonstration

Task 4: Temporal Processing – Phoneme Identification

Test Material 1

Modifications for distracter only:– Stop Consonants: Voice Onset will be increased.– Non-Stop Consonants: Fricative Vowel Gap will

be increased

modified Target

جى كى

ستى سى

دو تو

ذو سو

Test Material 2:

Modifications in target and distracter:– Expanding the formant transition– Increasing the amplitude at particular points in

the transition

Task 4: Temporal Processing – Phoneme Identification

Target Distracter

sa za

Aba ada

ba da

be de

Levels of Modifications:– Prolongation: 1 – 1.2 – 1.3 – 1.5– Amplitude increase: 0 – 10 – 20 dB

12 alternatives * 16 files = 192 files

Task 4: Temporal Processing – Phoneme Identification

Test Material:– CV

Task 5: Temporal Processing – Phonic Match

Sa za

Aba ada

ba da

Be de

Task 5: Temporal Processing – Phonic Match

Test Material:– CVC

1 شيل فيل

2 فار طار

3 ليل ديل

4 غيط خيط

5 دار طار

6 ناس ماس

7 برج درج

8 ماء واء

9 بق دق

10 الم نام

11 بيض بيت

12 ديك ديب

13 وز وش

14 ناس نام

15 شمس شمع

16 عين عيش

17 طور توم

18 موز موج

19 دش دق

20 ناس ماء

Task 5: Temporal Processing – Phonic Match

Modifications– Prolongation of the whole word– Amplification of rapidly changing elements– Test material should be played in pairs

Levels of Modifications:– Prolongation: 1 – 1.2 – 1.3 – 1.5– Amplitude increase: 0 – 10 – 20 dB

12 alternatives * 42 files = 504 files

Acknowledgement

Eng. Hossam OmarEng. Mohamed ElsayedEng. Majed Elkirdawy