Blind Single Channel

Deconvolution using Nonstationary

Signal Processing
Reverberation Cancellation in Acoustic
Environments
James R. Hopgood
http://www-sigproc.eng.cam.ac.uk/jrh1008/
jrh1008@eng.cam.ac.uk

Signal Processing Laboratory, Department of Engineering, University of Cambridge

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.1/13

Go to full-screen mode now by

hitting CTRL-L

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.2/13

Introduction to Blind Deconvolution









, modelled as the convolution

, with unknown distortion

Source
Signal



x(t)

, a scaled shifted version of

, given only the observations,









Observed
Signal

Room Transfer
Function

s(t)

Estimate , or
, where



Observation,
of unknown source,
operator, ; i.e.



 









Blind deconvolution fundamental in signal processing

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.3/13

Acoustic Reverberation Cancellation

Normal hearing: can concentrate
on original sound despite:

Walls
and other
obstacles

reverberation

Observer

Direct
paths

Indirect
paths

Sound
Source

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.4/13

Acoustic Reverberation Cancellation

Walls
and other
obstacles

Sound
Source 3

Sound
Source 2

reverberation
environmental noise

Observer

Direct
paths

Normal hearing: can concentrate

on original sound despite:

Indirect
paths

Sound
Source 1

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.4/13

Acoustic Reverberation Cancellation

Walls
and other
obstacles

Sound
Source 3

Sound
Source 2

reverberation
environmental noise

Observer

Direct
paths

Normal hearing: can concentrate

on original sound despite:

Hearing aid users unable to

distinguish one voice from another

Indirect
paths

Sound
Source 1

Sensori-neuro loss cannot be

compensated for by simple
amplifying hearing aids or surgery

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.4/13

Bayesian Blind Deconvolution

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.5/13





Bayess Theorem



















The posterior probability,

, of the system
parameters, , given the state of the system, , and an
underlying model, , is given by Bayes theorem:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.6/13





Bayess Theorem
























The posterior probability,

, of the system
parameters, , given the state of the system, , and an
underlying model, , is given by Bayes theorem:

is the likelihood

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.6/13





Bayess Theorem































The posterior probability,

, of the system
parameters, , given the state of the system, , and an
underlying model, , is given by Bayes theorem:

is the likelihood

represents prior knowledge

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.6/13





Bayess Theorem















is the likelihood

represents prior knowledge


















The posterior probability,

, of the system
parameters, , given the state of the system, , and an
underlying model, , is given by Bayes theorem:

is the evidence and, although usually regarded as a

normalising constant, is of interest for model selection

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.6/13

Likelihood Function for System




 0

/
.


 '
-,

 0

/
.

+


*)



&

&


 













 


given by:



2




Where



 !

%$#


 (%'




"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.7/13

Likelihood Function for System




 0

/
.


 '
-,

 0

/
.

+


*)



&


 (%'

&


 >









<;:
9 8

9
(
=
!

Data vector,

, 7

 !

%$#




"

, 

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.7/13

Likelihood Function for System

.

 0


 '
-,

 0

/
.

+


*)



&


 (%'

&

C
 >


B



 >


B 








,



; 9 8

9
(
=
?@!
A

Data matrix,

 7
/

Data vector,

<;:
9 8

9
(
=
!

, 7

 !

%$#




"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.7/13

Likelihood Function for System

.

 0


 '
-,

 0

/
.

+


*)



&


 (%'

&

C
 >

B

A


B



 >


B 









,

0
 >

Source parameters,



; 9 8

9
(
=
? !
A

Data matrix,

 7
/

Data vector,

<;:
9 8

9
(
=
!

, 7

 !

%$#




"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.7/13

Likelihood Function for System

.

 0


 '
-,

 0

/
.

+


*)



&

&

C
 >

B

A

&

Excitation Variances,

>


B



 >


B 









,

0
 >

Source parameters,



; 9 8

9
(
=
? !
A

Data matrix,

 7
/

Data vector,

<;:
9 8

9
(
=
!

, 7

 !

%$#


 (%'




"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.7/13

Likelihood Function for System

.

 0


 '
-,

 0

/
.

+


*)



&

&

C
 >

B

A

All source and channel parameters,

&

Excitation Variances,

>


B



 >


B 









,

0
 >

Source parameters,



; 9 8

9
(
=
? !
A

Data matrix,

 7
/

Data vector,

<;:
9 8

9
(
=
!

, 7

 !

%$#


 (%'




"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.7/13

Likelihood Function




 0

/
.


 '
-,

 0

/
.

&

#

K

GF

Other parameters:

 !

&

%$#


 (%'

*)






"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.8/13

Likelihood Function




 0

/
.


 '
-,

 0

/
.

&

vector of changepoints:

 >


GF

Other parameters:

 !

&

%$#


 (%'

*)








"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.8/13

Likelihood Function




 0

/
.


 '
-,

 0

/
.

&

vector of changepoints:

 >


GF

Other parameters:

 !

&

%$#


 (%'

*)








L

 >


vector of model orders:

"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.8/13

Likelihood Function




 0

/
.


 '
-,

 0

/
.

&

vector of changepoints:

 >


GF

Other parameters:

 !

&

%$#


 (%'

*)








L

 >


 >


M

vectors of hyperparameters:

vector of model orders:

"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.8/13

Likelihood Function

*)




 0

/
.


 '
-,

 0

/
.

&

vector of changepoints:

 >


GF

Other parameters:

 !

&

%$#


 (%'








 >


N

, and

 >


O

vectors of hyper-hyperparameters:
K

 >


M

vectors of hyperparameters:

 >


L

vector of model orders:

"

-,

The likelihood function for the observed signal, , is:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.8/13

Posterior Distribution for System











P






Apply Bayess rule to obtain the posterior pdf for the

unknown parameters (assuming is known):

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.9/13

Posterior Distribution for System




















Apply Bayess rule to obtain the posterior pdf for the

unknown parameters (assuming is known):

&Q

]
O
Q
1
Q&


and

=

Q

XW

M1
Q&

XW

Q&

Q 0

VUT

N\

Q D
R

Assuming
are independent between blocks, the
assigned priors are:




E


0
















Hence:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.9/13

Posterior Distribution for Channel

f




!
g

%g

Vea

d
`

cba

1
f

f

&
g

g

&

d
i





Only interested in estimating the channel, , so marginalise

the nuisance parameters and by integrating over
:

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.10/13

Posterior Distribution for Channel

/
, '

( W ;
Z

( W
l nl b
m

Y


.
;M

!
=




>

1 (



where

(p'
q=

 !

lml
/
'
 /

.
;M

 /

'

 T
/

 /

'
 ,

, '


.
,

(k











Yields the posterior density for the channel parameters :






*r

t
sr

MMAP estimate used i.e.



Written in terms of
to emphasise that it can be efficiently
calculated by inverse filtering the data,

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.11/13

Principle Revisited
White
noise

Source
Signal

Block Stationary
AR(2) b i

e(t)

Second Order
LTI IIR Filter a

s(t)

Source Signal Model

Observed
Signal
x(t)

Room Acoustic Model

and



>z

"x

w
#



"x

M = 10 Blocks, T i = 1000 samples

Phase and magnitude of

the pole locations for this
BSAR
process change
linearly with block number

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.12/13

Principle Revisited
White
noise

Source
Signal

Block Stationary
AR(2) b i

e(t)

Second Order
LTI IIR Filter a

s(t)

Source Signal Model

Log PDF of Stationary Parameters in block 1

Observed
Signal
x(t)

Room Acoustic Model

0.8
0.6

and

0.4

Imag Part



>z

"x

w
#



"x

M = 10 Blocks, T i = 1000 samples

0.2
0
0.2
0.4
0.6
0.8
1

0.8 0.6 0.4 0.2

0.2

0.4

0.6

0.8



~}

 

Real Part

<|{

Phase and magnitude of

the pole locations for this
BSAR
process change
linearly with block number

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.12/13

Principle Revisited
White
noise

Source
Signal

Block Stationary
AR(2) b i

e(t)

Second Order
LTI IIR Filter a

s(t)

Source Signal Model

Log PDF of Stationary Parameters in block 7

Observed
Signal
x(t)

Room Acoustic Model

0.8
0.6

and

0.4

Imag Part



>z

"x

w
#



"x

M = 10 Blocks, T i = 1000 samples

0.2
0
0.2
0.4
0.6
0.8
1

0.8 0.6 0.4 0.2

0.2

0.4

0.6

0.8




^

~}

 

Real Part

<|{

Phase and magnitude of

the pole locations for this
BSAR
process change
linearly with block number

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.12/13

Principle Revisited
White
noise

Source
Signal

Block Stationary
AR(2) b i

e(t)

Second Order
LTI IIR Filter a

s(t)

Source Signal Model

Complete Log PDF of Stationary Parameters

Observed
Signal
x(t)

Room Acoustic Model

0.8
0.6

and

0.4

Amplitude



>z

"x

w
#



"x

M = 10 Blocks, T i = 1000 samples

0.2
0
0.2
0.4
0.6
0.8
1

0.8 0.6 0.4 0.2

0.2

0.4

0.6

0.8




^

 
~}

Time (sample)

| {

Phase and magnitude of

the pole locations for this
BSAR
process change
linearly with block number

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.12/13

A simple acoustic environment

Actual and Estimated Response

Equalised Response

20

10
Estimated Response
Actual Response

15
5
10

Gain (dB)

10
10
15

20

1000

2000

3000

4000

5000

6000

15

7000

1000

2000

3000

4000

5000

6000

7000

Frequency (Hz)

"x

and

"x

"x


S



"x



O


Frequency (Hz)

Gain (dB)

Blind Deconvolution using Nonstationary Signal Processing. December 6, 2002 p.13/13