4
IEEE SIGNAL PROCESSING LETTERS, VOL. 13, NO. 7, JULY 2006 425 New Multimodulus Blind Equalization Algorithm With Relaxation Shafayat Abrar, Student Member, IEEE, and Syed Ismail Shah, Member, IEEE Abstract—A new multimodulus algorithm is presented for blind equalization of complex-valued communication channels. The proposed algorithm is obtained by solving a novel deterministic optimization criterion that constituted the dispersion minimiza- tion of a priori as well as a posteriori quantities, leading to an update equation having a particular zero-memory continuous nonlinearity. Analyses of automatic phase-recovery and inter- ference cancellation capabilities of the proposed algorithm are provided. Index Terms—Adaptive equalizers, blind equalization algorithms. I. INTRODUCTION W E address the problem of blind equalization of linear channels in digital communication systems that em- ploy quadrature amplitude modulation (QAM). Assuming a time-invariant channel, the channel and equalizer outputs at the Baud rate are given by and , respectively, where is the ( -tap FIR) channel impulse response, is the ( -tap FIR) equalizer vector at time instant , and are the channel input and additive noise sample, respectively, at time instant , , superscripts and denote transpose and Hermitian transpose, respectively, and subscripts and denote the real and the imaginary parts of the complex entity, respectively. We are interested in deriving a stochastic gradient blind equalization algorithm based on multimodulus criterion. Consider first the multimodulus criterion [1]–[3] (1) The above cost function yields the following stochastic gradient algorithm: (2) where and . This criterion minimizes the dispersion of the real Manuscript received October 18, 2005; revised January 9, 2006. Part of this work was presented at the IEEE International Conference on Microelec- tronics (ICM’2005) and International Workshop on Frontiers of Information Technology (FIT’2005). The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Philip Schniter. S. Abrar is with the Department of Electrical Engineering, COMSATS Institute of Information Technology, Islamabad 44000, Pakistan (e-mail: [email protected]). S. I. Shah is with the Department of Computing and Technology, Iqra Uni- versity, Islamabad 44000, Pakistan (e-mail: [email protected]). Digital Object Identifier 10.1109/LSP.2006.871860 and imaginary parts of the a priori output away from statis- tical constants and , respectively. The stochastic gradient algorithm (2) drops the expectation operator and minimizes the resulting cost function by performing one iteration per sample period. However, after having the filter estimate , we want to adapt it by considering the following instantaneous optimization problem: (3) where we denote as the a posteriori output of the equalizer. It is obvious that we can minimize this cost function perfectly, leading to and , , while leaving largely undetermined. To fix the degree of freedom in , we impose that remains as close as possible to its prior estimate , while satisfying the constraints imposed by the new data, leading to subject to , . Using Lagrange multi- pliers, we may formulate our optimization problem as follows: (4) Notice that, for , the above cost function becomes an equivalent form of the cost function used in [4] and [5] to obtain two different (normalized) multimodulus algorithms (MMA), where the constraints in (4) were satisfied hardly and softly, re- spectively. Consider a normalized adaptive algorithm , where is an appropriate blind estimate of the desired signal based on . We obtain . This shows that the a posteriori output is a convex combination of the a priori output and the blind estimate . Hence, will be closer to the than (where the step-size controls the extent to which approaches ). It provides us a heuristic idea that better blind equalization algorithms may be obtained if both a posteriori and a priori outputs are forced to come closer to the blind estimate. From a multimodulus perspective, we can develop a cost function to minimize (some) joint dispersion of and away from statistical constants, leading to a modified form of (4) as follows: (5) 1070-9908/$20.00 © 2006 IEEE

New multimodulus blind equalization algorithm with relaxation

  • Upload
    si

  • View
    212

  • Download
    0

Embed Size (px)

Citation preview

Page 1: New multimodulus blind equalization algorithm with relaxation

IEEE SIGNAL PROCESSING LETTERS, VOL. 13, NO. 7, JULY 2006 425

New Multimodulus Blind EqualizationAlgorithm With Relaxation

Shafayat Abrar, Student Member, IEEE, and Syed Ismail Shah, Member, IEEE

Abstract—A new multimodulus algorithm is presented for blindequalization of complex-valued communication channels. Theproposed algorithm is obtained by solving a novel deterministicoptimization criterion that constituted the dispersion minimiza-tion of a priori as well as a posteriori quantities, leading to anupdate equation having a particular zero-memory continuousnonlinearity. Analyses of automatic phase-recovery and inter-ference cancellation capabilities of the proposed algorithm areprovided.

Index Terms—Adaptive equalizers, blind equalizationalgorithms.

I. INTRODUCTION

WE address the problem of blind equalization of linearchannels in digital communication systems that em-

ploy quadrature amplitude modulation (QAM). Assuminga time-invariant channel, the channel and equalizer outputsat the Baud rate are given byand , respectively, where

is the ( -tap FIR) channel impulse response,is the ( -tap FIR) equalizer

vector at time instant , and are the channel inputand additive noise sample, respectively, at time instant ,

, superscripts and denotetranspose and Hermitian transpose, respectively, and subscripts

and denote the real and the imaginary parts of the complexentity, respectively. We are interested in deriving a stochasticgradient blind equalization algorithm based on multimoduluscriterion. Consider first the multimodulus criterion [1]–[3]

(1)

The above cost function yields the following stochastic gradientalgorithm:

(2)

where and. This criterion minimizes the dispersion of the real

Manuscript received October 18, 2005; revised January 9, 2006. Part ofthis work was presented at the IEEE International Conference on Microelec-tronics (ICM’2005) and International Workshop on Frontiers of InformationTechnology (FIT’2005). The associate editor coordinating the review of thismanuscript and approving it for publication was Dr. Philip Schniter.

S. Abrar is with the Department of Electrical Engineering, COMSATSInstitute of Information Technology, Islamabad 44000, Pakistan (e-mail:[email protected]).

S. I. Shah is with the Department of Computing and Technology, Iqra Uni-versity, Islamabad 44000, Pakistan (e-mail: [email protected]).

Digital Object Identifier 10.1109/LSP.2006.871860

and imaginary parts of the a priori output away from statis-tical constants and , respectively. The stochastic gradientalgorithm (2) drops the expectation operator and minimizesthe resulting cost function by performing one iteration persample period. However, after having the filter estimate ,we want to adapt it by considering the following instantaneousoptimization problem:

(3)

where we denote as the a posteriori output of theequalizer. It is obvious that we can minimize this cost functionperfectly, leading to and , ,while leaving largely undetermined. To fix the degree offreedom in , we impose that remains as close aspossible to its prior estimate , while satisfying the constraintsimposed by the new data, leading tosubject to , . Using Lagrange multi-pliers, we may formulate our optimization problem as follows:

(4)

Notice that, for , the above cost function becomes anequivalent form of the cost function used in [4] and [5] to obtaintwo different (normalized) multimodulus algorithms (MMA),where the constraints in (4) were satisfied hardly and softly, re-spectively. Consider a normalized adaptive algorithm

, where is an appropriateblind estimate of the desired signal based on . We obtain

. This shows that thea posteriori output is a convex combination of the a priorioutput and the blind estimate . Hence, will be closerto the than (where the step-size controls theextent to which approaches ). It provides us a heuristicidea that better blind equalization algorithms may be obtained ifboth a posteriori and a priori outputs are forced to come closerto the blind estimate. From a multimodulus perspective, we candevelop a cost function to minimize (some) joint dispersion of

and away from statistical constants, leading to a modifiedform of (4) as follows:

(5)

1070-9908/$20.00 © 2006 IEEE

Page 2: New multimodulus blind equalization algorithm with relaxation

426 IEEE SIGNAL PROCESSING LETTERS, VOL. 13, NO. 7, JULY 2006

where , . For tractable derivation, we use and. We differentiate (5) with respect to and set that

to zero:. Defining ,

, , taking transpose (for nota-tional simplicity), and applying the constraints (5), we get thefollowing vector-term expressions:

(6)

(7)

We post-multiply (6) and (7) with and , respectively, andsubtract the resulting expressions to get

. Similarly, we post-multiply (6) and (7)with and , respectively, and add the resulting expressionsto get . At this point, wedeviate a little and modify the minimization procedure of (5) byexploiting the principle of relaxation [6], [7]. This principle in-troduces a step-size so that the constraints are retained as softconstraints unless , leading to

(8)

(9)

Now we post-multiply (8) and (9) with and , re-spectively, and subtract them to get

. Similarly, we post-multiply (8)and (9) with and , respectively, and add them to get

. These results lead tothe following update equation:

(10)

If , then we can assume ,where or , to yield a much simpler expression givenby

. Note that the use of normalizationfactor in the weight adaptation process does not helpmuch in convergence for nonconstant modulus (or multimod-ulus) signals [8]. Based on this result, we suggest to removeit. Second, the four-quadrant symmetry of QAM constellationallows us to write , leading to

(11)

The update (11) represents a new MMA that becomes the sameas (2) for . Next we find the values of and such thatthe mean of the equalizer-deviation is zero. In fact, we requirethat at the equilibrium point of equalizer, whereis the bulk delay. Since , solving for the

Fig. 1. (a) Contour plot of J (12) showing four minima at �R � |R inthe signal-space (p = 2). (b) J (12) minimizes the dispersion of the real andimaginary parts of the equalizer output around two points �R and �R ,respectively.

th tap, we get. Next

, we get

which gives and. Notice that the update rule (11) can

be interpreted as a stochastic approximation of a gradientdescent algorithm for the cost function given by

,leading to

(12)where is constant of integration that ensures , .The stochastic cost function (12) has minimum values at

in the complex plane, as shown in Fig. 1(a). It impliesthat (12) penalizes the dispersion of the real and the imaginarypart of away from and , respectively, as depicted inFig. 1(b).1 Note that many existing algorithms are special casesof the proposed algorithm (11). For example, MMAs reported in[14]–[16] are the same as (11) with . Similarly, MMAs re-ported in [1], [9], and [17] are the same as (11) with . Alsonotice that (11) can be considered as a complex-valued versionof the real-valued algorithm reported in [18, eq. (15)] or a sim-plified version of the block-processing-based MMA reported in[19, eq. (9)-(10)]. In addition, the proposed cost algorithm (11)can be considered as a one-dimensional version of the two-di-mensional algorithm reported in [20] and [21].

II. PHASE RECOVERY CAPABILITY

The inherent phase recovery capability of the MMA (2)has been explored in detail in [22]–[25]. In this section, weinvestigate the phase recovery capability of the proposedMMA (11). Observe that the phase-offset only affects thefirst and the third terms in the cost function (12). Now as-sume QAM alphabet contains four points ,

1There is a misconception about the zero-error contour of MMA. Mistak-enly, MMA was realized of being capable of forcing the equalizer outputs ontostraight-line contours [9, p. 45]]–[11, p. 202]. However, as a matter of fact, theMMA forces the equalizer outputs to lie on four-point contours [12], [13, pp.95-110].

Page 3: New multimodulus blind equalization algorithm with relaxation

ABRAR AND SHAH: NEW MULTIMODULUS BLIND EQUALIZATION ALGORITHM WITH RELAXATION 427

Fig. 2. Defining � and � in first quadrant for an arbitrary value of p.

, , and ,where , . The functionmaps these four points to the same point as . Theexpectation can be written as

toyield Now assume that the equalizeroutput is subjected to a phase-offset, such that, .For the moment, we restrict to be in a range such that both

and lie in the same quadrant. If ,then this restriction corresponds to

. We defineto describe the effect of

phase-offset on the cost function (12), leading to

since

, . For , is expected to be greater than .However, it is observed that may become smaller than

for some values of . This behavior is illustrated in Fig. 2;observe that it is the middle region (specified with angle ,

, in the first quadrant), where the value of is higherthan . We also observe two lines at which .At the line closer to the -axis, we have , and atthe line closer to the -axis, we have .Considering and together and solving for the lowerline with substitution , we get

(13)

Letting , we take the th root on both sides of (15).Under the limit , we obtain for (15), theLHS ,and the RHS

. Due to considering the lower line,the equation has a unique solu-tion , which implies and

. It is an important result that describesan improvement in phase recovery capability with an incrementin (due to the expansion of the middle region).

III. INTER-SYMBOL INTERFERENCE (ISI) OPTIMIZATION

Let be the exact solution of the blind equalizationproblem, such that subject

to , where is the channel impulse response. Letbe a stochastic approximation estimate based on the partic-

ular (finite) realization of data , such that for

which . The equalization quality in termsof residual inter-symbol interference (ISI) can be expressed asISI ,where is the transmitted data sequence, is the re-ceived sequence, and is the estimation error. As-suming is small and using second-order Taylor expan-sion, the linearization of around gives

.Therefore, the error covariance matrix can be approximatedas . Underperfect signal recovery assumption, , we find

for

i.i.d. property for(14)

which gives , where isan -by- identity matrix. Next we find

fori.i.d. property for

(15)

which gives . Finally, ISI, where

and .Due to QAM four-quadrant symmetry, we have

, leading to ISI. The

evaluation of these expectations can be simplified if we considerthe case of a very high-order square-QAM signal. In this way,the uniformly distributed real and imaginary parts of the signalcan be considered continuous. We use generalized Gaussiandistribution (parameterized in )2 to express these expecta-tions, leading to ISI

. Forcontinuous and uniform distribution, we have , for whichwe can substitute , to yield an upper-bound forISI leading to ISI . It is an importantresult that shows that (even for a very large square-QAM signal)an increment in can yield a reduced residual ISI floor for thegiven filter length.

2For a generalized Gaussian variable X , we have p (x) =(�=(2��(1=�))e and IE[jXj ] = (� �((p + 1)=�)=�(1=�)),where �(a)

:= x e dx. For � � p, the Euler’s reflection formula

gives �(p=�) � �[sin(p�=�)] � �=p.

Page 4: New multimodulus blind equalization algorithm with relaxation

428 IEEE SIGNAL PROCESSING LETTERS, VOL. 13, NO. 7, JULY 2006

Fig. 3. Residual ISI traces for the existing algorithm (2).

Fig. 4. Residual ISI traces for the proposed algorithm (11).

IV. SIMULATION RESULTS

In [26], we have discussed that the existing MMA (2) ex-hibits poor convergence behavior as goes beyond 4. It is dueto the fact that, for , the error function of (2) (defined as

)becomes insignificant (that is, approaching to zero) for smallvalues of , making the algorithm fail to converge. It is also re-ported in [26] that the error function of the proposed algorithm(11) [defined as ] issignificant and thus offers a successful convergence.

To corroborate the above discussion, we simulated a Baudspaced seven-tap equalizer in a voice-band telephone channel(taken from [27]) with additive white Gaussian noise SNR

dB . With center-spike equalizer initialization, the residualISI is measured for 16-QAM by averaging 200 independent re-alizations of noise and data source. In Fig. 3, the ISI traces ob-tained from (2) are depicted for , 2, 3, and 4. However,for , the algorithm (11) yielded no stable convergence forany value of step-size. On the other hand, as depicted in Fig. 4,the proposed algorithm (11) is yielding stable convergence for

to 6 with consistent lowering in ISI floor (without af-fecting the convergence speed).

ACKNOWLEDGMENT

The authors would like to thank the anonymous reviewers andthe Associate Editor, Dr. P. Schniter, for their feedback, whichhas improved the quality of this manuscript.

REFERENCES

[1] K. Wesolowski, “Self-recovering adaptive equalization algorithms fordigital radio and voiceband data modems,” in Proc. Eur. Conf. CircuitTheory Design, 1987, pp. 19–24.

[2] K. N. Oh and Y. O. Chin, “Modified constant modulus algorithm: Blindequalization and carrier phase recovery algorithm,” in Proc. IEEE ICC,1995, vol. 1, pp. 498–502.

[3] J. Yang, J.-J. Werner, and G. A. Dumont, “The multimodulus blindequalization algorithm,” in Proc. IEEE Int. Conf. DSP, 1997, vol. 1,pp. 127–130.

[4] J.-C. Lin, “Blind equalization technique based on an improved constantmodulus adaptive algorithm,” Proc. Inst. Elect. Eng., Commun., vol.149, no. 1, pp. 45–50, Feb. 2002.

[5] S. Abrar, A. Zerguine, and M. Deriche, “Soft constraint satisfactionmultimodulus blind equalization algorithms,” IEEE Signal ProcessingLett., vol. 12, no. 9, pp. 637–640, Sep. 2005.

[6] O. Tanrikulu, A. G. Constantinides, and J. A. Chambers, “New nor-malized constant modulus algorithms with relaxation,” IEEE SignalProcess. Lett., vol. 4, no. 9, pp. 256–258, Sep. 1997.

[7] O. Tanrikulu, B. Baykal, A. G. Constantinides, and J. A. Chambers,“Soft constraint satisfaction (SCS) blind channel equalization algo-rithms,” Int. J. Adapt. Control Signal Process., vol. 12, pp. 117–134,1998.

[8] J. Mai and A. H. Sayed, “A feedback approach to the steady-stateperformance of fractionally-spaced blind adaptive equalizers,” IEEETrans. Signal Process., vol. 48, no. 1, pp. 80–91, Jan. 2000.

[9] J. Yang, “Multimodulus algorithms for blind equalization,” Ph.D. dis-sertation, Univ. British Columbia, Vancouver, BC, Canada, Aug. 1997.

[10] J. Yang, J.-J. Werner, D. D. Harman, and G. A. Dumont, “Blind equal-ization for broadband access,” IEEE Commun. Mag., vol. 37, no. 4, pp.87–93, Apr. 1999.

[11] A. H. Sayed, Fundamentals of Adaptive Filtering. Piscataway, NJ:Wiley-Interscience and IEEE Press, 2003.

[12] K. N. Oh, “A single/multilevel modulus algorithm for blind equaliza-tion of QAM signals,” IEICE Trans. Fundam., vol. E80-A, no. 6, pp.1033–1039, Jun. 1997.

[13] T. Thaiupathump, “New algorithms for blind equalization and blindsource separation/phase recovery,” Ph.D. dissertation, , Univ. Pennsyl-vania, Philadelphia, PA, 2002.

[14] H. Besbes and A. Paek, “A low-complexity blind QAM receiver,” inProc. IEEE GLOBECOM, Dec. 2003, pp. 2151–2155.

[15] S. Abrar, A. Zerguine, and M. Deriche, “Soft constraint satisfactionmultimodulus blind equalization algorithms,” in Proc. IEEE ICASSP,May 2004, vol. 2, pp. 853–856.

[16] S. Abrar and A. Zerguine, “A new multimodulus blind equalizationalgorithm,” in Proc. IEEE INCC, Jun. 2004, pp. 165–169.

[17] K. N. Oh and Y. O. Chin, “New blind equalization techniques basedon constant modulus algorithm,” in Proc. IEEE Global Telecommuni-cations, 1995, vol. 2, pp. 865–869.

[18] J. Serra and N. Esteves, “A blind equalization algorithm without deci-sion,” in Proc. IEEE ICASSP, Mar. 1984, vol. 9, no. 1, pp. 475–478.

[19] J. J. Mulligan and E. H. Satorius, Algorithm for equalizing rectangularsignal constellations NASA, JPL, California Inst. Technol., Tech. Rep.NPO-20 324, Mar. 1999, vol. 23, 3.

[20] E. H. Satorius and J. J. Mulligan, “Minimum entropy deconvolutionand blind equalization,” Electron. Lett., vol. 28, no. 16, pp. 1534–1535,Jul. 1992.

[21] H. Matsumoto and T. Furukawa, “A realization on faster convergenceand higher reliability of the new blind deconvolution algorithm usingthe minimum entropy method,” Inst. Elect. Eng. Trans. Jpn., vol.122-C, no. 3, pp. 448–456, Mar. 2002.

[22] K. Wesolowski, “Analysis and properties of the modified constant mod-ulus algorithm for blind equalization,” Eur. Trans. Telecommun., vol.3, no. 3, pp. 225–230, 1992.

[23] L. M. Garth, J. Yang, and J.-J. Werner, “Blind equalization algorithmsfor dual-mode CAP-QAM reception,” IEEE Trans. Commun., vol. 49,no. 3, pp. 455–466, Mar. 2001.

[24] R. Lopez-Valcarce, “Cost minimization interpretation of fourth powerphase estimator and links to multimodulus algorithm,” Electron. Lett.,vol. 40, no. 4, p. 278, Feb. 2004.

[25] J.-T. Yuan and K.-D. Tsai, “Analysis of the multimodulus blind equal-ization algorithm in QAM communication systems,” IEEE Trans.Commun., vol. 53, no. 9, pp. 1427–1431, Sep. 2005.

[26] S. Abrar, “A family of reduced-constellation algorithms for blindequalization of square-QAM signals,” in Proc. IEEE Int. Conf. Micro-electronics (ICM’05), Dec. 2005, pp. 296–300.

[27] G. Picchi and G. Prati, “Blind equalization and carrier recovery usinga ‘stop-and-go’ decision-directed algorithm,” IEEE Trans. Commun.,vol. COM-35, no. 9, pp. 877–887, Sep. 1987.