13
1 Testing Equality of Multiple Power Spectral Density Matrices David Ram´ ırez, Senior Member, IEEE, Daniel Romero, Member, IEEE, Javier V´ ıa, Senior Member, IEEE, Roberto L´ opez-Valcarce, Member, IEEE, and Ignacio Santamar´ ıa, Senior Member, IEEE Abstract— This work studies the existence of optimal invariant detectors for determining whether P multivariate processes have the same power spectral density (PSD). This problem finds application in multiple fields, including physical layer security and cognitive radio. For Gaussian observations, we prove that the optimal invariant detector, i.e., the uniformly most powerful invariant test (UMPIT), does not exist. Additionally, we consider the challenging case of close hypotheses, where we study the existence of the locally most powerful invariant test (LMPIT). The LMPIT is obtained in closed form only for univariate signals. In the multivariate case, it is shown that the LMPIT does not exist. However, the corresponding proof naturally suggests one LMPIT- inspired detector, which outperforms previously proposed detec- tors. Index Terms— Generalized likelihood ratio test (GLRT), locally most powerful invariant test (LMPIT), power spectral density (PSD), Toeplitz matrix, uniformly most powerful invariant test (UMPIT). I. I NTRODUCTION This work studies the problem of determining whether P Gaussian multivariate time series possess the same (pos- sibly matrix-valued) power spectral density (PSD) at every frequency. This interesting problem has many applications, such as comparison of gas pipes [1], analysis of hormonal times series [2], earthquake-explosion discrimination [3], light- intensity emission stability determination [4], physical-layer security [5], and spectrum sensing [6]. D. Ram´ ırez is with the Department of Signal Theory and Commu- nications, University Carlos III of Madrid, Legan´ es, Spain and with the Gregorio Mara˜ on Health Research Institute, Madrid, Spain (e-mail: [email protected]). D. Romero is with the Department of Information and Commu- nication Technology, University of Agder, Grimstad, Norway (e-mail: [email protected]). J. ıa and I. Santamar´ ıa are with the Department of Communi- cations Engineering, University of Cantabria, Santander, Spain (e-mail: {javier.via,i.santamaria}@unican.es). R. L´ opez-Valcarce is with the Department of Signal Theory and Commu- nications, University of Vigo, Vigo, Spain (e-mail: [email protected]). This work was partly supported by the Spanish MINECO grants COMONSENS Network (TEC2015-69648-REDC) and KERMES Network (TEC2016-81900-REDT/AEI); by the Spanish MINECO and the Euro- pean Commission (ERDF) grants ADVENTURE (TEC2015-69868-C2-1- R), WINTER (TEC2016-76409-C2-2-R), CARMEN (TEC2016-75067-C4-4- R) and CAIMAN (TEC2017-86921-C2-1-R and TEC2017-86921-C2-2-R); by the Comunidad de Madrid grant CASI-CAM-CM (S2013/ICE-2845); by the Xunta de Galicia and ERDF grants GRC2013/009, R2014/037 and ED431G/04 (Agrupacion Estrat´ exica Consolidada de Galicia accred- itation 2016-2019); by the SODERCAN and ERDF grant CAIMAN (12.JU01.64661); and by the Research Council of Norway grant FRIPRO TOPPFORSK (250910/F20). This paper was presented in part at the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing. The first work to consider this problem was developed by Coates and Diggle [1]. This work proposed tests, for univariate and real-valued time series, based on the ratio of periodograms. First, they presented non-parametric tests based on the comparison of the maximum and minimum of the log-ratio of periodograms over all frequencies. Moreover, assuming a parametric (quadratic) model for the log-ratio of the PSDs, they developed a generalized likelihood ratio test (GLRT). These detectors are further studied in [7]. Following similar ideas to [1], [7], the work in [2] proposed a graphical procedure, which resulted in another non-parametric test. The authors of [4] also considered detectors based on the ratio of periodograms for a problem with several time series and are based on a semi-parametric log-linear model for the ratio of PSDs. A different kind of detector is presented in [8], where the GLRT was derived without imposing any parametric model. In particular, they computed the GLRT for testing whether the PSD of two real multivariate time series are equal at a given frequency. The extension to complex time series is considered in [9], where the information from all frequencies is fused into a single statistic. An alternative way of fusing the information at all frequencies is derived in [10], but the proposed detector is not a GLRT anymore. All aforementioned detectors were developed in the frequency domain. However, there are also other works that propose time-domain detectors; see, for instance, [11] and references therein. The problem considered in this work is to decide whether at each frequency all P PSD matrices are identical or not. Thus, the tests for equality of several PSDs may be addressed as an extension of the classical problem of testing the homogeneity of covariance matrices [12]. This allows us to use the statistics for homogeneity at each frequency, which need to be fused into one statistic afterwards by combining the different frequencies. Depending on the chosen combination rule, different detectors (with different performance) may be derived. Every proposed test so far is either based on ad-hoc prin- ciples, or on the GLRT, which is optimal in the asymptotic regime [13]. However, their behavior for finite data records is unknown. That is, for finite data records, they may very well be suboptimal. Actually, to the best of the authors’ knowledge, neither the uniformly most powerful invariant test (UMPIT) nor the locally most powerful invariant test (LMPIT) have been studied for the considered problem, with the exception of our previous conference paper [14], which considers the particular case of P =2 processes. The conventional approach to derive these optimal invariant detectors is based on obtaining the

Testing Equality of Multiple Power Spectral Density Matrices

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Testing Equality of Multiple Power Spectral Density Matrices

1

Testing Equality of MultiplePower Spectral Density Matrices

David Ramırez, Senior Member, IEEE, Daniel Romero, Member, IEEE, Javier Vıa, Senior Member, IEEE,Roberto Lopez-Valcarce, Member, IEEE, and Ignacio Santamarıa, Senior Member, IEEE

Abstract— This work studies the existence of optimal invariantdetectors for determining whether P multivariate processes havethe same power spectral density (PSD). This problem findsapplication in multiple fields, including physical layer securityand cognitive radio. For Gaussian observations, we prove thatthe optimal invariant detector, i.e., the uniformly most powerfulinvariant test (UMPIT), does not exist. Additionally, we considerthe challenging case of close hypotheses, where we study theexistence of the locally most powerful invariant test (LMPIT). TheLMPIT is obtained in closed form only for univariate signals. Inthe multivariate case, it is shown that the LMPIT does not exist.However, the corresponding proof naturally suggests one LMPIT-inspired detector, which outperforms previously proposed detec-tors.

Index Terms— Generalized likelihood ratio test (GLRT), locallymost powerful invariant test (LMPIT), power spectral density(PSD), Toeplitz matrix, uniformly most powerful invariant test(UMPIT).

I. INTRODUCTION

This work studies the problem of determining whetherP Gaussian multivariate time series possess the same (pos-sibly matrix-valued) power spectral density (PSD) at everyfrequency. This interesting problem has many applications,such as comparison of gas pipes [1], analysis of hormonaltimes series [2], earthquake-explosion discrimination [3], light-intensity emission stability determination [4], physical-layersecurity [5], and spectrum sensing [6].

D. Ramırez is with the Department of Signal Theory and Commu-nications, University Carlos III of Madrid, Leganes, Spain and withthe Gregorio Maranon Health Research Institute, Madrid, Spain (e-mail:[email protected]).

D. Romero is with the Department of Information and Commu-nication Technology, University of Agder, Grimstad, Norway (e-mail:[email protected]).

J. Vıa and I. Santamarıa are with the Department of Communi-cations Engineering, University of Cantabria, Santander, Spain (e-mail:{javier.via,i.santamaria}@unican.es).

R. Lopez-Valcarce is with the Department of Signal Theory and Commu-nications, University of Vigo, Vigo, Spain (e-mail: [email protected]).

This work was partly supported by the Spanish MINECO grantsCOMONSENS Network (TEC2015-69648-REDC) and KERMES Network(TEC2016-81900-REDT/AEI); by the Spanish MINECO and the Euro-pean Commission (ERDF) grants ADVENTURE (TEC2015-69868-C2-1-R), WINTER (TEC2016-76409-C2-2-R), CARMEN (TEC2016-75067-C4-4-R) and CAIMAN (TEC2017-86921-C2-1-R and TEC2017-86921-C2-2-R);by the Comunidad de Madrid grant CASI-CAM-CM (S2013/ICE-2845);by the Xunta de Galicia and ERDF grants GRC2013/009, R2014/037and ED431G/04 (Agrupacion Estratexica Consolidada de Galicia accred-itation 2016-2019); by the SODERCAN and ERDF grant CAIMAN(12.JU01.64661); and by the Research Council of Norway grant FRIPROTOPPFORSK (250910/F20). This paper was presented in part at the 2018IEEE International Conference on Acoustics, Speech and Signal Processing.

The first work to consider this problem was developedby Coates and Diggle [1]. This work proposed tests, forunivariate and real-valued time series, based on the ratioof periodograms. First, they presented non-parametric testsbased on the comparison of the maximum and minimum ofthe log-ratio of periodograms over all frequencies. Moreover,assuming a parametric (quadratic) model for the log-ratio ofthe PSDs, they developed a generalized likelihood ratio test(GLRT). These detectors are further studied in [7]. Followingsimilar ideas to [1], [7], the work in [2] proposed a graphicalprocedure, which resulted in another non-parametric test. Theauthors of [4] also considered detectors based on the ratio ofperiodograms for a problem with several time series and arebased on a semi-parametric log-linear model for the ratio ofPSDs.

A different kind of detector is presented in [8], where theGLRT was derived without imposing any parametric model.In particular, they computed the GLRT for testing whetherthe PSD of two real multivariate time series are equal ata given frequency. The extension to complex time series isconsidered in [9], where the information from all frequenciesis fused into a single statistic. An alternative way of fusingthe information at all frequencies is derived in [10], but theproposed detector is not a GLRT anymore. All aforementioneddetectors were developed in the frequency domain. However,there are also other works that propose time-domain detectors;see, for instance, [11] and references therein.

The problem considered in this work is to decide whether ateach frequency all P PSD matrices are identical or not. Thus,the tests for equality of several PSDs may be addressed as anextension of the classical problem of testing the homogeneityof covariance matrices [12]. This allows us to use the statisticsfor homogeneity at each frequency, which need to be fused intoone statistic afterwards by combining the different frequencies.Depending on the chosen combination rule, different detectors(with different performance) may be derived.

Every proposed test so far is either based on ad-hoc prin-ciples, or on the GLRT, which is optimal in the asymptoticregime [13]. However, their behavior for finite data records isunknown. That is, for finite data records, they may very well besuboptimal. Actually, to the best of the authors’ knowledge,neither the uniformly most powerful invariant test (UMPIT)nor the locally most powerful invariant test (LMPIT) have beenstudied for the considered problem, with the exception of ourprevious conference paper [14], which considers the particularcase of P = 2 processes. The conventional approach to derivethese optimal invariant detectors is based on obtaining the

Page 2: Testing Equality of Multiple Power Spectral Density Matrices

2

ratio of the densities of the maximal invariant statistic undereach hypothesis [15]. The derivation of these distributions isfor most problems a very complicated task, if possible at all,which in many cases precludes the derivation of optimal invari-ant detectors. Instead of pursuing this conventional approach,we may invoke Wijsman’s theorem [16], [17], as we did in ourprevious works [18], [19]. This theorem allows us to derivethe UMPIT or the LMPIT, if they exist, without identifyingthe maximal invariant statistic and, more importantly, withoutcomputing its distributions. Exploiting Wijsman’s theorem,and assuming Gaussian-distributed data, this work proves thatthe UMPIT does not exist for testing equality of the PSDmatrices of P (≥ 2) processes. Moreover, focusing on the caseof close hypotheses (similar PSDs), we prove that the LMPITonly exists in the case of univariate processes, for which wefind a closed-form expression; whereas it does not exist forthe general case of multivariate time series. However, the non-existence proof of the LMPIT in the multivariate case suggestsone LMPIT-inspired detector, which turns out to outperformpreviously proposed schemes.

The paper is organized as follows. Section II presents themathematical formulation of the problem. The proof of thenon-existence of the UMPIT and the LMPIT for the generalcase is presented in Section III, whereas Section IV derives theLMPIT for univariate processes. Due to the non-existence ofthe LMPIT in the general case, we present a LMPIT-inspireddetector in Section V. The performance of the proposeddetector is illustrated by means of numerical simulations inSection VI, and Section VII summarizes the main conclusionsof this work.

A. Notation

In this paper, matrices are denoted by bold-faced upper caseletters; column vectors are denoted by bold-faced lower caseletters, and light-face lower case letters correspond to scalarquantities. The superscripts (·)T and (·)H denote transpose andHermitian, respectively. A complex (real) matrix of dimensionM × N is denoted by A ∈ CM×N

(A ∈ RM×N

)and x ∈

CM(x ∈ RM

)denotes that x is a complex (real) vector of

dimension M . The absolute value of the complex number x isdenoted as |x|, and the determinant, trace and Frobenius normof a matrix A will be denoted, respectively, as det(A), tr(A)and ‖A‖F . The Kronecker product between two matrices isdenoted by ⊗, IL is the identity matrix of size L × L, 0denotes the zero matrix of the appropriate dimensions, andFN is the Fourier matrix of size N . We use A−1/2 to denotethe Hermitian square root matrix of the Hermitian matrix A−1

(the inverse of A), the operator diagL(A) constructs a blockdiagonal matrix from the L × L blocks in the diagonal ofA, whereas diag(A) yields a vector with the elements of themain diagonal of A, and x = vec(X) constructs a vector bystacking the columns of X. x ∼ CN (µ,R) indicates that x isa proper complex circular Gaussian random vector of mean µand covariance matrix R and E[·] represents the expectationoperator. Finally, ∝ stands for equality up to additive andpositive multiplicative constant (not depending on data) terms.

II. PROBLEM FORMULATION

We are given N samples of P time series that are Lvariate, xi[n] ∈ CL, i = 1, . . . , P, and n = 0, . . . , N − 1.These samples are realizations of zero-mean proper Gaussianprocesses that are independent and wide-sense stationary. Theproblem studied in this work is to determine whether allthese P processes have the same power spectral density (PSD)matrix at every frequency or, alternatively, the same matrix-valued covariance function. To mathematically formulate thedetection problem, it is necessary to introduce the vector yi =[xTi [0] · · · xTi [N −1]]T ∈ CNL, which stacks the N samplesof the ith time series, and y = [yT1 · · · yTP ]T ∈ CPNL. Thus,the problem can be cast as the following binary hypothesistest:

H1 : y ∼ CN (0,RH1) ,

H0 : y ∼ CN (0,RH0) ,

(1)

where CN (0,RHi) denotes a zero-mean circular complex

Gaussian distribution with covariance matrix RHi. Taking the

independence into account, the covariance matrices are

RH1=

R1 0 · · · 00 R2 · · · 0...

.... . .

...0 0 · · · RP

, (2)

and

RH0=

R0 0 · · · 00 R0 · · · 0...

.... . .

...0 0 · · · R0

= IP ⊗R0, (3)

under H1 and H0, respectively, with

Ri = E[yiyHi ] =

Mi[0] · · · Mi[−N + 1]...

. . ....

Mi[N − 1] · · · Mi[0]

, (4)

being a block-Toeplitz covariance matrix built from the(unknown) covariance sequence of xi[n], Mi[m] =E[xi[n]xHi [n−m]]. Moreover, under H1, we do not assumeany further particular structure and, for notational simplicity,we have defined the common covariance sequence under H0

as M0[m].Dealing with block-Toeplitz covariance matrices is challeng-

ing, since they typically prevent the derivation of closed-formdetectors, as our previous works in [19]–[21] show. Theseworks also presented a solution to overcome this problem,which is based on an asymptotic (as N →∞) approximationof the likelihood. Concretely, this approach performs a block-circulant approximation of Ri, and results in convergence inthe mean-square sense of the asymptotic likelihood to thelikelihood [21].

Assume now that M , with M ≥ L,1 independentand identically distributed (i.i.d.) realizations of y, say

1This reasonable assumption is necessary for the derivation of the GLRT.However, for the study of the existence of optimal invariant detectors, onlyPM ≥ L is required.

Page 3: Testing Equality of Multiple Power Spectral Density Matrices

3

y(0), . . . ,y(M−1), are available. Then, to obtain the asymp-totic likelihood, we must define the transformation z =[zT1 · · · zTP ]T , where

zi =(FHN ⊗ IL

)yi = [zTi [0] · · · zTi [N − 1]]T , (5)

with zi[k] being the discrete Fourier transform (DFT) of xi[n]at frequency θk = 2πk/N, k = 0, . . . , N − 1. Exploiting thistransformation, the asymptotic approximation of the likelihoodis [19], [20]

p(z(0), . . . , z(M−1); SHi) =

1

πPNLM det(SHi)M

exp{−M tr

(S−1Hi

S)}

, (6)

where the PNL × PNL sample covariance matrix of thetransformed observations is

S =1

M

M−1∑m=0

z(m)z(m)H , (7)

and the covariance matrices under both hypotheses are

SH1 =

S1 0 · · · 00 S2 · · · 0...

.... . .

...0 0 · · · SP

, (8)

andSH0

= IP ⊗ S0. (9)

Moreover, Si is an NL × NL block-diagonal matrix whoseL × L blocks Si,1, . . . ,Si,N are given by the power spectraldensity matrix, i.e.,

Si,k+1 = Si(ejθk) =

N−1∑n=0

Mi[n]e−jθkn, (10)

with i = 1, . . . , P, and k = 0, . . . , N − 1. Finally, usingthe asymptotic likelihood, the detection problem in (1) isasymptotically equivalent to

H1 : z(m) ∼ CN (0,SH1) , m = 0, . . . ,M − 1,

H0 : z(m) ∼ CN (0,SH0) , m = 0, . . . ,M − 1.(11)

That is, we are testing two different covariance matrices withknown structure but unknown values.

Although our formulation assumes Gaussian data, as well asthe availability of M realizations each of length N , this is notvery restrictive in practice. First, the Gaussianity assumptioncan be dropped since the transformed observations, zi[k], aresamples of the DFT and it is well known, see [22], thatunder some mild conditions the DFT of large data recordsyields zi[k] that are independent and Gaussian distributedwith covariance matrix Si(e

jθk). Moreover, if only M =1 realization is available, it is possible to split this singlerealization into M windows, but keeping in mind that therealizations may no longer be i.i.d., as the samples in differentwindows may be dependent. This resembles the Welch methodfor PSD estimation. Moreover, further exploiting on this idea,it would be possible to increase the number of realizationsallowing some overlap among different windows. However,the study of the side effects (due to a higher correlation

among windows) will not be analyzed in this work. Finally,the case of different numbers Mi of realizations for eachprocess would require a different treatment, which would beequivalent to the introduction of further structure (subsets ofidentical covariance matrices) under the alternative hypothesis.Although this is a very interesting case, which is currently un-der consideration, the modification of the problem invariancesintroduces an additional complexity that is beyond the scopeof this paper.

A. The generalized likelihood ratio testThe typical approach to solve detection problems with un-

known parameters, as (11), is based on the GLRT. Actually, theworks in [8], [9], [11] derived the GLRT for this problem underdifferent assumptions, but they only studied the case of P = 2time series. The GLRT in [11] was derived for univariate realtime series, which was extended to multivariate real signals in[8] and multivariate complex signals in [9]. Here, we presentthe (straightforward) extension of these GLRTs to P (≥ 2)complex and multivariate processes. Concretely, the GLRT isgiven by

log G ∝N−1∑k=0

P∑i=1

log

det(Si(e

jθk))

det

(1

P

P∑p=1

Sp(ejθk)

) , (12)

where

Si(ejθk) =

1

M

M−1∑m=0

z(m)i [k]z

(m)Hi [k], (13)

is the sample PSD matrix at frequency θk, i.e., an L×L blockof S. Alternatively, the GLRT may be rewritten as

log G ∝N−1∑k=0

P∑i=1

log det(Ci(e

jθk)), (14)

where the frequency coherence is

Ci(ejθ) =(

1

P

P∑p=1

Sp(ejθ)

)−1/2

Si(ejθ)

(1

P

P∑p=1

Sp(ejθ)

)−1/2

.

(15)Finally, it is important to address how the threshold must

be chosen. On one hand, we could use Wilks’ theorem [13],which states that the GLRT is asymptotically (as M → ∞)distributed as

− 2M

N−1∑k=0

P∑i=1

log det(Ci(e

jθk))∼ χ2

(P−1)NL2 , (16)

that is, it is distributed as a Chi-squared distribution with (P−1)NL2 degrees of freedom. On the other, and for the finitecase, we could take into account that the detector is invariantto MIMO filtering, which allows us to consider that under H0

the PSDs are Si(ejθ) = IL,∀θ and i = 1, . . . , P . Thus, under

this assumption we could obtain the thresholds using MonteCarlo simulations, which will depend on P,L and M , but willbe independent of the specific values of Si(e

jθ).

Page 4: Testing Equality of Multiple Power Spectral Density Matrices

4

III. ON THE EXISTENCE OF OPTIMAL DETECTORS

Since GLRTs are not necessarily optimal for finite datarecords [23], the goal of this section is to study the existenceof optimal invariant detectors for the hypothesis test in (11).In particular, we will show that neither the uniformly mostpowerful invariant test (UMPIT) nor the locally most powerfulinvariant test (LMPIT) exist in the general case.

To derive invariant detectors, such as the UMPIT or theLMPIT, we must first identify the problem invariances [15].Specifically, we must define the group of invariant transfor-mations, which is composed only of linear transformationssince Gaussianity must be preserved. Among those lineartransformations, it is clear that applying the same invertiblemultiple-input-multiple-output (MIMO) filtering to all timeseries does not modify the structure of the hypotheses. Thatis, if the PSDs are equal, the same MIMO filtering yields alsoidentical PSDs and if they are different, they will stay different.In particular, this transformation is xi[n] = (H∗xi)[n], whereH[n] ∈ CL×L is a filtering matrix common to all processesand ∗ denotes convolution, which when applied to zi becomes

zi = Gzi, (17)

where G is a block-diagonal matrix with invertible L × Lblocks. Additionally, we may label the processes in anyarbitrary order, which may be even done on a frequency-by-frequency basis. The last invariance consists of a frequencyreordering. That is, we may permute the frequencies, i.e.,permute zi[k], provided that the same permutation is appliedto all processes. Then, the group of invariant transformationsfor the hypothesis test in (11) is

G = {g : z 7→ g(z) = Gz}, (18)

where

G = (IP ⊗G)

(N∑k=1

PTk ⊗ eke

Tk ⊗ IL

)(IP ⊗T⊗IL), (19)

with ek being the kth column of IN , Pk ∈ RP×P andT ∈ RN×N . Moreover, the matrix IP ⊗ T ⊗ IL applies afrequency reordering (permutation) to every process, G is ablock-diagonal matrix with L×L invertible blocks Gk, and Pk

is a matrix that permutes the kth frequency of all processes,i.e., permutes the position of z1[k − 1], . . . , zP [k − 1] in z.Then, Pk ∈ Pk, T ∈ T, and Gk ∈ G, where Pk and T are theset of permutation matrices formed by Pk and T, respectively,and G is the set of L× L invertible matrices. In Appendix I,we prove that

(∑Nk=1 PT

k ⊗ ekeTk ⊗ IL

)z corresponds to the

relabeling of the processes at each frequency.Equipped with the transformation group G, it is possible to

study the existence of the UMPIT. The typical approach [15]involves finding the maximal invariant statistic and computingits densities under both hypotheses. An alternative to thisprocess, which is usually very involved or even intractable,is based on Wijsman’s theorem [16], [17], and allows us toderive the UMPIT, if it exists, without finding the maximalinvariant statistic nor its distributions. This theorem directly

gives the ratio of the distributions of the maximal invariantstatistic as follows

L =∑T,P1,...,PN

∫GN

|det(G)|2MP exp{−M tr

(S−1H1

GSGH)}

dG

∑T,P1,...,PN

∫GN

|det(G)|2MP exp{−M tr

(S−1H0

GSGH)}

dG

,

(20)

where GN = G × · · · × G and dG is an invariant measureon the set GN and the sum over Pk represents the sum overall permutations matrices in the set Pk. If the ratio L , or amonotone transformation thereof, did not depend on unknownparameters, it would yield the UMPIT. When such dependenceis present, the UMPIT does not exist, and in that case it issensible to consider the case of close hypotheses to study theexistence of the LMPIT.

In the following, we will simplify the ratio L , show that theUMPIT does not exist, and study the case of close hypotheses.The next lemma presents the first simplification of L .

Lemma 1: The ratio L in (20) can be written as

L ∝∑T

∑P1,...,PN

∫GN

exp (−Mα(G))

N∏l=1

β(Gl)dGl, (21)

where

α(G) =

N∑k=1

P∑i=1

tr(Wi,kGkCπk[i],Π[k]G

Hk

), (22)

the matrix Cπk[i],Π[k] is a permutation of the sample coherencematrix

Ci,k =

[1

P

P∑p=1

Sp,k

]−1/2

Si,k

[1

P

P∑p=1

Sp,k

]−1/2

, (23)

with

Si,k+1 =1

M

M−1∑m=0

z(m)i [k]z

(m)Hi [k], (24)

being the sample estimate of the PSD matrix of {xi[n]}N−1n=0

at frequency 2πk/N . Moreover, the scalar β(Gl) is given by

β(Gl) = |det(Gl)|2MP exp{−PM tr

(GHl Gl

)}, (25)

and the matrix Wi,k is

Wi,k =

(1

P

P∑p=1

S−1p,k

)−1/2

S−1i,k

(1

P

P∑p=1

S−1p,k

)−1/2

− IL.

(26)Proof: The proof is presented in Appendix II.

As can be seen in (21), the ratio L depends on the matricesWi,k, which are unknown, proving that the UMPIT does notexist. Hence, as previously mentioned, we focus hereafter onthe case of close hypotheses, i.e., the PSD matrices are verysimilar. In this case, S1 ≈ · · · ≈ SP , which yields Wi,k ≈ 0.Under this assumption, the exponent term in (21) becomes

Page 5: Testing Equality of Multiple Power Spectral Density Matrices

5

small and allows us to perform a Taylor series expansionaround α(G) = 0 as follows

exp(−Mα(G)) ≈ 1

2

(2− 2Mα(G) +M2α2(G)

), (27)

which yieldsL ∝ Ll + Lq, (28)

where the linear and quadratic terms are respectively given by

Ll = −2M∑T

∑P1,...,PN

∫GN

α(G)

N∏l=1

β(Gl)dGl, (29)

and

Lq ∝M2∑T

∑P1,...,PN

∫GN

α2(G)

N∏l=1

β(Gl)dGl. (30)

Next, we analyze the linear term Ll.Lemma 2: The linear term is zero, i.e.,

Ll = 0. (31)Proof: The proof can be found in Appendix III.

Since the linear term is zero, only the quadratic term has tobe taken into account. The final expression is provided in thefollowing theorem.

Theorem 1: The ratio of the distributions of the maximalinvariant statistic is given by

L ∝N∑k=1

P∑i=1

‖Ci,k‖2F + β

N∑k=1

P∑i=1

tr2(Ci,k

), (32)

where β is a data-independent function of the matrices Wi,k,which are unknown.

Proof: See Appendix IV.As Theorem 1 shows, the ratio L depends on unknown

parameters, which are summarized in β. Hence, the LMPITfor testing the equality of PSD matrices at all frequencies doesnot exist in the general case. An exception is examined in thefollowing section. Moreover, an LMPIT-inspired detector isalso presented in Section V, and its performance is analyzedusing computer simulations.

One final comment is in order. Since the ratio L is given bya linear combination (with unknown weights) of the Frobeniusnorm and the trace of Ci,k, the optimal detector would be afunction of the eigenvalues of Ci,k. This makes sense as thedistributions of these eigenvalues are not modified by any ofthe invariances.

IV. THE LMPIT FOR UNIVARIATE TIME SERIES

The case of univariate time series, L = 1, is interestingsince the LMPIT does exist, as shown in the next corollary.

Corollary 1: For L = 1 the ratio in (32) reduces to

L ∝N∑k=1

P∑i=1

|Ci,k|2, (33)

which is therefore the LMPIT.Proof: In the univariate case, the coherence matrices Ci,k

become scalar, that is, Ci,k = Ci,k, and consequently

‖Ci,k‖2F = tr2(Ci,k

)= |Ci,k|2, (34)

which yields

L ∝ (1 + β)

N∑k=1

P∑i=1

|Ci,k|2 ∝N∑k=1

P∑i=1

|Ci,k|2. (35)

Interestingly, using (10) and the definition of Ci,k in (23),the LMPIT in Corollary 1 may be rewritten in a moreinsightful form as

L ∝N−1∑k=0

P∑i=1

S2i (ejθk)

[P∑i=1

Si(ejθk)

]2 , (36)

or asymptotically (as N →∞)

L ∝∫ π

−π

P∑i=1

S2i (ejθ)

[P∑i=1

Si(ejθ)

]2

2π. (37)

Thus, for L = 1, the LMPIT is given by the integral of thesum of the squares of the PSD estimates normalized by thesquare of their sum.

V. AN LMPIT-INSPIRED DETECTOR

Since the LMPIT does not exist in the multivariate case(L > 1), we present here an LMPIT-inspired detector. Inparticular, we could use each of the terms in (32) as teststatistics, which are

LF =

N∑k=1

P∑i=1

‖Ci,k‖2F =

N−1∑k=0

P∑i=1

‖Ci(ejθk)‖2F , (38)

and

LT =

N∑k=1

P∑i=1

tr2(Ci,k

)=

N−1∑k=0

P∑i=1

tr2(Ci(e

jθk)), (39)

where the frequency coherence, Ci(ejθ), was defined in (15).

Note that in the univariate case (L = 1), both (38) and (39)reduce to the true LMPIT (33). However, for multivariateprocesses we only propose LF as a detector and discardLF . To understand why, let us analyze both. Consideringthe case where all PSDs are identical (H0), the coherencematrices are Ci(e

jθ) ≈ IL, ∀θ. Actually, for a large numberof realizations, M →∞, they converge to Ci(e

jθ) = IL, ∀θ.Hence, to distinguish between both hypotheses, the detectorsmust measure how different Ci(e

jθ) is from IL. This is exactlywhat the statistics LF and LT do. The only difference residesin the way they quantify this difference: while LF uses theFrobenius norm, LT uses the trace. Since the Frobenius normexploits information provided by the cross-spectral densities ofeach multivariate time series, information which is neglectedby the trace operator, one would expect LF to outperformLT .

Page 6: Testing Equality of Multiple Power Spectral Density Matrices

6

Finally, as in Section IV, it is possible to write the asymp-totic versions of (38) as

LF =

∫ π

−π

P∑i=1

‖Ci(ejθ)‖2F

2π. (40)

A. Threshold selection

In this section, we study the threshold selection problem forthe LMPIT-inspired detector LF . Similarly to the approachesdescribed for the GLRT, we could consider that the PSDs areSi(e

jθ) = IL,∀θ and i = 1, . . . , P , and use Monte Carlosimulations to obtain the thresholds. Of course, due to theinvariance to MIMO filtering, these thresholds should be validfor other PSDs. The second approach is also based on Wilks’theorem, but it cannot be directly applied. Concretely, we willfollow along the lines in [18]. First, for close hypotheses, theGLRT may be approximated by

N−1∑k=0

P∑i=1

log det(Ci(e

jθk))

=

N−1∑k=0

P∑i=1

L∑s=1

log(1 + εi,s(e

jθk))

≈N−1∑k=0

P∑i=1

L∑s=1

(εi,s(e

jθk)−ε2i,s(e

jθk)

2

), (41)

where 1 + εi,s(ejθk) is the sth eigenvalue of Ci(e

jθk) and|εi,s(ejθk | � 1. After some straightforward manipulations, theabove approximation becomes

N−1∑k=0

P∑i=1

log det(Ci(e

jθk))≈ NPL

2+

N−1∑k=0

P∑i=1

L∑s=1

(2εi,s(e

jθk)−(1 + εi,s(e

jθk))2

2

), (42)

Now, using (60), we getP∑i=1

L∑s=1

εi,s(ejθk) = 0, (43)

which yields

− 2M

N−1∑k=0

P∑i=1

log det(Ci(e

jθk))

≈MN−1∑k=0

P∑i=1

‖Ci(ejθk)‖2F −MNPL. (44)

Hence, we obtain the following asymptotic distribution of LF

(MLF −MNPL) ∼ χ2(P−1)NL2 . (45)

VI. NUMERICAL RESULTS

This section studies the performance of the proposed detec-tor using Monte Carlo simulations, and compare it with thatof the GLRT. The performance evaluation is carried out in acommunication setup, where the signals are generated as

xi[n] =

T−1∑τ=0

Hi[τ ]si[n− τ ] + vi[n], i = 1, . . . , P,

−4 −2 0 2 4 6 8 1010−4

10−3

10−2

10−1

100

SNR (dB)

pm

GLRTLF

Fig. 1: Probability of missed detection for Experiment 1: P =3, L = 3, Q = 1, T = 20, ρ = 0.75, ∆h = 0.1, M = 4 andN = 128

which corresponds to a MIMO channel with finite impulseresponse. In this expression, the transmitted signals si[n] ∈CQ are independent multivariate processes whose entries areindependent QPSK symbols with unit energy, the noise vectorsvi[n] ∈ CL are independent with variance σ2, and spatiallyand temporally white. The channel H1[n] is a RayleighMIMO channel with unit energy,2 spatially uncorrelated, andwith exponential power delay profile of parameter ρ. Finally,Hi[n] =

√1−∆hH1[n] +

√∆hEi[n], i = 2, . . . , P , with

Ei[n] possessing the same statistical properties as H1[n] andbeing independent. Under this model, ∆h = 0 corresponds tosignals having the same PSD, that is H0, and 0 < ∆h ≤ 1measures how far the hypotheses are, along with the signal-to-noise ratio, which is defined as

SNR (dB) = 10 log

(1

σ2

). (46)

Experiment 1: In this first experiment, we have consideredP = 3 processes of dimension L = 3, Q = 1 signals aretransmitted through MIMO channels with T = 20 taps, theparameter of the exponential power delay profile is ρ = 0.75,and ∆h = 0.1 under H1. Moreover, to carry out the detection,a realization of 512 samples is available, which is then dividedinto M = 4 windows of length N = 128. The probabilityof missed detection for a fixed probability of false alarmpfa = 10−2 and for a varying SNR is depicted in Fig. 1.As this figure shows, the proposed LMPIT-inspired detector,LF , outperforms the GLRT, with an approximate gain of 2dB.

Experiment 2: The setup of this experiment is equivalent tothat of Experiment 1, with the exception that Q = 3 signals aretransmitted. The results for this scenario are presented in Fig.2, where similar conclusions can be drawn. In this scenario,which could be expected to be a bit more favorable for the

2Each element of H1[n] follows a proper complex Gaussian distributionwith zero mean and unit variance.

Page 7: Testing Equality of Multiple Power Spectral Density Matrices

7

−4 −2 0 2 4 6 8 1010−4

10−3

10−2

10−1

100

SNR (dB)

pm

GLRTLF

Fig. 2: Probability of missed detection for Experiment 2: P =3, L = 3, Q = 3, T = 20, ρ = 0.75, ∆h = 0.1, M = 4 andN = 128

−5 −4 −3 −2 −1 010−4

10−3

10−2

10−1

100

SNR (dB)

pm

GLRTLF

Fig. 3: Probability of missed detection for Experiment 3: P =3, L = 5, Q = 5, T = 20, ρ = 0.75, ∆h = 0.1, M = 8 andN = 128

GLRT, since the true PSD matrices are full rank, the detectorLF still outperforms the GLRT.

Experiment 3: The third experiment considers P = 3processes of dimension L = 5, and Q = 5 signals aretransmitted. The channel parameters remain the same as inthe two previous experiments. However, in this case, 1024samples are acquired, which are divided into M = 8 windowsof length N = 128. In this case, the difference between theGLRT and the Frobenius norm detector is reduced as Fig. 3shows. This was expected since, in this case, there is a largerM , which reduces the accuracy of the second-order Taylorexpansion in (27), i.e., the assumption of close hypothesesbegins to not hold true.

Experiment 4: The fourth experiment also analyzes theeffect of the distance between the hypotheses. In particular,we have obtained the probability of missed detection (pfa =10−2) for a varying ∆h and two different SNRs, 0 and 5 dBs.

0 0.2 0.4 0.6 0.810−4

10−3

10−2

10−1

100

∆h

pm

SNR = 0 dBSNR = 5 dB

GLRTLF

Fig. 4: Probability of missed detection for Experiment 4: P =2, L = 3, Q = 3, T = 20, ρ = 0.75, M = 4 and N = 128

In this experiment, there are P = 2 processes of dimensionL = 3, and Q = 3 signals are transmitted. The channelparameters remain the same as in the previous experimentswith the exception of ∆h, and 512 samples are obtained, whichare divided into M = 4 realizations of length N = 128.The results for this experiment are shown in Fig. 4, whichdemonstrates that the close hypotheses assumption holds formany setups, where the detector LF still outperforms theGLRT.

Experiment 5: In the fifth experiment, we evaluate theeffect of N and M . Specifically, we have considered a scenariowith the same parameters of Experiment 1, with the exceptionof the SNR, which is fixed to 3 dB, the length of the longrealization and how it is divided. Concretely, we have sweptN between 32 and 256 in steps of 16 samples, and consideredM = 4 and M = 8. Thus, a long realization of the appropriatelength is generated and divided according to the values of Nand M , that is, for each point of the curves the total numberof samples may be different. Figure 5 shows the probabilityof missed detection for pfa = 10−2, which shows that inthis setup it is more convenient to reduce the variance of theestimator (increase M ) at the expense of a lower resolution(small N ). This can be seen if we compare the probabilityof missed detection for N = 32 and M = 8 with that ofN = 64 and M = 4. Both have same number of samplesMN = 256, but pm is smaller for M = 8, i.e., for LF wehave pm = 0.1346 against pm = 0.3454. Finally, note that thisanalysis affects both, the GLRT and the proposed detector.

Experiment 6: This experiment evaluates the performanceof the detectors in a larger-scale scenario. Specifically, wehave considered P = 2 processes of dimension L = 30,Q = 3, the MIMO channels have T = 20 taps, ρ = 0.75 andSNR = −8 dB, ∆h = 0.1 under H1, and a long realizationof 3840 samples is generated, which is then divided intoM = 30 windows of length N = 128. The receiver operatingcharacteristic (ROC) curve for both detectors is depicted inFigure 6, which shows the better performance of the proposeddetector even in this large-scale scenario.

Page 8: Testing Equality of Multiple Power Spectral Density Matrices

8

50 100 150 200 25010−4

10−3

10−2

10−1

100

N

pm

M = 4M = 8

GLRTLF

Fig. 5: Probability of missed detection for Experiment 5: P =3, L = 3, Q = 1, T = 20, ρ = 0.75, ∆h = 0.1, and SNR =3 dB

0 0.2 0.4 0.6 0.8 10

0.2

0.4

0.6

0.8

1

pfa

pd

GLRTLF

Fig. 6: ROC curves for Experiment 6: P = 2, L = 30, Q = 3,T = 20, ρ = 0.75, ∆h = 0.1, SNR = −8 dB, M = 30 andN = 128

Experiment 7: In this experiment, we evaluate the accuracyof Wilks’ approximations for both, GLRT and the LMPIT-inspired detector. Fig. 7 shows the accuracy of these approxi-mations for a scenario with P = 3 processes of dimensionL = 4, and Q = 4 signals are transmitted. The channelparameters are those of Experiment 1 with an SNR = 5 dB.We have considered a long realization (of the appropriatelength) that is divided into M = 10, 20, . . . , 100 windowsof length N = 64. As can be seen in the figure, the χ2

distribution approximates much better the distribution of LF

than that of the GLRT. That is, it seems to converge faster forthe Frobenius norm based detector than for the GLRT.

VII. CONCLUSIONS

This work has studied the existence of optimal invariantdetectors for testing whether P multivariate time series havethe same power spectral density (PSD) matrix at every fre-

1,800 2,000 2,200 2,400 2,6000

0.2

0.4

0.6

0.8

1

Normalized test statistic

EC

DF

GLRTLF

χ2(P−1)NL2

Fig. 7: Empirical cumulate distribution functions (ECDF) forExperiment 7: P = 3, L = 4, Q = 4, T = 20, ρ = 0.75,M = 10, 20, . . . , 100, N = 64, and SNR = 5 dB

quency. Specifically, our derivation shows that the uniformlymost powerful invariant test (UMPIT) for this problem doesnot exist. Considering close hypotheses (i.e., similar PSDmatrices), we obtained the locally most powerful invariant test(LMPIT) for the case of univariate time series, and showedthat the LMPIT does not exist in the multivariate case. Never-theless, our derivation suggested one LMPIT-inspired detectorfor multivariate time series, which outperforms previouslyproposed detectors as shown by extensive numerical examples.

APPENDIX IDERIVATION OF THE RELABELING MATRICES

Let us start by rewriting z as z = vec (Z), where

Z =

z1[0] · · · zP [0]...

. . ....

z1[N − 1] · · · zP [N − 1]

=

N∑k=1

ek ⊗[z1[k − 1] · · · zP [k − 1]

]. (47)

Relabeling the processes at the kth frequency corresponds topermuting the colums of

[z1[k − 1] · · · zP [k − 1]

], that

is,[z1[k − 1] · · · zP [k − 1]

]Pk, where Pk is an arbitary

P ×P permutation matrix. It is important to note that the per-mutation matrix Pk depends on the frequency since we mayapply different relabelings at each frequency. The observationsafter the N (possibly) different relabelings are given by

Z =

N∑k=1

ek ⊗([

z1[k − 1] · · · zP [k − 1]]Pk

)=

N∑k=1

(ek ⊗

[z1[k − 1] · · · zP [k − 1]

])Pk. (48)

Taking now into account that[z1[k − 1] · · · zP [k − 1]

]=(eTk ⊗ IL

)Z, (49)

Page 9: Testing Equality of Multiple Power Spectral Density Matrices

9

it is easy to show that

ek ⊗[(

eTk ⊗ IL)Z]

=(ek ⊗ eTk ⊗ IL

)Z

=(eke

Tk ⊗ IL

)Z, (50)

which yields

Z =

N∑k=1

(eke

Tk ⊗ IL

)ZPk. (51)

Finally, vectorizing Z yields

z = vec(Z) =

(N∑k=1

PTk ⊗ eke

Tk ⊗ IL

)z. (52)

APPENDIX IIPROOF OF LEMMA 1

Since G and SHi are block-diagonal matrices with blocksize L, we may substitute S in (20) by diagL(S) withoutmodifying the integrals. Before proceeding, we must definethe block-diagonal matrix

Sπ =

N∑k,l=1

(PTk ⊗ eke

Tk ⊗ IL

)(IP ⊗T⊗ IL) diagL(S)×

(IP ⊗TT ⊗ IL)(Pl ⊗ ele

Tl ⊗ IL

), (53)

and, taking into account the effect of the permutations, itbecomes

Sπ =

Sπ1[1],Π[1] 0 · · · 0

0 Sπ2[1],Π[2] · · · 0...

.... . .

...0 0 · · · SπN [P ],Π[N ]

, (54)

where πk[·], k = 1, . . . , N, are possibly different permutationsof size P and Π[·] is a permutation of size N . That is, πk[·]is the permutation associated to Pk, Pk → πk[·], and Π[·] isthe permutation associated to T, T→ Π[·]. Applying now the

change of variables GΠ[k] → GΠ[k]

[1/P

∑Pi=1 Si,Π[k]

]−1/2

to the integrals in the numerator and denominator of (20), theratio L becomes

L =

∑T

∑P1,...,PN

∫GN

|det(G)|2MP exp (−Mγ1) dG

∑T

∑P1,...,PN

∫GN

|det(G)|2MP exp (−Mγ2) dG

, (55)

where

γ1 = tr(S−1H1

(IP ⊗G)Cπ(IP ⊗GH)), (56)

andγ2 = tr

((IP ⊗GHS−1

0 G)Cπ

), (57)

with

Cπ =

Cπ1[1],Π[1] 0 · · · 0

0 Cπ2[1],Π[2] · · · 0...

.... . .

...0 0 · · · CπN [P ],Π[N ]

, (58)

where we have used (9). We continue by applying the changeof variables Gk → S

1/20,kGk to the integral in the denominator,

which simplifies γ2 to

γ2 = tr((

IP ⊗GHG)Cπ

)=

N∑k=1

tr

(GHk Gk

P∑i=1

Cπk[i],Π[k]

)= P

N∑k=1

tr(GHk Gk

),

(59)

where we have taken into account thatP∑i=1

Ci,k = P IL. (60)

Since this exponent does not depend on the observations, thedenominator may be discarded from the ratio. Let us nowconsider the change of variables G→

(1/P

∑i S−1i

)−1/2G,

which yields

γ1 = tr[(W + I) (IP ⊗G)Cπ(IP ⊗GH)

], (61)

where

W =

W1,1 0 · · · 0

0 W1,2 · · · 0...

.... . .

...0 0 · · · WP,N

, (62)

with Wi,k defined in (26). The proof concludes by taking(60) again into account and the block-diagonal structure of allmatrices.

APPENDIX IIIPROOF OF LEMMA 2

The linear term Ll can be rewritten as

Ll = −2MψN−1∑T

N∑k=1

∑P1,...,PN

P∑i=1∫

Gβ(Gk) tr

(Wi,kGkCπk[i],Π[k]G

Hk

)dGk, (63)

where

ψ =

∫Gβ(Gl)dGl, (64)

does not depend on l. Now, performing the sum overP1, . . . ,PN , Ll becomes

Ll = −2[(P − 1)!]NMψN−1∑T

N∑k=1

P∑pk=1

P∑i=1∫

Gβ(Gk) tr

(Wi,kGkCpk,Π[k]G

Hk

)dGk

= −2[(P − 1)!]NMψN−1∑T

N∑k=1

P∑pk=1∫

Gβ(Gk) tr

[(P∑i=1

Wi,k

)GkCpk,Π[k]G

Hk

]dGk, (65)

Page 10: Testing Equality of Multiple Power Spectral Density Matrices

10

where for notational convenience

N∑k=1

P∑pk=1

=

N∑k=1

P∑p1=1

· · ·P∑

pN=1

, (66)

and we have taken into account that∑Pf(π[i]) = (P − 1)!

P∑p=1

f(p), (67)

for permutations of size P and any arbitrary function f(·).The proof follows from

P∑i=1

Wi,k = 0, ∀k. (68)

APPENDIX IVPROOF OF THEOREM 1

Exploiting the results of Lemma 2, the ratio of distributionsof the maximal invariant statistic simplifies to

L ∝∑T

∑P1,...,PN

∫GN

α2(G)

N∏l=1

β(Gl)dGl, (69)

and expanding α2(G) yields

L ∝ L1 + L2 + L3 + L4 (70)

where the expressions of the terms in the right-hand side of(70) are shown at the top of the next page. After summingover P1, . . . ,PN and T, L1 becomes

L1 ∝N∑

k,l=1

P∑pk=1

P∑i=1

∫Gβ(Gk) tr2

(Wi,kGkCpk,lG

Hk

)dGk.

(75)Let us now consider L2, which after summing overP1, . . . ,PN , becomes

L2 ∝∑T

N∑k,l=1k 6=l

P∑pk=1

P∑ql=1

P∑i=1[∫

Gβ(Gk) tr

(Wi,kGkCpk,Π[k]G

Hk

)dGk

]×[∫

Gβ(Gl) tr

(Wi,lGlCql,Π[l]G

Hl

)dGl

]. (76)

Carrying out the summations in pk and ql, and taking (60)into account, the term L2 simplifies to

L2 ∝∑T

N∑k,l=1k 6=l

P∑i=1

[∫Gβ(Gk) tr

(Wi,kGkG

Hk

)dGk

]

×[∫

Gβ(Gl) tr

(Wi,lGlG

Hl

)dGl

], (77)

which does not depend on the observations and thereforecan be discarded. We shall now focus on L3, which can berewritten as

L3 ∝∑T

N∑k=1

P∑pk=1

P∑qk=1pk 6=qk

P∑i,j=1i 6=j∫

Gβ(Gk) tr

(Wi,kGkCpk,Π[k]G

Hk

)× tr

(Wj,kGkCqk,Π[k]G

Hk

)dGk, (78)

since ∑Pf(π[i])g(π[j]) = (P − 2)!

P∑p,q=1p 6=q

f(p)g(q), (79)

for permutations of size P , i 6= j, and two arbitrary functionsf(·) and g(·). The expression for L3 simplifies to

L3 ∝∑T

N∑k=1

P∑pk=1

P∑i,j=1i6=j

∫Gβ(Gk) tr

(Wi,kGkCpk,Π[k]G

Hk

)

× tr(Wj,kGk

(P I− Cpk,Π[k]

)GHk

)dGk, (80)

after summing in qk and taking into account that

P∑qk=1pk 6=qk

Cqk,Π[k] = P IL − Cpk,Π[k]. (81)

Finally, expanding the second trace and summing over pk andj yields

L3 ∝N∑

k,l=1

P∑pk=1

P∑i=1

∫Gβ(Gk) tr2

(Wi,kGkCpk,lG

Hk

)dGk,

(82)

which is identical (up to a multiplicative and additive con-stants) to L1. Summing over P1, . . . ,PN , the term L4 be-comes

L4 ∝∑T

N∑k,l=1k 6=l

P∑pk=1

P∑ql=1

P∑i,j=1i6=j[∫

Gβ(Gk) tr

(Wi,kGkCpk,Π[k]G

Hk

)dGk

]×[∫

Gβ(Gl) tr

(Wj,lGlCql,Π[l]G

Hl

)dGl

], (83)

which reduces to

L4 ∝∑T

N∑k,l=1k 6=l

P∑i,j=1i 6=j

[∫Gβ(Gk) tr

(Wi,kGkG

Hk

)dGk

]

×[∫

Gβ(Gl) tr

(Wj,lGlG

Hl

)dGl

], (84)

Page 11: Testing Equality of Multiple Power Spectral Density Matrices

11

L1 = ψN−1∑T

N∑k=1

∑P1,...,PN

P∑i=1

∫Gβ(Gk) tr2

(Wi,kGkCπk[i],Π[k]G

Hk

)dGk, (71)

L2 = ψN−2∑T

N∑k,l=1k 6=l

∑P1,...,PN

P∑i=1

[∫Gβ(Gk) tr

(Wi,kGkCπk[i],Π[k]G

Hk

)dGk

]

×[∫

Gβ(Gl) tr

(Wi,lGlCπl[i],Π[l]G

Hl

)dGl

], (72)

L3 = ψN−1∑T

N∑k=1

∑P1,...,PN

P∑i,j=1i 6=j

∫Gβ(Gk) tr

(Wi,kGkCπk[i],Π[k]G

Hk

)tr(Wj,kGkCπk[j],Π[k]G

Hk

)dGk, (73)

L4 = ψN−2∑T

N∑k,l=1k 6=l

∑P1,...,PN

P∑i,j=1i 6=j

[∫Gβ(Gk) tr

(Wi,kGkCπk[i],Π[k]G

Hk

)dGk

]

×[∫

Gβ(Gl) tr

(Wj,lGlCπl[j],Π[l]G

Hl

)dGl

]. (74)

after summing over pk and ql, and taking (60) into account.It is clear that L4 does not depend on the observations andtherefore can be discarded. Then, combining all Li, we obtain

L ∝N∑

k,l=1

P∑pk=1

P∑i=1

∫Gβ(Gk) tr2

(Wi,kGkCpk,lG

Hk

)dGk.

(85)Applying the change of variables Gk → Vi,kGkU

Hpk,l

, withCpk,l = Upk,lΣpk,lU

Hpk,l

and Wi,k = Vi,kΛi,kVHi,k being

the eigenvalue decompositions of Cpk,l and Wi,k, yields

L ∝N∑

k,l=1

P∑pk=1

P∑i=1

∫Gβ(Gk) tr2

(GHk Λi,kGkΣpk,l

)dGk.

(86)Now, expressing the trace as

tr(GHk Λi,kGkΣpk,l

)= σTpk,lGkλi,k, (87)

where σpk,l = diag(Σpk,l), λi,k = diag(Λi,k), and[Gk]m,n = |[Gk]m,n|2, the ratio becomes

L ∝N∑

k,l=1

P∑pk=1

P∑i=1

σTpk,lEi,kσpk,l, (88)

where

Ei,k =

∫Gβ(Gk)Gkλi,kλ

Ti,kG

Tk dGk. (89)

The quadratic form σTpk,lEi,kσpk,l is invariant to permuta-tions3 of the elements of σpk,l, then Ei,k must be of the form

Ei,k = ei,kI + ei,k11T , (90)

3This permutation is an element of the set G, i.e., particular case of themultiplication by Gk .

yielding

L ∝N∑

k,l=1

P∑pk=1

P∑i=1

σTpk,l(ei,kI + ei,k11T

)σpk,l

=

N∑k,l=1

P∑pk=1

P∑i=1

(ei,k‖Cpk,l‖2 + ei,k tr2(Cpk,l)

)

=

N∑k,l=1

P∑pk=1

(ek‖Cpk,l‖2 + ek tr2(Cpk,l)

), (91)

where

ek =

P∑i=1

ei,k, ek =

P∑i=1

ei,k. (92)

The proof concludes by rewriting L as

L ∝ eN∑l=1

P∑pk=1

‖Cpk,l‖2 + e

N∑l=1

P∑pk=1

tr2(Cpk,l), (93)

where

e =

N∑k=1

ek e =

N∑k=1

ek, (94)

dividing (93) by e and defining β = e/e.

REFERENCES

[1] D. S. Coates and P. J. Diggle, “Tests for comparing two estimatedspectral densities,” Journal of Time Series Analysis, vol. 7, no. 1, pp.7–20, Jan. 1986.

[2] P. J. Diggle and N. I. Fisher, “Nonparametric comparison of cumulativeperiodograms,” Journal Royal Stat. Soc. Series C (App. Stat.), vol. 40,no. 3, pp. 423–434, 1991.

[3] Y. Kakizawa, R. H. Shumway, and M. Taniguchi, “Discriminationand clustering for multivariate time series,” Journal Ame. Stat. Assoc.,vol. 93, no. 441, pp. 328–340, Mar. 1998.

[4] K. Fokianos and A. Savvides, “On comparing several spectral densities,”Technometrics, vol. 50, no. 3, pp. 317–331, 2008.

Page 12: Testing Equality of Multiple Power Spectral Density Matrices

12

[5] J. K. Tugnait, “Wireless user authentication via comparison of powerspectral densities,” IEEE J. Sel. Areas Comm., vol. 31, no. 9, pp. 1791–1802, 2013.

[6] A. Tani and R. Fantacci, “A low-complexity cyclostationary-based spec-trum sensing for UWB and WiMAX coexistence with noise uncertainty,”IEEE Trans. Vehicular Tech., vol. 59, no. 6, pp. 2940–2950, 2010.

[7] P. J. Diggle, Time Series. Oxford University Press, 1990.[8] N. Ravishanker, J. R. M. Hosking, and J. Mukhopadhyay, “Spectrum-

based comparison of stationary multivariate time series,” Meth. Comp.App. Prob., vol. 12, no. 4, pp. 749–762, 2010.

[9] J. K. Tugnait, “Comparing multivariate complex random signals: Al-gorithm, performance analysis and application,” IEEE Trans. SignalProcess., vol. 64, no. 4, 2016.

[10] C. Jentsch and M. Pauly, “Testing equality of spectral densities usingrandomization techniques,” Bernoulli, vol. 21, no. 2, pp. 697–739, May2015.

[11] R. Lund, H. Bassily, and B. Vidakovic, “Testing equality of stationaryautocovariances,” Journal of Time Series Analysis, vol. 30, no. 3, pp.332–348, 2009.

[12] T. W. Anderson, An Introduction to Multivariate Statistical Analysis.New York: Wiley, 1958.

[13] S. M. Kay, Fundamentals of Statistical Signal Processing: DetectionTheory. Prentice Hall, 1998, vol. II.

[14] D. Ramırez, D. Romero, J. Vıa, R. Lopez-Valcarce, and I. Santamarıa,“Locally optimal invariant detector for testing equality of two powerspectral densities,” in IEEE Int. Conf. on Acoustics, Speech and SignalProcess., Calgary, Canada, Apr. 2018.

[15] L. L. Scharf, Statistical Signal Processing: Detection, Estimation, andTime Series Analysis. Addison - Wesley, 1991.

[16] R. A. Wijsman, “Cross-sections of orbits and their application todensities of maximal invariants,” in Proc. Fifth Berkeley Symp. Math.Stat. Prob., vol. 1, 1967, pp. 389–400.

[17] J. R. Gabriel and S. M. Kay, “Use of Wijsman’s theorem for the ratio ofmaximal invariant densities in signal detection applications,” in AsilomarConf. Signals, Systems, and Computers, vol. 1, Nov. 2002, pp. 756 –762.

[18] D. Ramırez, J. Vıa, I. Santamarıa, and L. L. Scharf, “Locally mostpowerful invariant tests for correlation and sphericity of Gaussianvectors,” IEEE Trans. Inf. Theory, vol. 59, no. 4, pp. 2128–2141, Apr.2013.

[19] D. Ramırez, P. J. Schreier, J. Vıa, I. Santamarıa, and L. L. Scharf, “De-tection of multivariate cyclostationarity,” IEEE Trans. Signal Process.,vol. 63, no. 20, pp. 5395–5408, Oct. 2015.

[20] D. Ramırez, J. Vıa, I. Santamarıa, and L. L. Scharf, “Detection ofspatially correlated Gaussian time series,” IEEE Trans. Signal Process.,vol. 58, no. 10, pp. 5006–5015, Oct. 2010.

[21] D. Ramırez, G. Vazquez-Vilar, R. Lopez-Valcarce, J. Vıa, and I. San-tamarıa, “Detection of rank-P signals in cognitive radio networks withuncalibrated multiple antennas,” IEEE Trans. Signal Process., vol. 59,no. 8, pp. 3764–3774, Aug. 2011.

[22] D. R. Brillinger, Time Series: Data Analysis and Theory. McGraw-Hill,1981.

[23] K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. NewYork: Academic, 1979.

David Ramırez (S’07-M’12-SM’16) received theTelecommunication Engineer degree and the Ph.D.degree in Electrical Engineering from the Universityof Cantabria, Spain, in 2006 and 2011, respec-tively. From 2006 to 2011, he was with the Com-munications Engineering Department, University ofCantabria, Spain. In 2011, he joined as a researchassociate the University of Paderborn, Germany, andlater on, he became assistant professor (Akademis-cher Rat). He is now assistant professor (profesorvisitante) with the University Carlos III of Madrid.

Dr. Ramırez was a visiting researcher at the University of Newcastle, Australiaand at the University College London. His current research interests includesignal processing for wireless communications, statistical signal processing,change-point management, and signal processing on graphs. Dr. Ramırez hasbeen involved in several national and international research projects on thesetopics. He was the recipient of the 2012 IEEE Signal Processing SocietyYoung Author Best Paper Award and the 2013 extraordinary Ph.D. award ofthe University of Cantabria. Moreover, he currently serves as associate editorfor the IEEE Transactions on Signal Processing and is a member of the IEEETechnical Committee on Signal Processing Theory and Methods. Finally, Dr.Ramırez was Publications Chair of the 2018 IEEE Workshop on StatisticalSignal Processing.

D. Romero (M’16) received his M.Sc. and Ph.D.degrees in Signal Theory and Communications fromthe University of Vigo, Spain, in 2011 and 2015,respectively. From Jul. 2015 to Nov. 2016, he was apost-doctoral researcher with the Digital TechnologyCenter and Department of Electrical and ComputerEngineering, University of Minnesota, USA. In Dec.2016, he joined the Department of Information andCommunication Technology, University of Agder,Norway, as an associate professor. His main researchinterests lie in the areas of machine learning, opti-

mization, signal processing, and communications.

Javier Vıa (M’08-SM’12) received the Degree intelecommunication engineering and the Ph.D. de-gree in electrical engineering from the Universityof Cantabria, Cantabria, Spain, in 2002 and 2007,respectively.

He joined the Department of CommunicationsEngineering, University of Cantabria, in 2002, wherehe is currently an Associate Professor. He has spentvisiting periods at the Smart Antennas ResearchGroup, Stanford University, Stanford, CA, USA,and the Department of Electronics and Computer

Engineering, Hong Kong University of Science and Technology, Hong Kong.He has actively participated in several European and Spanish research projects.His current research interests include blind channel estimation and equal-ization in wireless communication systems, multivariate statistical analysis,quaternion signal processing, and kernel methods.

Page 13: Testing Equality of Multiple Power Spectral Density Matrices

13

Roberto Lopez-Valcarce (S’95-M’01) received thetelecommunication engineering degree from the Uni-versity of Vigo, Vigo, Spain, in 1995, and the M.S.and Ph.D. degrees in electrical engineering from theUniversity of Iowa, Iowa City, IA, USA, in 1998and 2000, respectively. In 1995, he was a ProjectEngineer with Intelsis. He was a Ramn y Cajal Post-Doctoral Fellow of the Spanish Ministry of Scienceand Technology from 2001 to 2006. During thatperiod, he was with the Signal Theory and Com-munications Department, University of Vigo, where

he is currently an Associate Professor. From 2010 to 2013, he was a ProgramManager of the Galician Regional Research Program on Information andCommunication Technologies with the Department of Research, Developmentand Innovation. He has co-authored over 60 papers in leading internationaljournals and holds several patents in collaboration with industry. His mainresearch interests include adaptive signal processing, digital communications,and sensor networks.

Dr. Lopez-Valcarce was a recipient of the 2005 Best Paper Award from theIEEE Signal Processing Society. He served as an Associate Editor of the IEEETransactions on Signal Processing from 2008 to 2011, and as a member ofthe IEEE Signal Processing for Communications and Networking TechnicalCommittee from 2011 to 2013. Currently he serves as Area Editor for theSignal Processing Journal.

Ignacio Santamaria (M’96-SM’05) received theTelecommunication Engineer degree and the Ph.D.degree in electrical engineering from the Universi-dad Politecnica de Madrid (UPM), Spain, in 1991and 1995, respectively. In 1992, he joined the De-partment of Communications Engineering, Univer-sity of Cantabria, Spain, where he is Full Pro-fessor since 2007. He has co-authored more than200 publications in refereed journals and interna-tional conference papers, and holds two patents. Hiscurrent research interests include signal processing

algorithms and information-theoretic aspects of multiuser multiantenna wire-less communication systems, multivariate statistical techniques, and machinelearning theories. He has been involved in numerous national and internationalresearch projects on these topics.

He has been a visiting researcher at the University of Florida (in 2000 and2004), at the University of Texas at Austin (in 2009), and at the Colorado StateUniversity. Prof. Santamaria was general co-chair of the 2012 IEEE Workshopon Machine Learning for Signal Processing (MLSP 2012). From 2009 to2014, he was a member of the IEEE Machine Learning for Signal ProcessingTechnical Committee. He served as Associate Editor and Senior Area Editorof the IEEE Transactions on Signal Processing (2011-2015). He was a co-recipient of the 2008 EEEfCOM Innovation Award, as well as coauthor of apaper that received the 2012 IEEE Signal Processing Society Young AuthorBest Paper Award.