on the distribution of indefinite quadratic forms in...

13
On the Distribution of Indefinite Quadratic Forms in Gaussian Random Variables T. Y. Al-Naffouri 1,2 , M. Moinuddin 3,4 , Nizar Ajeeb 5 , Babak Hassibi 6 , and Aris L. Moustakas 7 1 Electrical Engineering Department, King Fahd University of Petroleum and Minerals, Saudi Arabia 2 Electrical Engineering Department, King Abdullah University of Science and Technology, Saudi Arabia 3 Electrical and Computer Engineering Department, King Abdulaziz University, Saudi Arabia 4 Center of Excellence in Intelligent Engineering Systems (CEIES), King Abdulaziz University,Saudi Arabia 5 Electrical and Computer Engineering Department, American University of Beirut, Beirut, Lebanon 6 Electrical Engineering Department, California Institute of Technology, California, U.S.A 7 Physics Department, National Kapodistrian University of Athens, Greece Abstract—In this work, we propose a unified approach to evaluating the CDF and PDF of indefinite quadratic forms in Gaussian random variables. Such a quantity appears in many applications in communications, signal processing, information theory, and adaptive filtering. For example, this quantity appears in the mean-square-error (MSE) analysis of the normalized least-mean-square (NLMS) adaptive algo- rithm, and SINR associated with each beam in beam form- ing applications. The trick of the proposed approach is to replace inequalities that appear in the CDF calculation with unit step functions and to use complex integral representa- tion of the the unit step function. Complex integration allows us then to evaluate the CDF in closed form for the zero mean case and as a single dimensional integral for the non-zero mean case. Utilizing the saddle point technique allows us to closely approximate such integrals in non zero mean case. We demonstrate how our approach can be extended to other scenarios such as the joint distribution of quadratic forms and ratios of such forms, and to characterize quadratic forms in isotropic distributed random variables. We also evaluate the outage probability in multiuser beamforming using our approach to provide an application of indefinite forms in communications. Key Words: wireless communications, Correlated Gaus- sian random vectors, multi-user diversity, weighted norms of Gaussian variables. I. I NTRODUCTION Gaussian random variables (r.v.’s) play a very important role in signal processing, communications, and informa- tion theory [1]. One reason why Gaussian r.v.’s are so ubiquitous is the central limit theorem which states that under conditions often reasonable in applications, the probability density function (PDF) of the sum of inde- pendent random variables approaches that of a Gaussian random variable. It is very important to find the distributions of various quantities involving Gaussian random variables, most notably sums of squares of Gaussian random variables (quadratic forms) and ratios of such norms. The quadratic forms in Gaussian random variables [2], [3] appear in many applications in communications, signal processing, and statistics. Some of these applications include non- coherent detection [4], [5], [6], performance analysis of wireless relay networks [7], [8], cooperative diversity in wireless networks [9], diversity combining in communi- cation systems [10], [11], array processing and random beam forming [12], estimation of power spectra [13], X 2 test, analysis of variance [3], probability content of regions under spherical normal distributions [14], and performance analysis of the adaptive filtering algorithms [15], [16], [17]. Table I lists specific applications of indefinite quadratic forms in the field of communications. A. Characterizing the Behavior of Quadratic Forms: A Literature Review Several works have been devoted to study quadratic forms and their ratios [13], [14],[18]–[42]. However, the approaches proposed are either restricted to special cases and/or provide approximations or complex solutions in the form of series expansion which limit their usefulness. Turin was the first to obtain the characteristic func- tion of Hermitian quadratic forms in complex Gaussian variates [30]. He also derived the value of the CDF at the origin for the special case of zero-mean Gaussian random variables [39]. Tziritas in [40] considered the distribution of positive definite quadratic forms in real and complex Gaussian variables. He provided necessary and sufficient conditions on when the quadratic form can be written as a sum of independent Gamma variables. His approach was to invert the expression for the characteristic function and the expressions he arrived at were almost always in the form of infinite series (for both the central and noncentral Gaussian random variables). The work of Reifler was restricted to the positive definite case only [25]. In [2], Mathai and Provost analyzed the specific scenario of zero- mean Gaussian random variables (central case). Similarly, the works presented in [18], [19], [34], [41] are limited to real Gaussian random variables only. In [5], [28], numerical integration is used to evaluate the distribution

Upload: others

Post on 21-Sep-2019

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

On the Distribution of Indefinite Quadratic Forms in Gaussian RandomVariables

T. Y. Al-Naffouri1,2, M. Moinuddin3,4, Nizar Ajeeb5, Babak Hassibi6, and Aris L. Moustakas7

1Electrical Engineering Department, King Fahd University of Petroleum and Minerals, Saudi Arabia2Electrical Engineering Department, King Abdullah University of Science and Technology, Saudi Arabia

3Electrical and Computer Engineering Department, King Abdulaziz University, Saudi Arabia4 Center of Excellence in Intelligent Engineering Systems (CEIES), King Abdulaziz University,Saudi Arabia

5Electrical and Computer Engineering Department, American University of Beirut, Beirut, Lebanon6Electrical Engineering Department, California Institute of Technology, California, U.S.A

7Physics Department, National Kapodistrian University of Athens, Greece

Abstract—In this work, we propose a unified approach toevaluating the CDF and PDF of indefinite quadratic formsin Gaussian random variables. Such a quantity appearsin many applications in communications, signal processing,information theory, and adaptive filtering. For example, thisquantity appears in the mean-square-error (MSE) analysisof the normalized least-mean-square (NLMS) adaptive algo-rithm, and SINR associated with each beam in beam form-ing applications. The trick of the proposed approach is toreplace inequalities that appear in the CDF calculation withunit step functions and to use complex integral representa-tion of the the unit step function. Complex integration allowsus then to evaluate the CDF in closed form for the zero meancase and as a single dimensional integral for the non-zeromean case. Utilizing the saddle point technique allows us toclosely approximate such integrals in non zero mean case.We demonstrate how our approach can be extended to otherscenarios such as the joint distribution of quadratic formsand ratios of such forms, and to characterize quadraticforms in isotropic distributed random variables. We alsoevaluate the outage probability in multiuser beamformingusing our approach to provide an application of indefiniteforms in communications.

Key Words: wireless communications, Correlated Gaus-sian random vectors, multi-user diversity, weighted normsof Gaussian variables.

I. INTRODUCTION

Gaussian random variables (r.v.’s) play a very importantrole in signal processing, communications, and informa-tion theory [1]. One reason why Gaussian r.v.’s are soubiquitous is the central limit theorem which states thatunder conditions often reasonable in applications, theprobability density function (PDF) of the sum of inde-pendent random variables approaches that of a Gaussianrandom variable.

It is very important to find the distributions of variousquantities involving Gaussian random variables, mostnotably sums of squares of Gaussian random variables(quadratic forms) and ratios of such norms. The quadraticforms in Gaussian random variables [2], [3] appear inmany applications in communications, signal processing,

and statistics. Some of these applications include non-coherent detection [4], [5], [6], performance analysis ofwireless relay networks [7], [8], cooperative diversity inwireless networks [9], diversity combining in communi-cation systems [10], [11], array processing and randombeam forming [12], estimation of power spectra [13],X 2 test, analysis of variance [3], probability content ofregions under spherical normal distributions [14], andperformance analysis of the adaptive filtering algorithms[15], [16], [17]. Table I lists specific applications ofindefinite quadratic forms in the field of communications.

A. Characterizing the Behavior of Quadratic Forms: ALiterature Review

Several works have been devoted to study quadraticforms and their ratios [13], [14],[18]–[42]. However, theapproaches proposed are either restricted to special casesand/or provide approximations or complex solutions inthe form of series expansion which limit their usefulness.

Turin was the first to obtain the characteristic func-tion of Hermitian quadratic forms in complex Gaussianvariates [30]. He also derived the value of the CDF at theorigin for the special case of zero-mean Gaussian randomvariables [39]. Tziritas in [40] considered the distributionof positive definite quadratic forms in real and complexGaussian variables. He provided necessary and sufficientconditions on when the quadratic form can be written as asum of independent Gamma variables. His approach wasto invert the expression for the characteristic function andthe expressions he arrived at were almost always in theform of infinite series (for both the central and noncentralGaussian random variables). The work of Reifler wasrestricted to the positive definite case only [25]. In [2],Mathai and Provost analyzed the specific scenario of zero-mean Gaussian random variables (central case). Similarly,the works presented in [18], [19], [34], [41] are limitedto real Gaussian random variables only. In [5], [28],numerical integration is used to evaluate the distribution

Page 2: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

of an indefinite quadratic form resulting in approximatesolutions. In [38], Raphaeli considered the distribution ofspecial indefinite quadratic forms and computed the re-sulting CDF as an infinite series of Laguerre polynomials.The series obtained however are difficult to manipulateto find the PDF or moments. Also, it is not clear howRaphaeli’s method can be used to treat the real caseand how it simplifies in the central case. Shah and Liused the result of [42] to evaluate the distribution ofquadratic forms in Gaussian mixtures. Biyari and Lindseyconsidered a specific indefinite quadratic form and usedthe characteristic function approach to obtain expressionsfor the PDF and CDF [26]. Just like the earlier methods,the series expansions obtained are difficult to manipulate.More recently, Simon and Alouini [43] considered theCDF of the difference of two independent chi-squarerandom variables and obtained a closed form expressionfor the value of the CDF at its zero argument. They usedtheir derivation to evaluate the PDF of a ratio of twosuch variables. In a related extension, Holm and Alouinievaluated the sum and difference of two correlated Nak-agami variate in terms of the McKay distribution andthen used that to evaluate the CDF of the ratio of suchvariables [44]. Some recent works on MIMO systemsinclude the capacity evaluation of spatially correlatedMIMO Rayleigh fading channels by Chiani et al. [45] andthe derivation of eigenvalue density of correlated randomWishart matrices by Simon and Moustakas [46].

B. Drawbacks of Past Approaches

There are several drawbacks of the approaches high-lighted above as we summarize below.

1) The approaches above are not unified in nature1.Various techniques are used to treat special cases(complex Gaussian, real Gaussian, central variables,noncentral variables, definite/indefinite forms, ra-tios of quadratic forms, .... etc).

2) These approaches almost always end up with seriesexpansions whose coefficients are difficult to eval-uate. The expansions in turn are difficult to manip-ulate further to obtain the corresponding momentsor CDF’s [38].

3) They focus on obtaining the PDF from the charac-teristic function whereas the CDF is a more usefulexpression. The reason is that the CDF (just like thePDF) can be used to obtain the moments (throughintegration by parts). Moreover, the CDF directlygives an expression for the probability (whereasthe PDF needs to be integrated to obtain thisinformation).

1There are other works (including the works of [26], [28], [29]) whichalso result in a single integral expression and thus provide unification insome sense. But their usefulness is limited as they provide approximatesolutions and/or treat special cases.

4) The proposed methods are not generalized to othercases, e.g. to obtain the joint CDF or joint PDF oftwo or more quadratic forms.

C. Our Approach

In this work, we aim to study the distribution of var-ious quantities involving weighted norms of a correlatedGaussian vector and show how to find the distributionof these quantities using complex integration. Our aimis to provide a consistent and unified way to approachthe distribution of quadratic Gaussian forms by takingadvantage of its quadratic structure. More specifically, theapproach is unified in the following sense:

1) We transform the inequality that define the CDFinto a step function that we represent using itsFourier Transform

2) This makes the CDF expression into an indefiniteM+x dimensional integral where M is the numberof Gaussian variables and x is the number of stepfunctions employed (x=1 for a single CDF, x = 2for a joint CDF, ... etc)

3) This applies for the distribution of any quantity(or joint distribution of a number of quantities). Inother words, this quantity need not to be a quadraticform... it could be any other form.

4) What restrict the form we use is our ability tocalculate the indefinite (M -dimensional) integral. Inthe Gaussian and the isotropic cases, the quadraticform are very relevant to many applications andfortunately lend themselves to the evaluation of theM -dimensional integral

5) Once the M -dimensional integral is evaluated, itremains to evaluate the remaining x-dimensionalintegral(s) (that resulted from the step function(s)).

This with the aid of complex integration allows us torepresent the CDF in closed form or at least as a singledefinite integral. In the latter case, we make use of saddlepoint approximation technique to evaluate such integralswhich is a well known technique for approximatingintegrals and has been used in numerous works before[47], [48], [49]. As we stress above, the unification ismore general than just evaluating this one dimensionalintegral or not. Specifically, we treat all the followingcases using the same methodology described above:

1) General indefinite quadratic form (real, complex,zero mean, non-zero mean, ratios of quadraticforms)

2) Joint distribution of indefinite quadratic forms3) Other non-Gaussian variables, for example, indef-

inite quadratic forms in isotropically distributedvariables.

4) Alternative proof of Craigs formula for Q function.The paper is organized as follows. Following this intro-duction, the problem is set up in Section II. In Section III,the distribution of indefinite quadratic form in central

Page 3: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

variables is derived. The non-central quadratic form isinvestigated in Section V while the real quadratic formis treated in Section VI. Section VII demonstrates howwe can extend our technique beyond quadratic forms ofGaussian variables. Section VIII provides the evaluationof outage probability in multiuser beamforming as anapplication of indefinite forms in communications. Sim-ulation results are presented in section IX to investigatethe performance of the derived analytical model. Finally,concluding remarks are given in Section X.

II. PROBLEM FORMULATION

In this paper, we consider quadratic forms2 defined by

Ync = ‖h + b‖2A (1)

where A is a Hermitian matrix of size M , b is a constantM × 1 vector, and h is a white circularly symmetricGaussian vector, i.e., h ∼ N (0, I), where 0 is an M × 1vector of all zeros and I is the identity matrix of size M .We are interested in finding the CDF of this variable. Thefollowing points are in order.

1) Without loss of generality, we assume that h iswhite. To see why this is the case, let hw ∼ N (0, I)be the whitened version of h ∼ N (0,R), i.e., hwand h are related by3 hw = R

H2 h. Then

‖h+b‖2A = (hHwRH2 +bH)A(R

12 hw+b) = ‖hw+ b‖2

A(2)

where b = R12 b and A = R

H2 AR

12 are the new

mean vector and new weight matrix, respectively.2) In most of our analysis, we will assume h to have

zero mean, that is, we will focus on the centralquadratic form

Yc = ‖h‖2A (3)

where h ∼ CN (0, I). When the mean is notzero, we can equivalently consider the (noncentral)quadratic form defined in (1).

3) The Hermitian quadratic form (1) is a special caseof the real quadratic form

Yr = ‖hr‖2Ar

∆= hTr Arhr (4)

where hr is a real Gaussian vector N (0, I), Ar isa symmetric matrix, and the notation ()T denotestransposition. We will show in Subsection VI howto deal with the distribution Of such forms.

4) We also apply our technique to scenarios beyondquadratic forms of Gaussian random variables.Specifically, we treata) Ratios (divisions) of quadratic forms:

Yd =εb + ‖h‖2Bεa + ‖h‖2A

(5)

2For any matrix A, the quadratic form ||x||2A is defined as ||x||2A4=

xHAx where the notation ()H denotes conjugate transposition.3The representation R

H2 is a short notation for (R

12 )H

b) Joint distributions of quadratic forms

Pr{‖h‖2A ≤ xa, ‖h‖2B ≤ xb

}, (6)

c) Quadratic forms in isotropically distributed ran-dom vectors

Yi = ‖φ‖2A and (7)

d) Alternative Proof of Craig’s Formula for Qfunction which is given by [50]

Q(x) =1

π

∫ π2

0

e−x2

2 sin θ dθ (8)

III. THE DISTRIBUTION OF AN INDEFINITEHERMITIAN QUADRATIC FORM

Consider the random Hermitian quadratic form definedin (1). The CDF of Ync is defined by

FYnc(y) = P {Ync ≤ y} =

∫Ap(h)dh (9)

where p(h) is the PDF of h and A is area in the Mmultidimensional complex plane defined by the inequality

‖h + b‖2A ≤ y (10)

Such an integral would in general be very difficult toevaluate. An alternative way to do so is to express theinequality that appears in (10) as

y − ‖h + b‖2A ≥ 0 (11)

So, the CDF takes the formFYnc(y) =

∫ ∞−∞

p(h)u(y − ‖h + b‖2A)dh, (12)

where u(·) is the unit step function. Since we are dealingwith M -dimensional circular white Gaussian randomvectors, the PDF of h is given by

p(h) =1

πMe−||h||

2

, (13)

Thus, the CDF can be set up as

FYnc(y) =1

πM

∫ ∞−∞

e−||h||2

u(y − ‖h + b‖2A)dh

The above integration is performed over the entire hplane. Thus, the unit step function allowed us to goaround the constraint in limits of integration. However,it is still difficult to deal with the unit step that appearsinside the integral. To go around this, we replace the unitstep by its Fourier transform representation [51]

u(x) =1

∫ ∞−∞

ex(jω+β)

jω + βdω (14)

which is valid for any β > 0 (and is also independent ofthe value of β). It is worth pointing out here, the com-plementary CDF (CCDF) can also be expressed directlyusing the Fourier representation of the complementarystep function 1-u(x) as follows

1− u(x) = − 1

∫ ∞−∞

ejω−β

jω − βdω (15)

Page 4: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

again for β > 0. We see that, in contrast to (14) the polehere lies in the lower complex plane, and this will haverepercussions in the evaluation of the asymptotic form ofthe CCDF below.

Thus, the representation (14) yields the the followingM + 1 dimensional integral

FYnc (y) =1

2πM+1

∞∫ ∫−∞

e−(‖h‖2+‖h+b‖2(jω+β)A)

dhey(jω+β)

jω + βdω

(16)Let A = QΛQH denote the eigenvalue decomposition

of A, then the inner integral in the above can be writtenequivalently as∫

e−(‖h‖2+‖h+b‖2(jω+β)A)

dh =

∫e−(‖h‖2+‖h+b‖2(jω+β)Λ)

dh

(17)where b = QHb and h = QHh and we have used the

fact that dh = dh. Now, by completing the squares, wecan write the sum of (weighted) norms that appear aboveas a single (noncentral) quadratic form

‖h‖2 + ‖h + b‖2(jω+β)Λ = ‖h + b‖2B + c(ω)

where b = (I +1

jω + βΛ−1)−1b (18)

B = I + (jω + β)Λ (19)

c(ω) = bH(I +1

jω + βΛ−1)−1b (20)

which allows us to rewrite (16) as

FYnc (y) =1

2πM+1

∞∫ ∫−∞

e−‖h+b‖2Bdhey(jω+β)−c(ω)

(jω + β)dω (21)

The inner integral looks like the area under a GaussianPDF with mean b and covariance B−1. In spite of thefact that b and B are complex, we show in Appendix Athat

1

πM

∫ ∞−∞

e−(h+b)HB(h+b)dh =1

|B|=

1

|I + Λ(jω + β)|(22)

as expected from a Gaussian PDF. This allows us to setup the CDF of Ync as

FYnc(y) =1

∫ ∞−∞

1

|I + (jω + β)Λ|ey(jω+β)

(jω + β)e−c(ω)dω

(23)which reduces the M + 1 dimensional integral into a 1-dimensional problem in the variable jω+β. At this stageof the derivation, we will distinguish between two cases

1. the central (zero mean) case where b is set to a zerovector (treated in the following section).

2. the non-central (non-zero mean) case (treated inSection V).

IV. DISTRIBUTION OF CENTRAL QUADRATIC FORM

In the central quadratic form, the mean vector band consequently the vector b is a zero vector whichcorresponds to the central quadratic form defined in (3)

(as a result Ync is transformed into Yc defined in (3)).Thus, the term c(ω) defined in (20) becomes zero whichreduces the CDF of Yc to

FYc(y) =1

∫ ∞−∞

1

|I + (jω + β)Λ|ey(jω+β)

(jω + β)dω (24)

To evaluate this integral, we need to first expand thefraction that appears in (24) in a partial fraction expan-sion. With this in mind, assume that A has exactly Ldistinct eigenvalues λ1, . . . , λL where λl has multiplicityml. Then the fraction in (24) can be expanded as

1

(jω + β)∏Mi=1 (1 + λi(jω + β))

=1

(jω + β)+

L∑l=1

ml∑k=1

αk,l(1 + λl(jω + β))k

(25)

Now, by employing residue theory, we can show that [52]

1

∫ ∞−∞

e+jωp

(a+ jω)νdω =

pν−1

Γ(ν)e−apu(p) for a > 0

− (−p)ν−1

Γ(ν)e−apu(−p) for a < 0

(26)

=signν(a)

Γ(ν)(p)ν−1e−apu(ap) (27)

We can use the above results to evaluate the integrals in(24). Specifically, we have

1

∫ ∞−∞

ey(jω+β)

jω + βdω = eβye−βyu(y) = u(y) (28)

and

1

∫ ∞−∞

ey(jω+β)

(1 + λl(jω + β))kdω

=eyβ

λkl

1

∫ ∞−∞

eyjω

(β + 1λl

+ jω)k=e− yλl u

(yλl

)Γ(k)|λl|k

yk−1(29)

where in arriving at (29), we used the fact that β ischosen such that β+ 1

λl> 0 and hence sign

(β + 1

λl

)=

sign (λl). Note that both integrals in (28) and (29) areindependent of β as they should. This allows us to writethe CDF FYc(y) in the following closed form

FYc(y;λ,m) = u(y)+

L∑l=1

ml∑k=1

αk,lΓ(k)|λl|k

yk−1e− yλl u

(y

λl

)(30)

where λ = [λ1, . . . , λL] is the vector of eigenvalues andm = [m1,m2, · · · ,mL] is the corresponding multiplicityvector (the dependence on λ and/or m can be droppedif this dependence is understood).

To get more insight, let’s consider the special casewhen no eigenvalue of A is repeated, i.e., ml = 1, ∀ land L = M (and we can thus write m = 1, where 1 isthe vector with all entries equal to 1). In this case, thepartial fraction expansion takes the form

1

(jω + β)∏Ml=1(1 + λl(jω + β))

=1

jω + β+

M∑l=1

αl

1 + λl(jω + β)

(31)

Page 5: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

where αl = −λl∏Mi=1,i 6=l(1−

λiλl

). Upon carrying out the

integration using (26), we finally arrive at

FYc(y) = u(y)−M∑l=1

λMl∏Mi=1,i6=l(λl − λi)

1

|λl|e− yλl u

(y

λl

)(32)

RemarkBy differentiating (24), we get an integral representationfor the PDF of y, denoted by fYc(y), and it is given by

fYc(y) =1

∫ ∞−∞

1∏Ml=1 (1 + λl(jω + β))

ey(jω+β)dω (33)

which can be solved using the same approach describedfor the CDF. For the special case when no eigenvalue isrepeated, it can be shown that

fYc(y) =

M∑l=1

λM−1l∏M

i=1,i6=l(λl − λi)1

|λl|e− yλl u

(y

λl

)(34)

V. NON-CENTRAL QUADRATIC FORMS

In this section, we deal with the non-central case forwhich b in (1) is non-zero. In this case, the term c in(20) is non-zero and is rather a function of the integrationvariable ω. Equivalently, we would like to consider thenon-central quadratic form Ync defined in (1). For thiscase, the CDF of Ync is given in (23) as 1-D integralwhich can not be put in closed form. Therefore, wepropose to directly approximate the integral in (23) usingthe saddle point (SP) technique [53] which is a wellknown technique for approximating integrals and hasbeen used in numerous works before [47], [48], [49], [54],[55], [56]. The SP method has not seen widespread usein communication research, but only in specific cases,such as in the context of MIMO mutual informationcalculations [57], [58] or in error probability analysis[54]. To apply SP method, we seek to approximate theCDF, FYnC (y), as follows

FYnc (y) =1

∫ey(jω+β)e−c(ω)

(jω + β)|I + (jω + β)Λ|dw

=1

∫es(ω) dω (35)

where

s(ω) = ln

[ey(jω+β)e−c(ω)

(jω + β)|I + (jω + β)Λ|

]and

c(ω) =M∑i=1

|bi|2 −M∑i=1

|bi|2

1 + (jω + β)λi(36)

The position of the poles of the integrand in (35) arelocated at jβ and j(β+λi) and the path of integration isparallel to the real line and between β and −j∞. WhenΛ has negative eigenvalues, then the path is between jβand j(β+λm), where λm is the minimum norm negativeeigenvalue of Λ. For simplicity in the sequel we only dealwith the case where all λi > 0. The idea behind the saddlepoint analysis is to deform the path, without crossing anypoles, so that it crosses the real axis through a point, withs′(ω) = 0. Then it is known that the integral close to thatpoint will dominate the whole integral in the large Mlimit [53]. Thus, we differentiate s(ω) by rewriting s(ω)

as − ln (jω + β)−M∑i=1

ln [(1 + λi(jω + β))]+y(jω+β)−c(ω) to

obtain

s′(ω) =

−j(jω + β)

−M∑i=1

jλi

1 + λi(jω + β)+jy+

M∑i=1

[|bi|2 (−λij)

](1 + λi(jω + β))2

(37)Thus, s

′(jω) is found to be

s′(jω) =

−j(−ω + β)

−M∑i=1

jλi

1 + λi(−ω + β)+jy−

M∑i=1

j|bi|2λi(1 + λi(−ω + β))2

(38)where ω = j(β + p). Thus, we solve for p such thatp ∈ (−∞, 0) by setting s

′(jω) to zero as

−1

(−ω + β)−M∑i=1

λi

1 + λi(−ω + β)+y−

M∑i=1

|bi|2λi(1 + λi(−ω + β))2

= 0

(39)Equation (39) has a single real solution in the regionp ∈ (−∞, 0) (which we denote as ω0 such that ω0 =j(β + p0)) irrespective of the values of λi and for anyvalue of y (see Appendix B for a formal proof). Now, toapply the saddle point technique, we approximate s(ω)as

s(ω) ≈ s(ω0) + (ω − ω0)s′(ω0) +

(ω − ω0)2

2s′′

(ω0), (40)

Thus, we can approximate the integration in (35) as

FYnc (y) ≈1

∫es(ω0)+s

′(ω0)(ω−ω0)+

s′′

(ω0)2

(ω−ω0)2 dω

=1

2πes(ω0)

∫es′′

(ω0)2

(ω−ω0)2 dω

=1

2πes(ω0)

√2π

|s′′ (ω0)|, (41)

There are a few comments in order here. First, the higherorder terms in the expansion of s around the saddle pointcan be treated performatively, and provide corrections toleading order O(1/M). Hence, in the large M limit, theabove result becomes exact.

Second, the above calculations provide an accurateanalysis of the asymptotic behavior for the CDF. Toanalyze the CCDF it is more accurate to work directlywith the Fourier expression for 1 − u(y) given in (15)4 The analysis can then be go on as above with theonly difference being that 1/(jω + β) is replaced by1/(−jω + β) and in all other terms β → −β. Inaddition, now the saddle point solution is sought forω ∈ j(β, β+λmin), where λmin is the minimum positiveeigenvalue of Λ.

Third, the asymptotic evaluation of the PDF is muchsimpler, because of the absence of the term 1/(jω + β).In this case one seeks a solution between ω − jβ ∈(−j∞, jλmin) (or ω−jβ ∈ (jλm, λmin) in the presenceof negative eigenvalues.)

Finally, the saddle point solution provides a robustsolution even for cases where a closed form expressionfor F (y) exists when M is not small. This is so, because

4Alternatively one can deform the integration contour to go abovethe pole at ω = jβ above.

Page 6: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

as seen in (32) its calculation entails the summation of alarge number (M ) of terms with alternating sign whichbecomes problematic when one needs to obtain the tails ofthe distribution. Simulations show very good agreementwith the above analysis both for the CDF and CCDF andare reported in Section IX.

VI. THE REAL QUADRATIC FORM

In this section we address the case of real quadraticform (Yr) where h is a real Gaussian random vector andA is a symmetric matrix of size M . Proceeding as beforeand using the inverse Fourier Transform of the unit step,we set up the CDF for real case as

FYr (y) =1√

(2π)M

∫ ∞−∞

e−‖h‖2u(y − ‖h‖2A)dh

=1

(2π)M2

+1

∞∫ ∫−∞

e−(‖h‖2+‖h‖2(jω+β)Λ)

dhey(jω+β)

jω + βdω(42)

where we have used the eigenvalue decomposition of Aby defining A = QΛQT and using h = QTh. Now,the inner integral in the above is nothing but the areaunder a real Gaussian PDF with zero mean and covariance(I + Λ(jω + β))

−1. Thus, using the Gaussian PDF forthe real case, we can show that

FYr (y) =1

∫ ∞−∞

ey(jω+β)

jω + β

1√| (I + Λ (jω + β)) |

(43)The above integral representing the CDF of the realquadratic form has no closed form and the method ofpartial fraction is not applicable due to presence of theroot in its expression. To approximate the CDF of the realquadratic form expressed by the above integral, we willagain utilize the technique of the saddle point. We startby expressing the CDf as

FYr (y) =1

∫ ∞−∞

1√| (I + Λ (jω + β)) |

ey(jω+β)

jw + βdω

=1

∫es(ω) dω (44)

where

s(ω) = ln

[1√

| (I + A (jω + β)) |ey(jω+β)

jω + β

]

= −1

2

M∑i=1

ln [1 + λi(jw + β)] + y(jw + β)− ln (jw + β)(45)

Again employing the approximation for s(ω) given in(40) with a solution ω0 to achieve5

FYr (y) ≈1

∫es(ω0)+s

′(ω0)(ω−ω0)+

s′′

(ω0)2

(ω−ω0)2 dw

=1

2πes(ω0)

√2π

|s′′ (ω0)|(46)

5Note that one can prove the existence of such ω0 using the sameargument utilized for the general Hermitian case.

VII. BEYOND QUADRATIC FORMS OF GAUSSIANVARIABLES

The technique we pursued in the last sections can beapplied beyond quadratic forms of Gaussian random vari-ables. In this section, we demonstrate how our approachcan be extended to a non-Gaussian variables. Specifically,we show how it can be used to characterize the 1) ratios ofquadratic forms, 2) joint distributions of quadratic forms,3) quadratic forms in isotropically distributed randomvectors, and 4) alternative formulation of the Q functiongiven by Craig [50].

A. Distribution of a ratio of Quadratic Forms

There are many applications involving quadratic formsthat are encountered in signal processing and communi-cations. For example, the SINR in random beam formingdeveloped in [12] and moments for analyzing the behav-ior of ε-NLMS algorithm [16], [17] appear as ratio ofquadratic forms.

Let’s apply the technique developed above to derivethe CDF of such a ratio defined as

Yd =ε1 + ‖h‖2B1

ε2 + ‖h‖2B2

(47)

where B1 and B2 are Hermitian matrices with B2 ≥0. Our approach can be easily employed to evalu-ate the CDF of such ratios. Note that the probabil-

ity Pr

{ε1+‖h‖2B1

ε2+‖h‖2B2

≤ x}

can be equivalently written as

Pr {‖h‖B1−xB2≤ ε2x− ε1}. Hence, by employing the

expression of (32), we can immediately write

FX(x) = u(ε2x−ε1)−M∑l=1

λMl (x)e− ε2x−ε1

λl

|λl(x)|∏i=1,i 6=l(λl(x)− λi(x))

u

(ε2x− ε1

λl

)(48)

Here λi(x) (i = 1, . . . ,M) are the eigenvalues of B1 −xB2 and hence are functions of6 x.B. Joint Distributions of Hermitian Quadratic Forms

In this section, we show how we can use the approachpresented in previous sections to find the joint distributionof several quadratic forms. We demonstrate it here fortwo quadratic forms, although the insights can be easilyextended to a larger number of quadratic forms. Let’sconsider the joint CDF of the quadratic forms ‖h‖2A ≤ y1

and ‖h‖2B ≤ y2,

FYc1 ,Yc2 (y1, y2) = Pr{‖h‖2A ≤ y1, ‖h‖2B ≤ y2

}(49)

Such a joint CDF appears when one considers the jointdistribution of SINRs. For example, in [59], the per-formance of random beamforming in MIMO broadcastchannels is studied by evaluating the joint probability

6The expression (48) is valid assuming that the eigenvalues ofB1 − xB2 are distinct for each x. If not, one needs to take care ofmultiplicities for those values of x for which the eigenvalues λi(x) arerepeated.

Page 7: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

of two such SINRs. Thus, we demonstrate that how ourapproach can be extended to joint distribution case. Byemploying the approach presented in Section III, we canwrite the joint CDF in (49) asFYc1 ,Yc2 (y1, y2) =

1

4πM+2

∞∫ ∫ ∫−∞

e−‖h‖2Cdh

ey1(jω1+β1)

(jω1 + β1)dω1

ey2(jω2+β2)

(jω2 + β2)dω2

where

C = I + (jω1 + β1)A + (jω2 + β2)B (50)

Just as we did before, we can formally think of in-ner integral in the above as an integral of GaussianPDF with covariance C−1. This allows us to integratethe h-dependent part of the integral and we can writeFYc1 ,Yc2 (y1, y2) as

FYc1 ,Yc2 (y1, y2) =

1

4π2

∫ ∫1

|(I + (jω1 + β1)A + (jω2 + β2)B)|×

ey1(jω1+β1)

(jω1 + β1)dω1

ey2(jω2+β2)

(jω2 + β2)dω2 (51)

In general, we can not evaluate this integral in closed formunless A and B are diagonal (or jointly diagonalizable byan orthonormal transformation). Under this assumption,the determinant in (51) can be easily expanded and thejoint CDF takes the form

FYc1 ,Yc2 (y1, y2) =

1

4π2

∫ ∫1∏M

i=1(1 + (jω1 + β1)ai + (jω2 + β2)bi)×

ey1(jω1+β1)

(jω1 + β1)dω1

ey2(jω2+β2)

(jω2 + β2)dω2 (52)

where ai and bi are the eigenvalues of the matrices Aand B, respectively. Now it is straightforward to evaluatethis double integral. We consider the fraction that appearsin (52) as a function of jω1 + β1 and expand it in apartial fraction expansion. This results in M + 1 terms(assuming that that non of the terms are repeated). Eachof these terms can be integrated with respect to ω1 toproduce M + 1 terms that are in turn partial fractions injω2 + β2. The same process is now repeated for the ω2

variable, arriving finally at a closed form expression forthe CDF.RemarkAny two Hermitian matrices are jointly diagonalizablebut not necessarily with an orthonormal transformation.In that case, we can show that we can integrate (52) withrespect to one of the ω’s in (52) but not necessarily withrespect to the second one. When the transformation isorthonormal, (52) can be expressed in closed form asexplained above. In the non central case, the saddle pointanalysis can hold here as well, where now one needs tolook for a saddle point for two variables ω1 and ω2.

C. Indefinite Quadratic Forms in Isotropic Random Vec-tors

Isotropic vectors and matrices play an important rolein the understanding the behavior of a communicationsystem and characterizing its limits. For example thecapacity achieving signal in a multiple antenna link (withno channel information at the transmitter and receiver)is the product of an isotropic matrix with an indepen-dent diagonal real matrix [60]. Similarly, in a point-to-multipoint broadcast scenario, isotropic vectors are usedas beams that carry the signal information and achieveoptimal capacity in the large number of users regime [12].In this section, we demonstrate how our approach can beused to characterize the distribution of quadratic formsin isotropic random variables. An isotropically randomunitary matrix Φ is a matrix with orthogonal columnsand whose distribution is invariant to a pre-multiplicationby a unitary matrix [60], i.e., p(Φ) = p(UΦ). A columnof Φ, φ is called an isotropic vector and has the followingmarginal PDF

p(φ) =Γ(M)

πMδ(1− ‖φ‖2) (53)

In this section, we characterize the CDF of a weightednorm of an isotropic vector given by

Yi = ‖φ‖2A (54)

where A is a Hermitian matrix. To evaluate the probabil-ity P{Yi ≤ y}, we can use equivalent representation forinequality Yi ≤ y as y − ‖φ‖2A ≥ 0. Thus, the CDF ofYi can be set up as

FYi(y) =

∫p(φ)u(y − ‖φ‖2A)dφ

=Γ(M)

πM

∫δ(1− ‖φ‖2)u(y − ‖φ‖2A)dφ (55)

Now, we employ the integral representation of the stepfunction (14) and a similar representation of delta func-tion [60]

δ(x) =1

∫ ∞−∞

ex(α+jω)dω (56)

to obtain7

FYi(y) =Γ(M)

4πM+2eα∫ ∫ ∫

e−φH

(αI+A(jω1+β)−jω2I)φdφ

×e−jω2dω2e(jω1+β)y

(jω1 + β)dω1 (57)

By inspecting the inner integral, we note that it is sim-ilar to the Gaussian density integral which allow us tosimplify FYi(y) as

FYi (y) =

Γ(M)eα

4πM+2

∫ ∫e−jω2e(jω1+β)ydω2dω1

|αI + A(jω1 + β)− jω2I|(jω1 + β)(58)

7The representation of delta function is valid for any α > 0.

Page 8: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

The determinant in (58) can be expressed in terms of theeigenvalues of A and expanded using partial fraction as8

1∏Mi=1 (α+ λi(jω1 + β)− jω2)

=1

(jω1 + β)M−1

M∑i=1

ηi(α+ λi(jω1 + β)− jω2)

(59)

where ηi = 1∏k 6=i(λk−λi)

. We now use residue theory toevaluate the integral with respect to ω2 as

1

∫dω2

e−jω2

det (αI + (jω1 + β)A− jω2I)

=

M∑i=1

ηie−α−λi(jω1+β) (60)

where α is chosen such that α + λi > 0. We can thuswrite

FYi(y) =Γ(M)

∫ ∞−∞

M∑i=1

ηie−λi(jω1+β) e(jω1+β)y

(jω1 + β)Mdω1

(61)Note that the CDF is now independent of the constantα as it should. Using residue theory again, we can showthat

FYi(y) =

M∑i=1

ηi(y − λi)M−1u(y − λi) (62)

RemarkJust as in the Gaussian case, the same approach couldbe used to characterize the CDF of joint distribution ofquadratic forms in isotropic random variables and theratios of such forms.

D. Alternative Proof of Craig’s Formula for Q function

In this section, we use the approach outlined in thispaper to provide an alternative proof for the Craig’sformula for the Q function [50] which is given in Equ.(8). This formulation is convenient because the argumentof Q appears in the integrand as opposed to beingpart of the integration limits. These formulations werethen used by Alouini and Simon in [61] to present aunified performance analysis of digital communicationsover generalized fading channels. In the following, weshow how to derive these representations in a naturalmanner. The 1-dimensional Q function is the probabilitythat the real Gaussian variable Y ∼ N (0, 1) satisfies

Q(x) = P{y > x}Using the unit step function, this can be written as

Q(x) =1

∫ ∞−∞

dωe(y−x)(jω+β)

jω + β

1√

∫ ∞−∞

e−y2

2 dy

8If the λi’s are not all distinct, we can proceed as we did inSection IV.

or upon completing the squares,

Q(x) =1

∫ ∞−∞

dωe−x(jω+β)

jω + β

1√

2πe

12

(jω+β)2

×∫ ∞−∞

e−12

(y2−2y(jω+β)+(jω+β)2)dy

and by realizing that the inner integral sums out to unity(the integral is the area under the Gaussian PDF with“mean” jω + β and variance 1)

Q(x) =1

∫ ∞−∞

e−x(jω+β)+ 12

(jω+β)2

jω + βdω

Now introduce the change of variables ω = β tan θ, thendω = β(1 + tan2 θ) and Q(x) becomes

Q(x) =1

∫ π2

−π2

e−β(1+j tan θ)x+ 12β2(1+j tan θ)2 (1− j tan θ)dθ

=1

∫ π2

−π2

e(−βx+ 12β2− 1

2β2 tan2 θ)+j(−βx tan θ+β2 tan θ)(1− j tan θ)dθ

Now assume that x > 0 and set beta = x > 0. Then

Q(x) =1

∫ π2

−π2e−

x2

2 (1+tan2 θ)(1− j tan θ)dθ

The imaginary part is odd and hence integrates to zerowhile the even part can be simplified to

Q(x) =1

π

∫ π2

0

e−x2

2 sin θ dθ

Contrast this approach with the original approach of Craigin [50] which requires the use of polar transformation.Our approach achieved the same result by a simple andelegant way. The same method can actually be used torederive Craigs formulas for Q2 and Q3 in contrast to[50], [61], [62] which each had to use different method toderive alternative formulas for Qi(i = 1, 2, 3). However,due to the lack of space, we limit the derivation here tothe Q-function.

VIII. OUTAGE PROBABILITY IN MULTIUSERBEAMFORMING FOR CORRELATED LOS CHANNELS

In this section, we show how to use our approachto deal with the evaluation of outage probability inmultiuser beamforming for correlated LOS channels. Inthis context, consider a multi-antenna Gaussian broadcastchannel with one transmitter (base station) equipped withM antennas and K users (receivers) each equipped withone antenna. The transmitter chooses M orthonormalbeam vectors φm (each of size M ×1). These beams arethen used to transmit the symbols s1(t), s2(t), · · · , sM (t)by constructing the M × 1 transmitted vector s(t) =∑Mm=1 φm(t)sm(t). The received signal ri at the ith

receiver is given by

ri(t) =√Pih

Hi (t)s(t) + vi(t) (63)

where Pi is the received SNR at the ith receiver, hi(t)is the M × 1 channel vector associated between the base

Page 9: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

station and the ith receiver such that hi(t) is distributedas CN (b,R). The term vi(t) represents additive com-plex Gaussian noise with zero mean and unit variance,that is, vi ∼ CN (0, 1). Since, transmitted symbols siare independently and identically distributed to differentusers, we have E[ssH ] = 1

M I and Pi = P,∀ i. Afterincorporating expression for s(t) in (63) and droppingthe time index t for simplicity, we can set up the receivedsignal as ri =

√P∑Mm=1 hHi φmsm+vi. Thus, the SINR

associated with the mth beam at the ith receiver is givenby

SINRi,m =|hHi φm|2

MP +

∑Mk=1,k 6=m |hHi φk|2

(64)

which can be reformulated in indefinite quadratic form as

SINRi,m =||hi||2φmφHm

MP + ||hi||2ΦΦH−φmφHm

=||hi||2φmφHm

MP + ||hi||2I−φmφHm

(65)where Φ = [φ1,φ2, · · · ,φM ] is an M ×M matrix andΦΦH = I as the beam vectors are orthonormal. Our aimis to derive the probability of outage that the SINRi,m isless than certain threshold ξ, that is, Pr(SINRi,m < ξ).For that, we have investigated the scenario of zero meancase9, that is, when the channel vector has zero meanvector, that is, b = 0.

To proceed further, we formulate the Pr(SINRi,m < ξ)using the step function representation and the PDF of hias follows:

Pr(SINRi,m < ξ)

= Pr(M

Pξ + ||hi||2

ξI−(ξ+1)φmφHm> 0

)

=

∫ ∫e−||hi||2R−1−ξ(jω+β)I+(ξ+1)(jω+β)φmφHm e

MPξ(jω+β)dhi dω

2πM+1|R|(jω + β)

=1

2π|R|

∫(jω + β)−1e

MPξ(jω+β) dω

|R−1 − ξ(jω + β)I + (ξ + 1)(jω + β)φmφHm|(66)

The above integral can be solved using the approachgiven in Section IV. Thus, finally the probability ofoutage for zero mean case is found to be

Pr(SINRi,m < ξ) = 1− λM|R|

ΠM−1i=1

λiλMξ(λi − λM )

e−MP

ξλM

(67)where λi(i = 1, · · · ,M) are the eigenvalues of matrix Awhich is defined as

A = (1 + ξ)Λ1/2φmφHmΛ1/2 − ξΛ (68)

and φm = Uφm is the transformed version of φm withU as the eigenvector matrix obtained from the eigenvaluedecomposition of R−1, that is, R−1 = UHΛ−1U.

9The scenario of non-zero mean case be evaluated using the procedureoutlined in Section V

IX. SIMULATION RESULTS

In this section, simulation results are presented tovalidate our theoretical results10. The simulated resultsare obtained by averaging over 10000 independent exper-iments. Throughout the simulation, the random variablesYnc, Yc, Yr, Yd and Yi are obtained via correlatedcircular complex Gaussian vector h of length M = 4,where h is generated with the correlation matrix withentries Ri,j = α

|i−j|c with correlation factor11 αc (0 <

αc < 1). The aim of our simulations is to validate thederived analytical results. Specifically, the objectives ofour simulation experiments is to validate the analyticalexpressions for the following tasks

1) The CDF of central case (i.e., CDF of Yc) fordistinct and repeated eigenvalues,

2) To compare the CDF of Ync obtained via oursaddle point approach and the Raphaeli’s seriesapproximation [38],

3) The CDF of real case (i.e., CDF of Yr) using saddlepoint technique,

4) The CDF of ratio of indefinite quadratic forms (i.e.,CDF of Yd),

5) The CDF of indefinite quadratic form in isotropicrandom vector (i.e., CDF of Yi).

6) The Probability of outage in random beamforming(i.e., Pr(SINRi,m < ξ)).

2 4 6 8 10 12 14 16 1810

−4

10−3

10−2

10−1

100

y

1−F

Yc(y

)

Simulation for distinct eigenvalues, M=5 Analytical for distinct eigenvalues, M=5 Simulation for repeated eigenvalues, M=4, L=2Analytical for repeated eigenvalues, M=4, L=2

Fig. 1. The CCDF of Yc for distinct and repeated eigenvalues.

We have plotted the CCDF (i.e., 1-CDF) in order tohave better visualization of the results. In Fig. 1, theCCDF of central case (i.e., for Yc) with distinct andrepeated eigenvalues are plotted and compared with theirrespective simulation results. For the case of distincteigenvalue, We set M = 5 for the distinct eigenvaluecase and M = 5 with multiplicity L = 2 for the repeatedeigenvalue case. An excellent match between theory andsimulation can be observed from the reported results.

10All the MATLAB codes related to the simulations presented in thiswork are provided on the author

′s website.

11The case αc = 0 corresponds to the white case while αc = 1corresponds to the fully correlated case

Page 10: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

2 4 6 8 10 12 14 16 18 20 2210

−4

10−3

10−2

10−1

100

y

1−F

Ync

(y)

Analytical via Raphaeli Series for ||b||=0.6Simulations for ||b||=0.6Analytical via Saddle point approach for ||b||=0.6Analytical via Raphaeli Series for ||b||=0.3Simulations for ||b||=0.3Analytical via Saddle point approach for ||b||=0.3

Fig. 2. The CCDF of Ync with M = 4 for ‖b‖ = 0.3 and 0.6.

2 4 6 8 10 12 1410

−3

10−2

10−1

100

y

1−F

Yr(y

)

SimulationsOur approach

Fig. 3. The CCDF of Yr for M = 5

Next, in Fig. 2, we compare the CCDF of Ync obtainedvia our approach (using saddle point technique) with theone obtained using the Raphaeli’s series approximation[38] for two different values of mean vector b, thatis, for b = [.15 .15 .15 .15] (i.e. ‖b‖ equals to 0.3)and b = [.3 .3 .3 .3] (i.e. ‖b‖ equals to 0.6). It canbe easily seen that the Raphaeli’s series approximationworks well only for lower values of y but it gives verypoor estimate of the CCDF near tail especially for the

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.810

−4

10−3

10−2

10−1

100

y

1−F

Yd(y

)

SimulationsOur approach

Fig. 4. The CCDF of Yd for M = 5, ε1 = 1, ε2 = 0.01, B1 = B2 = I.

0.2 0.4 0.6 0.8 1 1.2 1.4 1.610

−3

10−2

10−1

100

y

1−F

Yi(y

)

SimulationsOur approach

Fig. 5. The CCDF of Yi for M = 5

0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55

−12

−10

−8

−6

−4

−2

0

ζ

Pr(

SIN

R <

ζ )

Simulation for Central caseAnalytical for Central caseSimulation for Non−central caseAnalytical for Non−central case

Fig. 6. Probability of outage for random beamforming (dB).

second case12. On the other hand, our approach is goodand consistent for both the cases. More importantly, ifwe contrast the computational complexity of the twoapproaches, our approach is much simpler as comparedto that of the Raphaeli’s approach as it requires multiplesummations including an infinite summation [38]. TheCCDF of the real quadratic form (Yr) is investigatedin Fig. 3 via saddle point approximation and again avery close match of analytical and simulation resultsis obtained. Next, the CCDF of a ratio of indefinitequadratic forms (Yd) and isotropic random vector (Yi) arecompared with the one via simulation in Fig. 4 and Fig. 5,respectively. Finally, the probability of outage in randombeamforming is compared via simulations for both zeromean and non-zero mean channel vector (with ‖b‖ = 2.5)in Fig. 6. In summary, an excellent match between theoryand simulation is observed for all the derived analyticalresults.

X. CONCLUSION

In this work, we provide a unified framework tocharacterize the statistical behavior (PDF and CDF)of quadratic forms in Gaussian random variables.

12In fact, the performance of the Raphaeli’s series further degradesfor larger ‖b‖ even by increasing the number of terms in the seriessummation.

Page 11: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

Our approach is unified in nature as it applies todefinite/indefinite forms in Gaussian random variables(real or complex, central and non-central). The mainidea is to replace the inequalities that defines the CDFin terms of unit step function and to represent the latterin terms of its Fourier transform. This allow us tointegrate the effect of the Gaussian variable, leaving uswith a one-dimensional integral that we can evaluatein closed form or approximate using the saddle pointtheorem. The saddle point approach can be directlyextended to cases where the correlation matrix itself oreven the mean vector b is random. We also show howour approach can be easily extended beyond quadraticforms such as ratios of quadratic forms, joint distributionof quadratic forms, and indefinite quadratic forms inisotropic random vectors. Simulation results support ourtheoretical developments.

APPENDIX A: Evaluation of Integral in Equ.

(21)By examining (21), we note that the inner integral lookslike a Gaussian integral. Intuition suggests that thisintegral can be written as

1

πM

∫ ∞−∞

e−(h+b)HB(h+b)dh=1∏M

i=1 (1 + λi(jω + β))

=1

|I + Λ(jω + β)|(69)

The above result can be verified easily. To see this,consider the integral in (69) which can be decomposedas

1

πM

∫ ∞−∞

e−(h+b)H(I+Λ(jω+β))(h+b)dh

=1

πM

M∏i=1

∫ ∞−∞

e−(1+βλi+λijω)|hi+bi|2dhi, (70)

where λi is the ith diagonal element in matrix Λ, hi is theith element in vector h, and bi is the ith element in vectorb. For each i, we can choose β such that 1 + βλi > 0.With this choice of β, it is easy to see that [52]

1

π

∫ ∞−∞

e−(1+βλi+λijω)|hi+bi|2dhi =1

1 + λi(jω + β)

Thus, by using the above, we finally arrive at the resultreported in (69).APPENDIX B: Proof for the existence of the solutionfor (39)To prove this, we define a function g(w) as

g(w) =1

(−ω + β)+

M∑i=1

1

µi + (−w + β)

+

M∑i=1

|bi|2µi[µi + (−w + β)]

2 (71)

where µi = 1λi

. Thus, it suffices to show that ∃w0 s.t.g(w0) = y for any values of y and λi , i = 1 . . .M . Itis important to note that ω > jβ for CCDF and ω < jβfor CDF.Let λ1 be the largest positive eigenvalue and λM bethe smallest negative eigenvalue (i.e. the largest negativeeigenvalue in absolute value). If the matrix A is positivedefinite, i.e. the eigenvalues are all positive, the aboveresult that establishes the existence of the saddle pointstill holds with some minor modifications in the proof.By studying the g(ω) asymptotically, it can be noted that

limw→(µ1+β)−

g(w) = +∞ and limw→(µM+β)+

g(w) = −∞(72)

Thus, based on this and the fact that g(w) is continuousin the interval (µM +β, µ1 +β) ; we conclude that givenany value of y, ∃ a value w0 ∈ (µM + β, µ1 + β) whereg(.) intersects the horizontal line y. In fact, we considerthe interval (−∞, µ1 + β) which results in

limw→−∞

g(w) = 0 and limw→(µ1+β)−

g(w) = +∞ (73)

Again, this together with the continuity of g(w) on theinterval (−∞, µ1 +β) guarantees the existence of a valuew0 ∈ (−∞, µ1 + β) where g(.) intersects the horizontalline y . This is the case since A being positive definitenecessitates that y > 0.

REFERENCES

[1] G. N. G. Tavares and L. M. G. Tavares, “On the Statistics of theSum of Squared Complex Gaussian Random Variables,” IEEETrans. Commun., vol. 55, no. 10, pp. 1857–1862, Oct. 2007.

[2] A. M. Mathai and S. B. Provost, “Quadratic forms in randomvariables,” New York: Marcel Dekker, 1992.

[3] N. L. Johnson and S. Kotz, “Continuous univariate distributions,”New York: Houghton Mifflin, vol. 2, 1970.

[4] D. Divsalar, K. M. Simon, and M. Shahshahani, “The performanceof trellis-coded MDPSK with multiple symbol detection,” IEEETrans. Commun., vol. 38, no. 9, pp. 1391–1403, Sept.

[5] D. Raphaeli, “Noncoherent coded modulation,” IEEE Trans.Commun., vol. 44, no. 2, pp. 172–183, Feb 1996.

[6] J. Huang and L. L. Campbell, “Trellis coded mdpsk in correlatedand shadowed rician fading channels,” IEEE Trans. Veh. Technol.,vol. 40, pp. 786–797, 1991.

[7] Q. Zhao and H. Li, “Differential BPSK modulation for wirelessrelay networks,” Proceedings of 38th Annual conference onInformation Science and Systems (CISS’04), Princeton University,Princeton NJ, 2004.

[8] Q. Zhao and H. Li, “Performance of differential modulation withwireless relays in rayleigh fading channels,” IEEE CommunicationLetters, vol. 9, pp. 343–345, 2005.

[9] G. W. Wornel J. N. Laneman and D. N. C. Tse, “An efficientprotocol for realizing cooperative diversity in wireless networks,”Proceedings of IEEE International Symposium on InformationTheory, 2001, June 2001.

[10] W. R. Bennett M. Schwartz and S. Stein, “Communication systemsand techniques,” New York: McGraw Hill, 1966.

[11] J. G. Proakis, Digital Communications, 3rd Edition, New York:McGraw Hill, 1995.

[12] M. Sharif and B. Hassibi, “On the capacity of MIMO broadcastchannel with partial side information,” IEEE Trans. Inf. Theory,vol. 51, no. 2, pp. 506–522, Feb 2005.

Page 12: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

[13] H. O. Pollak U. Grenander and D. Slepian, “The distribution ofquadratic forms in normal variates: A small sample theory withapplications to spectral analysis,” SIAM J., vol. 7, pp. 374–401,1959.

[14] H. Ruben, “Probability content of regions under spherical normaldistributions 1,” Ann. Math. Stat., vol. 31, pp. 598–619, 1960.

[15] N.J. Bershad, “Analysis of the normalized LMS algorithm withGaussian inputs.,” IEEE Trans. Acoust., Speech and SignalProcess., vol. ASSP-34, pp. 793–806, 1986.

[16] N. J. Bershad, “Behavior of the ε-Normalizd LMS algorithmfor Gaussian inputs,” IEEE Trans. Acoust., Speech, and SignalProcess., vol. ASSP-35, no. 5, pp. 636–644, May 1987.

[17] T. Y. Al-Naffouri and M. Moinuddin, “Exact Performance Anal-ysis of the ε-NLMS Algorithm for Colored Circular GaussianInputs,” IEEE Trnsactions on Signal Processing, vol. 58, no. 10,pp. 5080–5090, Oct. 2010.

[18] J. Gurland, “Distribution of definite and indefinite quadraticforms,” Ann. Math. Stat., vol. 26, pp. 122–127, 1955.

[19] B. K. Shah, “Distribution of definite and indefinite quadratic formsfrom a non-central normal distribution,” Ann. Math. Stat., vol. 34,pp. 186–190, 1963.

[20] J. P. Imhof, “Computing the distribution of quadratic forms innormal variates,” Biometrika, vol. 48, pp. 419–426, 1961.

[21] S. J. Press, “Linear Combinations of noncentral chi-squarevariates,” Ann. Math. Stat., vol. 37, pp. 480–487, 1966.

[22] A. Grad and H. Solomon, “Distribution of quadratic forms andsome applications,” Ann. Math. Stat., vol. 26, pp. 464–477, 1955.

[23] J. Robinson, “The distribution of a general quadratic form innormal variates,” Australian J. Stat., vol. 7, pp. 110–114, 1965.

[24] Y. Y. Wang, “A comparision of several variance componentestimators,” Biometrika, vol. 54, pp. 301–305, 1967.

[25] M. S. Rogers F. J. Reifler and K. Malakian, “Distribution of gen-eral noncentral positive definite quadratic form in k-dimensions,”IEEE Trans. Aerosp. Electron. Syst., vol. 25, pp. 411–414, May1989.

[26] K. H. Biyari and W. C. Lindsey, “Statistical distribution ofhermitian quadratic forms in complex Gaussian variables,” IEEETrans. Inf. Theory, vol. 39, pp. 1076–1082, May 1993.

[27] J. Huang and L. L. Campbell, “Tail probability of a noncentralindefinite gaussian quadratic form,” Comm. Stat. Simul., vol. 23,pp. 431–439, 1994.

[28] S. O. Rice, “Distribution of quadratic forms in normal variables:Evaluation by numerical integration,” SIAM. J. Scient. Statist.Comput., vol. 1, pp. 438–448, Dec 1980.

[29] M. Di Renzo, F. Graziosi, and F. Santucci, “On the cumulativedistribution function of quadratic-form receivers over generalizedfading channels with tone interference,” IEEE Trans. Commun.,vol. 57, no. 7, pp. 2122–2137, July 2009.

[30] G. L. Turin, “The characteristic function of hermitian quadraticforms in in complex normal variables,” Biometrika, vol. 47, pp.199–201, 1960.

[31] J. Gurland, “Quadratic forms in normally distributed randomvariables,” Sankhaya, vol. 17, pp. 37–50, 1956.

[32] S. B. Provost, “The distribution function of a statistic for testingthe equality of scale parameters in two gamma populations,”Metrika, vol. 36, pp. 337–345, 1989.

[33] C. G. Khatri, “Quadratic forms in normal variables,” Handbookof Statistics, vol. 1, pp. 443–469, 1980.

[34] H. E. Robbnis, “The distribution of a definite quadratic form,”Ann. Math. Stat., vol. 19, pp. 266–270, 1948.

[35] H. Ruben, “A new result on the distribution of definite quadraticforms,” Ann. Math. Stat., vol. 34, pp. 1582–1584, 1963.

[36] H. E. Robbnis and E. J. G. Pitman, “Application of the methodof mixtures of quadratic forms in normal variates,” Ann. Math.Stat., vol. 20, pp. 552–560, 1949.

[37] N. L. Johnson S. Kot and D. W. Boyd, “Series representationof distribution of quadratic forms in normal variables 1. centralcase,” Ann. Math. Stat., vol. 38, pp. 832–837, 1967.

[38] D. Raphaeli, “Distribution of noncentral indefinite quadratic formsin complex normal variables,” IEEE Trans. Inf. Theory, vol. 42,no. 3, pp. 1002–1007, May 1996.

[39] G. L. Turin, “Some computation of error rates for selectivelyfading multipath channels,” Proc. NEC, pp. 431–440, 1959.

[40] G. G. Tziritas, “On the distribution of positive definite gaussainquadratic functions,” IEEE Trans. Inf. Theory, vol. IT-33, pp. 895–906, 1987.

[41] T. Hayakawa, “On the distribution of a quadratic form in amultivariate normal sample,” Ann. Inst. Statist. Math., vol. 18,pp. 191–200, 1966.

[42] N. Shah and H. Li, “Distribution of quadratic form in Gaussianmixture variables and application in Relay Networks,” IEEE 6thWorkshop on Signal Processing Advances in Wireless Communi-cations 2005, pp. 490–494, 2005.

[43] M. K. Simon and M.-S. Alouini, “On the difference of two chi-square variates with application to outage probability computa-tion,” IEEE Trans. Commun., vol. 49, pp. 1946–1954, Nov 2001.

[44] H. Holm and M. S. Alouini, “Sum and difference of two squaredcorrelated Nakagami variates in connection with the McKaydistribution,” IEEE Trans. Commun., vol. 52, no. 8, pp. 1367–1376, Aug 2004.

[45] M. Chiani, M. Z. Win, A. Zanella, “On the capacity of spatiallycorrelated MIMO Rayleigh fading channels,” IEEE Trans. Inf.Theory, vol. 49, no. 10, pp. 2363–2371, Oct. 2003.

[46] S. H. Simon and A. L. Moustakas, “Eigenvalue Density ofCorrelated Random Wishart Matrices,” Phys. Rev. E, vol. 69, no.065101(R), pp. 2363–2371, 2004.

[47] M. Senst, L. Krzymien, L. Szczecinski, and F. Labeau, “Calcu-lating LLRs via Saddlepoint Approximation in Front-End MIMOReceivers,” IEEE Trans. Commun., vol. 61, no. 6, pp. 2330–2338,June 2013.

[48] J. Scarlett, A. Martinez, and A. Guilln i Fbregas, “MismatchedDecoding: Error Exponents, Second-Order Rates and SaddlepointApproximations,” IEEE Trans. Inf. Theory, vol. 60, pp. 2647–2666, May 2014.

[49] M. K. Liu; A. C. Vrahas, and M. J. B. Moretti, “Saddle pointbit error rate computations for optical communication systemsincorporating equalizers,” IEEE Trans. Commun., vol. 43, no.2/3/4, pp. 998–1000, Feb./March/April 1995.

[50] J. W. Craig, “A New, Simple and Exact Result for Calculating theProbability of Error for Two-Dimensional Signal Constellations,”IEEE MILCOM91 Conference Record, Boston, MA, pp. 25.5.1–25.5.5, 1991.

[51] T. Y. Al-Naffouri and B. Hassibi, “On the distribution of indefenitequadratic forms in Gaussian random variables,” InternationalSymposium on Information Theory (ISIT), South Korea, 2009.

[52] Gradshteyn and Ryzhik, Table of Integrals, Series, and Products,A. Jeffrey and D. Zwillinger (eds.), 7th ed., Feb 2007.

[53] C. M. Bender and S. A. Orszag, Advanced Mathematical Methodsfor Scientists and Engineers, NY: McGraw-Hill, 1978.

[54] A. Martinez, A. Guilln i Fbregas, and G. Caire, “Error probabilityanalysis of bit-interleaved coded modulation,” IEEE Trans. Inf.Theory, vol. 52, no. 1, pp. 2647–2666, Jan. 2006.

[55] R. W. Butler and M. S. Paolella, “Uniform saddlepoint approxi-mations for ratios of quadratic forms,” Bernoulli, vol. 14, no. 1,pp. 140–154, 2008.

[56] P. W. N. Marsh, “Saddlepoint approximations for noncentralquadratic forms,” Econ. Theory, vol. 14, pp. 539–559, 1998.

[57] A. L. Moustakas, S. H. Simon and A. M. Sengupta, “MIMO Ca-pacity Through Correlated Channels in the Presence of CorrelatedInterferers and Noise: A (not so) Large N Analysis,” IEEE Trans.Inf. Theory, vol. 49, no. 10, pp. 25–45, Oct. 2003.

[58] A. L. Moustakas and S. H. Simon, “Random Matrix Theory ofMulti-Antenna Communications: The Ricean Channel,” invitedarticle,J. Phys. A: Math. Gen.(special Issue on Trends in QuantumChaotic Scattering), vol. 38, pp. 10859–10872, 2005.

[59] M. Sharif M. J. Fakhereddin and B. Hassibi, “Reduced feedbackand random beamforming for OFDM MIMO broadcast channels,”IEEE Trans. Commun., vol. 57, no. 12, pp. 3827–3835, 2009.

[60] B. Hassibi and T. L. Marzetta, “Multiple-antennas and isotropi-cally random unitary inputs:The received signal density in closedform,” IEEE Trans.Inf. Theory, vol. 48, no. 6, pp. 1473–1484,2002.

[61] M. K. Simon, and M.-S. Alouini, Digital Communication overFading Channels: A Unified Approach to Performance Analysis,John Wiley and Sons, Inc., 2000.

Page 13: On the Distribution of Indefinite Quadratic Forms in ...faculty.kfupm.edu.sa/EE/naffouri/publications/Indefinite_Quad_Form... · On the Distribution of Indefinite Quadratic Forms

[62] M. K. Simon, “Single integral representations of certain integerpowers of the Gaussian Q-function and their application,” IEEECommun. Lett., , no. 12, pp. 532–534, Dec. 2002.

[63] F. Sohrabi and T. N. Davidson, “Coordinate Update Algorithmsfor Robust Power Loading for the MISO Downlink with OutageConstraints and Gaussian Uncertainities,” Proceedings of Inter-national Conference on Acoustic, Speech and Signal Processing(ICASSP) 2013, Vancouver, Canada, May 2013.

[64] B. D. Rao, M. Wengler, and B. Judson, “Performance analysisand comparison of MRC and optimal combining in antenna arraysystems,” ICASSP 2001, vol. 5, pp. 2949–2952, 2001.

[65] A. Al-Humaidi Fadhel and S. Shahbazpanahi, “Two-way cooper-ative communications with statistical channel knowledge,” SignalProcessing, Elsevier, 2013.

[66] C. Kim, S. Lee, and J. Lee, “SINR and Throughput Analysis forRandom Beamforming Systems with Adaptive Modulation,” IEEETrnsactions on Signal Processing, vol. 12, no. 4, pp. 1460–1471,April 2013.

[67] K. G. Seddik, A. K. Sadek, W. Su, and K. J. R. Liu, “OutageAnalysis and Optimal Power Allocation for Multinode RelayNetworks,” IEEE Trnsactions on Signal Processing, vol. 14, no.6, pp. 377–380, June 2007.

[68] Nabil Romero-Zurita, Mounir Ghogho, and Des McLernon, “Out-age probability based power distribution between data and artificialnoise for physical layer security,” Signal Processing Letters, IEEE,vol. 19, no. 2, pp. 71–74, 2012.

[69] M. F. A. Ahmed, T. Y. Al-Naffouriy, and S. Alouiniy, “Onthe Effect of Correlated Measurements on the Performance ofDistributed Estimation,” IEEE International Conf. on Comm. ICC’13, Hungary.

[70] S. G. Sankaran and A. A. Beex, “Convergence Behavior of AffineProjection Algorithms,” IEEE Trnsactions on Signal Processing,vol. 48, no. 4, pp. 1086–1096, April 2000.

Application ReferencesPower allocation and optimal combining for multiple antennas [63], [64]Performance analysis of beamforming techniques [65]–[66]Outage analysis [67], [68]Performance analysis of sensor networks [69]Performance analysis of the adaptive filtering algorithms [15]–[17],[70]

TABLE ILIST OF SOME SPECIFIC APPLICATIONS OF INDEFINITE QUADRATIC

FORMS IN COMMUNICATIONS.