{"id":1273,"date":"2018-11-27T06:57:16","date_gmt":"2018-11-27T06:57:16","guid":{"rendered":"http:\/\/msp01.epgpbooks.inflibnet.ac.in\/?post_type=chapter&p=1273"},"modified":"2019-04-30T12:13:29","modified_gmt":"2019-04-30T12:13:29","slug":"matrices","status":"publish","type":"chapter","link":"https:\/\/ebooks.inflibnet.ac.in\/msp01\/chapter\/matrices\/","title":{"rendered":"Matrix eigenvalue problem"},"content":{"raw":"
\"epgp<\/a>\r\n<\/span><\/div>\r\n
\r\n\r\n \r\n\r\nTABLE OF CONTENTS<\/strong>\r\n

1. Introduction<\/p>\r\n

2. Complex vector spaces<\/p>\r\n

2.1 The inner product<\/p>\r\n

3. The characteristic equation<\/p>\r\n

4. Symmetric, antisymmetric and orthogonal matrices<\/p>\r\n

4.1 Orthogonal transformations<\/p>\r\n

4.2 Properties of orthogonal matrices<\/p>\r\n

4.3 Eigenbasis<\/p>\r\n

5. Similar matrices<\/p>\r\n

5.1 Diagonalization of a matrix<\/p>\r\n

6. Unitary, hermitian and antihermitian matrices<\/p>\r\n

6.1 Eigenvalues of unitary, hermitian and antihermitian matrices<\/p>\r\n

6.2 Eigenvectors of a hermitian matrix<\/p>\r\n

6.3 Invariance of inner product<\/p>\r\n \r\n\r\n<\/div>\r\n

\r\n\r\nLEARNING OBJECTIVES<\/strong>\r\n

1. Idea of eigenvalue of a matrix is introduced and its importance discussed.<\/p>\r\n

2. A complex vector space is introduced as a prelude to eigenvalue problem.<\/p>\r\n

3. The characteristic equation of a matrix and its relation to eigenvalues and eigenvectors obtained.<\/p>\r\n

4. Symmetric, antisymmetric and orthogonal matrices are defined. Orthogonal transformations are introduced and their properties discussed.<\/p>\r\n

5. Similar matrices are defined and its importance in diagonalization of a matrix discussed.<\/p>\r\n

6. Unitary, hermitian and antihermitian matrices are defined and properties of their eigenvalues proved.<\/p>\r\n\r\n<\/div>\r\n \r\n

\r\n

M a t r i x\u00a0 e i g e n\u00a0 v a l u e\u00a0 p r o b l e m<\/strong><\/p>\r\n \r\n\r\n1. Introduction<\/strong><\/span>\r\n

In this unit we will be dealing exclusively with square matrices. Let A<\/strong> be a square matrix of order n<\/em> and x<\/strong> a column vector of order n<\/em>. Then the \u201coperation\u201d of A<\/strong> on x<\/strong>, will yield some other column vector y<\/strong>:<\/p>\r\n\"\"\r\n

We can look upon the matrix as a transformation<\/em> in the n<\/em>-dimensional vector space of column vectors. The operation of A<\/strong> on x<\/strong> \u201ctransforms\u201d it into, in general, a different vector y<\/strong> in that vector space. However there exist certain special nonzero vectors which have the property that the matrix A<\/strong> operating on them yields simply a multiple of the same vector. If x<\/strong> is one such special vector then<\/p>\r\n\"\"\r\n

The problem is to be viewed as given a matrix A<\/strong>, we have to find the unknown column vector x<\/strong> and the unknown scalar \u03bb<\/em> so that equation (1) is satisfied. One solution to this problem is x = 0<\/strong>. This is the trivial solution and is of no interest to us. The problem of systematically finding such special nonzero vectors for a given square matrix and the corresponding scalars \u03bb<\/em> is referred to as the eigenvalue problem<\/em>. And this is the problem that we will address in this unit.<\/p>\r\n

The nonzero vectors x<\/strong>i<\/em> that satisfies equation (1) are called eigenvectors<\/em> or characteristic vectors<\/em> of A<\/strong> and the corresponding scalars \u03bb<\/em>i<\/em> are called the eigenvalues<\/em> or characteristic values<\/em> of A<\/strong>. The set of all eigenvectors of a matrix A<\/strong> is called its spectrum<\/em>. The largest of the absolute value of the eigenvalues of A<\/strong> is called the spectral radius <\/em>of A<\/strong>.<\/p>\r\n

This rather innocent looking matrix equation leads to a theory with applications in such diverse fields as engineering, physics, geometry, mathematics, biology, environmental science, urban planning, economics, psychology, and many others.<\/p>\r\n

It will soon become clear that even if the matrix A<\/strong> is real, the eigenvalues as well as eigenfunctions are in general complex. So perforce we have to deal with complex numbers and complex vector spaces. Hence before we begin the problem of finding eigenvalues and eigenvectors, we will introduce complex vector spaces. They have same properties as real vector spaces, except for the differences that crop up due to scalars being complex numbers. We will also introduce certain special matrices which are of particular interest in the study of eigenvalue problem.<\/p>\r\n \r\n\r\n2. Complex vector spaces<\/span><\/strong>\r\n

A complex vector space<\/em> is a vector space in which the scalars are complex numbers. It has all the properties of real vector spaces dealt with in the last unit, including linear independence, dimensionality and basis. Thus, for example, the space , consisting of n<\/em>-tuples of complex numbers, is n<\/em>-dimensional. In 3, the vectors<\/p>\r\n

(i,<\/em> 0, 0),\u00a0\u00a0 (0, i, i<\/em>),\u00a0\u00a0\u00a0 (0, 0, i<\/em>)<\/p>\r\n\"\"\r\n

where f<\/em>1<\/sub> and f<\/em>2<\/sub> are real functions of a real variable. The scalars consist of the set of all complex numbers. Then it is easy to verify that these functions form a complex vector space.<\/p>\r\n \r\n

2.1 The inner product<\/span><\/span><\/p>\r\n\"\"\r\n\r\n\"\"\r\n\r\nIn terms of the components of the vectors the norm and the distance are respectively<\/span>\r\n\r\n\"\"\r\n

If two vectors <\/span>u<\/strong> and <\/span>v<\/strong> are such that their inner product is zero, the vectors are said to be <\/span>orthogonal<\/em>. If further both the vectors have been \u201cnormalized\u201d, that is, have unit norm, then they are said to be <\/span>orthonormal<\/em>. In an <\/span>n<\/em>-dimensional vector space we can always choose <\/span>n<\/em> vectors which have unit norm and are mutually orthogonal. That is, we can always choose an <\/span>orthonormal basis<\/em>.<\/span><\/p>\r\n \r\n\r\nExample<\/span>\r\n\r\n\"\"\r\n\r\n \r\n\r\n3. The characteristic equation<\/span><\/strong><\/span>\r\n

Our objective now is to find the eigenvalues and the eigenvectors of a given matrix <\/span>A<\/strong> ={<\/span>a<\/em>ij<\/em>}. By taking the <\/span>\u03bb<\/em>x<\/strong> term to the left hand side in equation (1), it can be rewritten in the form<\/span><\/p>\r\n\"\"\r\n

By Cramer\u2019s rule of the last unit this homogeneous system of equations in <\/span>x<\/em>i<\/em><\/sub> has a nontrivial solution if, and only if, the determinant of the coefficient matrix is identically zero. That is<\/span><\/p>\r\n\"\"\r\n

The matrix <\/span>A<\/strong>\u2013<\/strong>\u03bb<\/em>I<\/strong> is called the <\/span>characteristic matrix<\/em> and the determinant <\/span>D<\/em>(<\/span>\u03bb<\/em>) is called the <\/span>characteristic<\/em>determinant <\/em>of the matrix <\/span>A<\/strong>. When the determinant<\/span> D<\/em>(<\/span>\u03bb<\/em>) is written in the expanded form it will be a sum of<\/span> n<\/em>! terms, each term will consist of exactly <\/span>n<\/em> factors. Only one of the terms will consist of the factors<\/span><\/p>\r\n\"\"\r\n

Thus the determinant is a <\/span>polynomial of degree n in \u03bb<\/em>. Equation (3) is called the <\/span>characteristic equation<\/em> and the polynomial is called the <\/span>characteristic polynomial<\/em> of <\/span>A<\/strong>. Thus we have the important theorem that:\u00a0<\/span><\/p>\r\n

Eigenvalues of a matrix <\/em>A<\/strong> are the roots of the characteristic equation of A<\/strong>.<\/em><\/p>\r\n\"\"\r\n\r\n \r\n\r\nExample-1<\/span>\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n \r\n\r\nExample-2<\/span>\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n\"\"\r\n

In this example the matrix is real but the eigenvalues and eigenvectors are complex.<\/em><\/p>\r\n \r\n

4. Symmetric, antisymmetric and orthogonal matrices<\/span><\/strong><\/span><\/p>\r\n

Though we have introduced complex spaces and matrices, for the moment we continue with real matrices and consider three classes of real square matrices that, because of their remarkable properties, occur quite frequently in applications.<\/span><\/p>\r\nA (real) square matrix <\/span>A<\/strong> is called <\/span>symmetric<\/em>, if <\/span>A<\/strong>T<\/strong><\/sup>= A<\/strong>, and <\/span>antisymmetric<\/em> if <\/span>A<\/strong>T<\/strong><\/sup>= -A<\/strong>.<\/span>\r\n\r\nA (real) square matrix is <\/span>orthogonal<\/em> if, and only if, <\/span>A<\/strong>T<\/strong><\/sup>= A<\/strong>-1<\/sup>.<\/span>\r\n\r\nEquivalently, an orthogonal matrix can be defined by the requirement <\/span>AA<\/strong>T<\/strong><\/sup>= A<\/strong>T<\/strong><\/sup>A = I<\/strong>, the unit matrix.<\/span>\r\n\r\n \r\n\r\nExamples<\/span>\r\n\r\n\"\"\r\n

For the eigenvalues of symmetric and skew-symmetric matrices we have the following results which we will prove in the context of complex matrices.<\/span><\/p>\r\n

(i)\u00a0\u00a0\u00a0\u00a0\u00a0 <\/span>The eigenvalues of a symmetric matrix are real.<\/em><\/p>\r\n

(ii)\u00a0\u00a0\u00a0 <\/span>The eigenvalues of a skew-symmetric matrix are pure imaginary or zero.<\/em><\/p>\r\n\r\n<\/div>\r\n\"\"\r\n\r\n \r\n\r\n4.1 Orthogonal transformations<\/span><\/span>\r\n

We have already remarked that the matrix <\/span>A<\/strong> can be viewed as effecting a transformation in the space \u211dn<\/em><\/sup> which transforms a vector <\/span>x<\/strong> into a vector <\/span>y<\/strong>:<\/span><\/p>\r\n

y = Ax<\/strong><\/p>\r\n

If a matrix <\/span>A<\/strong> is orthogonal, the corresponding transformation is called an <\/span>orthogonal transformation<\/em>. It can be shown that every rotation in a plane or three dimensional space, or <\/span>n<\/em>-dimensional space for that matter, is an orthogonal transformation. For example a rotation by an angle <\/span>\u03b8<\/em> in a plane is given by the orthogonal matrix<\/span><\/p>\r\n\"\"\r\n\r\n \r\n\r\n4.2 Properties of orthogonal matrices<\/span><\/span>\r\n

Orthogonal transformations and therefore matrices have some very important and useful properties.<\/span><\/p>\r\n

1. An orthogonal transformation preserves the inner product in \u211dn<\/em><\/sup>.<\/span><\/p>\r\n\"\"\r\n

As a corollary it follows that the norm of a vector is also preserved.<\/span><\/p>\r\n \r\n\r\nProof<\/span><\/span>\r\n\r\n\"\"\r\n

\r\n\r\n \r\n

2.\u00a0 A real square matrix is orthogonal if and only if its column vectors (c<\/strong>1<\/sub>, c<\/strong>2<\/sub>, ..., c<\/strong>n<\/em><\/sub>) (and also its row vectors) form an orthonormal system<\/em>. That is,<\/p>\r\n\"\"\r\n\r\nProof<\/span>\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n<\/div>\r\n

\r\n\r\n \r\n

3. The determinant of an orthogonal matrix has the value +1 or -1.<\/p>\r\n \r\n\r\nProof<\/span>\r\n

Determinants have the property that det(AB<\/strong>) = det(A<\/strong>) det(B<\/strong>) and det(A<\/strong>) = det(A<\/strong>T<\/strong><\/sup>). From these two properties the result follows:<\/p>\r\n\"\"\r\n\r\n \r\n\r\n4.3 Eigenbasis<\/span>\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n\"\"\r\n

Thus in terms of the eigenbasis, the effect of the matrix <\/span>A<\/strong> on an arbitrary vector is to multiply the coefficient of each eigenvector by a scalar. That is why it is important to know if an eigenbasis exists.<\/span><\/p>\r\n \r\n\r\nTheorem<\/span><\/span>\r\n

The following theorem provides a criterion for existence of eigenbasis: If all the <\/span>n<\/em> eigenvalues of an <\/span>n<\/em>x<\/span>n<\/em> matrix <\/span>A<\/strong> are distinct, then the eigenvectors form a basis in \u211dn<\/em><\/sup> ( or \u2102n<\/em><\/sup> ).<\/span><\/p>\r\n \r\n\r\nProof<\/span><\/span>\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n \r\n\r\n5. Similar matrices<\/span><\/strong><\/span>\r\n\r\n\"\"\r\n\r\n \r\n\r\nProof<\/span><\/span>\r\n\r\n\"\"\r\n\r\n \r\n\r\nExample<\/span><\/span>\r\n\r\n\"\"\r\n\r\n \r\n\r\n5.1 Diagonalization of a matrix<\/span><\/span>\r\n

Given an <\/span>n<\/em>x<\/span>n<\/em> matrix <\/span>A<\/strong>, if there exists a matrix similar to <\/span>A<\/strong> which is diagonal in form, we say the matrix <\/span>A<\/strong> has been <\/span>diagonalized<\/em>. It may not be always possible to diagonalize a given matrix. However, the following theorem gives a criterion under which the matrix can be diagonalized:<\/span><\/p>\r\n \r\n\r\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 (i) If the eigenvectors of an <\/span>n<\/em>x<\/span>n<\/em> matrix <\/span>A<\/strong> form a basis, then<\/span>\r\n\r\n\"\"\r\n

is diagonal, with the eigenvalues of <\/span>A<\/strong> as the entries on the main diagonal. Here <\/span>X<\/strong> is the matrix whose columns are these eigenvectors.<\/span><\/p>\r\n \r\n\r\n\"\"\r\n\r\n<\/div>\r\n

\r\n\r\n \r\n\r\n6. Unitary, hermitian and antihermitian matrices<\/strong><\/span>\r\n\r\n\"\"\r\n\r\nThe hermitian conjugate<\/em> or transpose conjugate<\/em> of a square matrix A<\/strong>, denoted by A<\/strong>* is the matrix which is transpose as well as the conjugate of A<\/strong>:\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\nA matrix is said to be\r\n\r\n\"\"\r\n\r\n \r\n\r\n6.1 Eigenvalues of unitary, hermitian and antihermitian matrices<\/span><\/span>\r\n

We have a remarkable theorem about the eigenvalues of unitary, hermitian and antihermitian matrices:<\/span><\/p>\r\n

1.\u00a0<\/span>The eigenvalues of a hermitian matrix <\/em>(<\/span>and thus of a real symmetric matrix<\/em>)<\/span> are real.<\/em><\/p>\r\n

2.\u00a0<\/span>The eigenvalues of a skew-hermitian matrix <\/em>(<\/span>and thus of a real skew-symmetric matrix<\/em>)<\/span> are pure imaginary.<\/em><\/p>\r\n

3.\u00a0<\/span>The eigenvalues of a unitary matrix <\/em>(<\/span>and thus of a real orthogonal matrix<\/em>)<\/span> have absolute value <\/em>1.<\/span><\/p>\r\n\r\n<\/div>\r\n

\r\n\r\nProof<\/span>\r\n\r\n1. Let \u03bb<\/em> be an eigenvalue and x<\/strong> the corresponding eigenvector of A<\/strong>: Ax<\/strong> = \u03bb<\/em>x<\/strong>. Multiply this equation by x<\/strong>*<\/strong> from the left, so that\r\n\r\n\"\"\r\n\r\nis real and positive definite since x<\/strong> being an eigenvector cannot be the null vector. Therefore dividing equation (16) by x<\/strong>*<\/strong>x,<\/strong> we have\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n\"\"\r\n\r\n \r\n\r\n6.2 Eigenvectors of a hermitian matrix<\/span><\/span>\r\n

For the eigenvectors of a hermitian matrix we have the important theorem: If <\/span>A<\/strong> is hermitian, its eigenvectors corresponding to distinct eigenvalues are orthogonal.<\/span><\/p>\r\n \r\n

Proof<\/span><\/span><\/p>\r\n\"\"\r\n\r\n \r\n\r\n6.3 Invariance of inner product<\/span><\/span>\r\n\r\n\"\"\r\n\r\n<\/div>\r\n \r\n\r\nSUMMARY<\/strong>\r\n