Elementary Linear Algebra

289 downloads 377880 Views 560KB Size Report
1.6 Further Results on Systems of Equations and Invertibility. 59 .... x + 3z + 1, and x1 − 2x2 − 3x3 + x4 = 7 ... numbers s1,s2,...,sn such that the equation is satisfied when we substitute x1 = s1, ... a2x + b2y = c2 (a2, b2 not both zero) .... (f ) πx1 −. √. 2x2 + 1. 3 x3 = 71/3. 2. Given that k is a constant, which of the following are ...
CHAPTER 1

SYSTEMS OF LINEAR EQUATIONS AND MATRICES 1.1 1.2 1.3 1.4 1.5 1.6 1.7

CHAPTER 2

DETERMINANTS 2.1 2.2 2.3 2.4

CHAPTER 3

The Determinant Function 82 Evaluating Determinants by Row Reduction 89 Properties of the Determinant Function 95 Cofactor Expansion; Cramer’s Rule 104

Introduction to Vectors (Geometric) Norm of a Vector; Vector Arithmetic Dot Product; Projections 130 Cross Product 138 Lines and Planes in 3-Space 149

119

120 126

EUCLIDEAN VECTOR SPACES 4.1 Euclidean n-Space 162 173 4.2 Linear Transformations from R n to R m 4.3 Properties of Linear Transformations from R n to R m

xiv

59

81

VECTORS IN 2-SPACE AND 3-SPACE 3.1 3.2 3.3 3.4 3.5

CHAPTER 4

Introduction to Systems of Linear Equations 2 Gaussian Elimination 8 Matrices and Matrix Operations 23 Inverses; Rules of Matrix Arithmetic 37 Elementary Matrices and a Method for Finding A−1 50 Further Results on Systems of Equations and Invertibility Diagonal, Triangular, and Symmetric Matrices 66

1

161

189

Contents

CHAPTER 5

GENERAL VECTOR SPACES 5.1 5.2 5.3 5.4 5.5 5.6

CHAPTER 6

203

Real Vector Spaces 204 Subspaces 211 Linear Independence 221 Basis and Dimension 231 Row Space, Column Space, and Nullspace Rank and Nullity 259

246

INNER PRODUCT SPACES

275

6.1 Inner Products 276 6.2 Angle and Orthogonality in Inner Product Spaces 287 6.3 Orthonormal Bases; Gram–Schmidt Process; QR-Decomposition 6.4 Best Approximation; Least Squares 311 6.5 Orthogonal Matrices; Change of Basis 320

CHAPTER 7

EIGENVALUES, EIGENVECTORS 7.1 7.2 7.3

CHAPTER 8

Eigenvalues and Eigenvectors Diagonalization 347 Orthogonal Diagonalization

298

337

338 357

LINEAR TRANSFORMATIONS 8.1 8.2 8.3 8.4 8.5

CHAPTER 9

• • • xv

General Linear Transformations 366 Kernel and Range 376 Inverse Linear Transformations 382 Matrices of General Linear Transformations Similarity 402

365

390

ADDITIONAL TOPICS 9.1 Application to Differential Equations 420 9.2 Geometry of Linear Operators on R 2 426 9.3 Least Squares Fitting to Data 437 9.4 Approximation Problems; Fourier Series 442 9.5 Quadratic Forms 447 9.6 Diagonalizing Quadratic Forms; Conic Sections 9.7 Quadric Surfaces 463

419

454

xvi • • • Contents 9.8 Comparison of Procedures for Solving Linear Systems 9.9 LU -Decompositions 477

CHAPTER 10

COMPLEX VECTOR SPACES 10.1 10.2 10.3 10.4 10.5 10.6

CHAPTER 11

468

Complex Numbers 488 Vision of Complex Numbers 494 Polar Form of a Complex Number 500 Complex Vector Spaces 506 Complex Inner Product Spaces 513 Unitary, Normal, and Hermitian Matrices

487

520

APPLICATIONS OF LINEAR ALGEBRA 11.1 11.2 11.3 11.4 11.5 11.6 11.7 11.8 11.9 11.10 11.11 11.12 11.13 11.14 11.15 11.16 11.17 11.18 11.19 11.20 11.21

Constructing Curves and Surfaces Through Specified Points Electrical Networks 538 Geometric Linear Programming 542 The Assignment Problem 554 Cubic Spline Interpolation 565 Markov Chains 576 Graph Theory 587 Games of Strategy 598 Leontief Economic Models 608 Forest Management 618 Computer Graphics 626 Equilibrium Temperature Distributions 636 Computed Tomography 647 Fractals 659 Chaos 678 Cryptography 692 Genetics 705 Age-Specific Population Growth 716 Harvesting of Animal Populations 727 A Least Squares Model for Human Hearing 735 Warps and Morphs 742

531 532

ANSWERS TO EXERCISES

A-1

PHOTO CREDITS

P-1

INDEX

I-1

1

Chapter Contents 1.1 1.2 1.3 1.4 1.5 1.6 1.7

Introduction to Systems of Linear Equations Gaussian Elimination Matrices and Matrix Operations Inverses; Rules of Matrix Arithmetic Elementary Matrices and a Method for Finding A−1 Further Results on Systems of Equations and Invertibility Diagonal, Triangular, and Symmetric Matrices

NTRODUCTION: Information in science and mathematics is often organized into rows and columns to form rectangular arrays, called “matrices” (plural of “matrix”). Matrices are often tables of numerical data that arise from physical observations, but they also occur in various mathematical contexts. For example, we shall see in this chapter that to solve a system of equations such as 5x + y = 3 2x − y = 4 all of the information required for the solution is embodied in the matrix   5 1 3 2 −1 4 and that the solution can be obtained by performing appropriate operations on this matrix. This is particularly important in developing computer programs to solve systems of linear equations because computers are well suited for manipulating arrays of numerical information. However, matrices are not simply a notational tool for solving systems of equations; they can be viewed as mathematical objects in their own right, and there is a rich and important theory associated with them that has a wide variety of applications. In this chapter we will begin the study of matrices.

1

2 • • • Chapter 1 / Systems of Linear Equations and Matrices

1.1

INTRODUCTION TO SYSTEMS OF LINEAR EQUATIONS Systems of linear algebraic equations and their solutions constitute one of the major topics studied in the course known as “linear algebra.” In this first section we shall introduce some basic terminology and discuss a method for solving such systems.

Linear Equations Any straight line in the xy-plane can be represented algebraically by an equation of the form a1 x + a2 y = b where a1 , a2 , and b are real constants and a1 and a2 are not both zero. An equation of this form is called a linear equation in the variables x and y. More generally, we define a linear equation in the n variables x1 , x2 , . . . , xn to be one that can be expressed in the form a 1 x1 + a 2 x2 + · · · + a n xn = b where a1 , a2 , . . . , an , and b are real constants. The variables in a linear equation are sometimes called unknowns.

EXAMPLE 1 Linear Equations The equations x + 3y = 7, y = 21 x + 3z + 1, and

x1 − 2x2 − 3x3 + x4 = 7

are linear. Observe that a linear equation does not involve any products or roots of variables. All variables occur only to the first power and do not appear as arguments for trigonometric, logarithmic, or exponential functions. The equations √ x + 3 y = 5, 3x + 2y − z + xz = 4, and y = sin x are not linear. A solution of a linear equation a1 x1 + a2 x2 + · · · + an xn = b is a sequence of n numbers s1 , s2 , . . . , sn such that the equation is satisfied when we substitute x1 = s1 , x2 = s2 , . . . , xn = sn . The set of all solutions of the equation is called its solution set or sometimes the general solution of the equation.

EXAMPLE 2 Finding a Solution Set Find the solution set of (a) 4x − 2y = 1, and (b) x1 − 4x2 + 7x3 = 5. Solution (a). To find solutions of (a), we can assign an arbitrary value to x and solve for y, or choose an arbitrary value for y and solve for x. If we follow the first approach and assign x an arbitrary value t, we obtain x = t,

y = 2t −

1 2

1.1

Introduction to Systems of Linear Equations

••• 3

These formulas describe the solution set in terms of an arbitrary number t, called a parameter. Particular numerical solutions can be obtained by substituting specific values ; and t = − 21 yields the for t. For example, t = 3 yields the solution x = 3, y = 11 2 solution x = − 21 , y = − 23 . If we follow the second approach and assign y the arbitrary value t, we obtain x = 21 t + 41 ,

y=t

Although these formulas are different from those obtained above, they yield the same solution set as t varies over all possible real numbers. For example, the previous formulas gave the solution x = 3, y = 11 when t = 3, while the formulas immediately above 2 . yield that solution when t = 11 2 Solution (b). To find the solution set of (b) we can assign arbitrary values to any two variables and solve for the third variable. In particular, if we assign arbitrary values s and t to x2 and x3 , respectively, and solve for x1 , we obtain x1 = 5 + 4s − 7t,

x2 = s,

x3 = t

Linear Systems A finite set of linear equations in the variables x1 , x2 , . . . , xn is called a system of linear equations or a linear system. A sequence of numbers s1 , s2 , . . . , sn is called a solution of the system if x1 = s1 , x2 = s2 , . . . , xn = sn is a solution of every equation in the system. For example, the system 4x1 − x2 + 3x3 = −1 3x1 + x2 + 9x3 = −4 has the solution x1 = 1, x2 = 2, x3 = −1 since these values satisfy both equations. However, x1 = 1, x2 = 8, x3 = 1 is not a solution since these values satisfy only the first of the two equations in the system. Not all systems of linear equations have solutions. For example, if we multiply the second equation of the system x+ y=4 2x + 2y = 6 by 21 , it becomes evident that there are no solutions since the resulting equivalent system x+y =4 x+y =3

has contradictory equations. A system of equations that has no solutions is said to be inconsistent; if there is at least one solution of the system, it is called consistent. To illustrate the possibilities that can occur in solving systems of linear equations, consider a general system of two linear equations in the unknowns x and y: a1 x + b1 y = c1 (a1 , b1 not both zero) a2 x + b2 y = c2 (a2 , b2 not both zero) The graphs of these equations are lines; call them l1 and l2 . Since a point (x, y) lies on a line if and only if the numbers x and y satisfy the equation of the line, the solutions of the system of equations correspond to points of intersection of l1 and l2 . There are three possibilities illustrated in Figure 1.1.1: • The lines l1 and l2 may be parallel, in which case there is no intersection and consequently no solution to the system.

4 • • • Chapter 1 / Systems of Linear Equations and Matrices l1

l2

• The lines l1 and l2 may intersect at only one point, in which case the system has exactly one solution. • The lines l1 and l2 may coincide, in which case there are infinitely many points of intersection and consequently infinitely many solutions to the system.

y

x

Although we have considered only two equations with two unknowns here, we will show later that the same three possibilities hold for arbitrary linear systems: Every system of linear equations has either no solutions, exactly one solution, or infinitely many solutions.

(a) No solution y l1

An arbitrary system of m linear equations in n unknowns can be written as

l2

a11 x1 + a12 x2 + · · · + a1n xn = b1 a21 x1 + a22 x2 + · · · + a2n xn = b2 .. .. .. .. . . . . am1 x1 + am2 x2 + · · · + amn xn = bm

x

(b) One solution y

l1 and l2

where x1 , x2 , . . . , xn are the unknowns and the subscripted a’s and b’s denote constants. For example, a general system of three linear equations in four unknowns can be written as a11 x1 + a12 x2 + a13 x3 + a14 x4 = b1 a21 x1 + a22 x2 + a23 x3 + a24 x4 = b2 a31 x1 + a32 x2 + a33 x3 + a34 x4 = b3

x

The double subscripting on the coefficients of the unknowns is a useful device that is used to specify the location of the coefficient in the system. The first subscript on the coefficient aij indicates the equation in which the coefficient occurs, and the second subscript indicates which unknown it multiplies. Thus, a12 is in the first equation and multiplies unknown x2 .

(c) Infinitely many solutions Figure 1.1.1

Augmented Matrices If we mentally keep track of the location of the +’s,

the x’s, and the =’s, a system of m linear equations in n unknowns can be abbreviated by writing only the rectangular array of numbers:   a11 a12 · · · a1n b1 a a ··· a b  2n 2  21 22  .. .. .. ..   . . . .  am1 am2 · · · amn bm This is called the augmented matrix for the system. (The term matrix is used in mathematics to denote a rectangular array of numbers. Matrices arise in many contexts, which we will consider in more detail in later sections.) For example, the augmented matrix for the system of equations x1 + x2 + 2x3 = 9 2x1 + 4x2 − 3x3 = 1 3x1 + 6x2 − 5x3 = 0 is



1 2 3

1 2 4 −3 6 −5

 9 1 0

1.1

Introduction to Systems of Linear Equations

••• 5

When constructing an augmented matrix, the unknowns must be written in the same order in each equation and the constants must be on the right.

REMARK.

The basic method for solving a system of linear equations is to replace the given system by a new system that has the same solution set but which is easier to solve. This new system is generally obtained in a series of steps by applying the following three types of operations to eliminate unknowns systematically. 1. Multiply an equation through by a nonzero constant. 2. Interchange two equations. 3. Add a multiple of one equation to another. Since the rows (horizontal lines) of an augmented matrix correspond to the equations in the associated system, these three operations correspond to the following operations on the rows of the augmented matrix. 1. Multiply a row through by a nonzero constant. 2. Interchange two rows. 3. Add a multiple of one row to another row.

Elementary Row Operations These are called elementary row operations. The following example illustrates how these operations can be used to solve systems of linear equations. Since a systematic procedure for finding solutions will be derived in the next section, it is not necessary to worry about how the steps in this example were selected. The main effort at this time should be devoted to understanding the computations and the discussion.

EXAMPLE 3 Using Elementary Row Operations In the left column below we solve a system of linear equations by operating on the equations in the system, and in the right column we solve the same system by operating on the rows of the augmented matrix.   x + y + 2z = 9 1 1 2 9   2x + 4y − 3z = 1 4 −3 1 2 3x + 6y − 5z = 0 3 6 −5 0 Add −2 times the first equation to the second to obtain

x + y + 2z = 9 2y − 7z = −17 3x + 6y − 5z = 0 Add −3 times the first equation to the third to obtain

x + y + 2z = 9 2y − 7z = −17 3y − 11z = −27

Add −2 times the first row to the second to obtain



1  0 3

1 2 6

2 −7 −5

 9  −17 0

Add −3 times the first row to the third to obtain



1  0

1 2

2 −7

0

3

−11

 9  −17 −27

6 • • • Chapter 1 / Systems of Linear Equations and Matrices Multiply the second equation by

1 2

x + y + 2z = y−

7 z 2

to obtain

Multiply the second row by



9

 0 0

= − 17 2

3y − 11z = −27 Add −3 times the second equation to the third to obtain

x + y + 2z =



− 21 z = − 23



+ y−

11 z 2 7 z 2

= =

35 2 − 17 2

z=

3

Add−11 times the third equation to the first and 2 7 times the third equation to the second to obtain 2

x y

=1 =2

1

 0 0

y − 27 z = − 17 2 z= 3

x

2

1

− 27

3 −11

 9  − 17 2  −27

1

2

1 − 27 0

− 21



9

  − 17 2  − 23

Multiply the third row by −2 to obtain

9

Add −1 times the second equation to the first to obtain

1

 0  0

y − 27 z = − 17 2

x + y + 2z =

1

to obtain

Add −3 times the second row to the third to obtain

9

Multiply the third equation by −2 to obtain

1

1 2

1

2

1 − 27 0

1

9



 − 17 2  3

Add −1 times the second row to the first to obtain



1

 0  0

1

11 2 − 27

0

1

0



35 2   − 17 2 

3

Add − 11 times the third row to the first and 2 times the third row to the second to obtain

z=3



1  0  0

0 1 0

0 0 1

 1  2 3

The solution x = 1, y = 2, z = 3 is now evident.

Exercise Set 1.1 1. Which of the following are linear equations in x1 , x2 , and x3 ? √ (b) x1 + 3x2 + x1 x3 = 2 (c) x1 = −7x2 + 3x3 (a) x1 + 5x2 − 2x3 = 1 √ 3/5 (d) x1−2 + x2 + 8x3 = 5 (e) x1 − 2x2 + x3 = 4 (f ) πx1 − 2x2 + 13 x3 = 71/3 2. Given that k is a constant, which of the following are linear equations? 1 (a) x1 − x2 + x3 = sin k (b) kx1 − x2 = 9 (c) 2k x1 + 7x2 − x3 = 0 k 3. Find the solution set of each of the following linear equations. (a) 7x − 5y = 3 (c) − 8x1 + 2x2 − 5x3 + 6x4 = 1

(b) 3x1 − 5x2 + 4x3 = 7 (d) 3v − 8w + 2x − y + 4z = 0

4. Find the augmented matrix for each of the following systems of linear equations. (a) 3x1 − 2x2 = −1 4x1 + 5x2 = 3 7x1 + 3x2 = 2

+ 2x3 = 1 (b) 2x1 3x1 − x2 + 4x3 = 7 6x1 + x2 − x3 = 0

− x4 + x5 = 1 (c) x1 + 2x2 3x2 + x3 − x5 = 2 x3 + 7x4 =1

(d) x1 x2

=1 =2 x3 = 3

7 2

1.1

Introduction to Systems of Linear Equations

5. Find a system of linear equations corresponding to the augmented matrix.     3 0 −2 5 2 0 0     1 4 −3 0 (b) 7 (a) 3 −4 0 −2 1 7 0 1 1   1 0 0 0 7   0 1 0 0 −2 7 2 1 −3 5   (c) (d)   0 1 0 3 0 1 2 4 0 1 0 0 0 1 4 6. (a) Find a linear equation in the variables x and y that has the general solution x = 5 + 2t, y = t. (b) Show that x = t, y = 21 t − 25 is also the general solution of the equation in part (a). 7. The curve y = ax 2 + bx + c shown in the accompanying figure passes through the points (x1 , y1 ), (x2 , y2 ), and (x3 , y3 ). Show that the coefficients a, b, and c are a solution of the system of linear equations whose augmented matrix is   y y = ax2 + bx + c x12 x1 1 y1  2  x  (x3, y3)  2 x2 1 y2  2 (x1, y1) x3 x3 1 y3 (x2, y2 ) x

Figure Ex-7 8. Consider the system of equations x + y + 2z = a x

+ z=b

2x + y + 3z = c Show that for this system to be consistent, the constants a, b, and c must satisfy c = a + b. 9. Show that if the linear equations x1 + kx2 = c and x1 + lx2 = d have the same solution set, then the equations are identical.

Discussion and Discovery 10. For which value(s) of the constant k does the system x− y=3 2x − 2y = k have no solutions? Exactly one solution? Infinitely many solutions? Explain your reasoning. 11. Consider the system of equations ax + by = k cx + dy = l ex + fy = m What can you say about the relative positions of the lines ax + by = k, cx + dy = l, and ex + fy = m when (a) the system has no solutions; (b) the system has exactly one solution; (c) the system has infinitely many solutions? 12. If the system of equations in Exercise 11 is consistent, explain why at least one equation can be discarded from the system without altering the solution set. 13. If k = l = m = 0 in Exercise 11, explain why the system must be consistent. What can be said about the point of intersection of the three lines if the system has exactly one solution?

••• 7

8 • • • Chapter 1 / Systems of Linear Equations and Matrices

1.2

GAUSSIAN ELIMINATION In this section we shall develop a systematic procedure for solving systems of linear equations. The procedure is based on the idea of reducing the augmented matrix of a system to another augmented matrix that is simple enough that the solution of the system can be found by inspection.

Echelon Forms In Example 3 of the last section, we solved a linear system in the unknowns x, y, and z by reducing the augmented matrix to the form   1 0 0 1 0 1 0 2  0 0 1 3 from which the solution x = 1, y = 2, z = 3 became evident. This is an example of a matrix that is in reduced row-echelon form. To be of this form a matrix must have the following properties: 1. If a row does not consist entirely of zeros, then the first nonzero number in the row is a 1. We call this a leading 1. 2. If there are any rows that consist entirely of zeros, then they are grouped together at the bottom of the matrix. 3. In any two successive rows that do not consist entirely of zeros, the leading 1 in the lower row occurs farther to the right than the leading 1 in the higher row. 4. Each column that contains a leading 1 has zeros everywhere else. A matrix that has the first three properties is said to be in row-echelon form. (Thus, a matrix in reduced row-echelon form is of necessity in row-echelon form, but not conversely.)

EXAMPLE 1 Row-Echelon and Reduced Row-Echelon Form The following matrices are in reduced row-echelon form.      0 1 −2 1 0 0 1 0 0 4 0 0 0    0 1 0 7, 0 1 0, 0 0 0 0 0 1 −1 0 0 1 0 0 0

0 1 0 0

The following matrices are in row-echelon form.     1 4 −3 7 1 1 0     1 6 2, 0 0 1 0, 0 0 1 5 0 0 0

2 1 0



0  0 0

1 0 0

 1 3 , 0 0

6 −1 0



0 0

0 0



 0  0 1

We leave it for you to confirm that each of the matrices in this example satisfies all of the requirements for its stated form.

EXAMPLE 2 More on Row-Echelon and Reduced Row-Echelon Form As the last example illustrates, a matrix in row-echelon form has zeros below each leading 1, whereas a matrix in reduced row-echelon form has zeros below and above

1.2

Gaussian Elimination

••• 9

each leading 1. Thus, with any real numbers substituted for the ∗’s, all matrices of the following types are in row-echelon form:     1 * * * 1 * * * 0 1  0 1  * * * *    ,  , 0 0 1 * 0 0 1 * 0 0 0 1 0 0 0 0     0 1 * * * * * * * * 1 * * *   0 0 0 1 * * * * * * 0 1    * *  0 0 0 0 1 * * * * *  ,   0 0 0 0  0 0 0 0 0 1  * * * *  0 0 0 0 0 0 0 0 0 0 0 0 1 * Moreover, all matrices of the following types are in reduced row-echelon form:     1 0 0 0 1 0 0 * 0 1 0 0  0 1 0  *     ,  , 0 0 1 0  0 0 1 * 0 0 0 1 0 0 0 0     0 1 * 0 0 0 * * 0 * 1 0 * *   0 0 0 1 0 0 * * 0 * 0 1    * *  0 0 0 0 1 0 * * 0 *  ,   0 0 0 0 0 0 0 0 0 1  * * 0 *  0 0 0 0 0 0 0 0 0 0 0 0 1 * If, by a sequence of elementary row operations, the augmented matrix for a system of linear equations is put in reduced row-echelon form, then the solution set of the system will be evident by inspection or after a few simple steps. The next example illustrates this situation.

EXAMPLE 3 Solutions of Four Linear Systems Suppose that the augmented matrix for a system of linear equations has been reduced by row operations to the given reduced row-echelon form. Solve the system.     1 0 0 5 1 0 0 4 −1     1 0 −2 1 0 2 6 (a) 0 (b) 0 0 0 1 4 0 0 1 3 2     1 6 0 0 4 −2 1 0 0 0 0  0 1 0 3 1    (c)  (d) 0 1 2 0  0 0 1 5 2 0 0 0 0 1 0 0 0 0 0 0 Solution (a). The corresponding system of equations is x1 x2

= 5 = −2 x3 =

By inspection, x1 = 5, x2 = −2, x3 = 4.

4

10 • • • Chapter 1 / Systems of Linear Equations and Matrices Solution (b). The corresponding system of equations is + 4x4 = −1

x1

+ 2x4 =

6

x3 + 3x4 =

2

x2

Since x1 , x2 , and x3 correspond to leading 1’s in the augmented matrix, we call them leading variables. The nonleading variables (in this case x4 ) are called free variables. Solving for the leading variables in terms of the free variable gives x1 = −1 − 4x4 x2 = x3 =

6 − 2x4 2 − 3x4

From this form of the equations we see that the free variable x4 can be assigned an arbitrary value, say t, which then determines the values of the leading variables x1 , x2 , and x3 . Thus there are infinitely many solutions, and the general solution is given by the formulas x1 = −1 − 4t, x3 = 2 − 3t, x4 = t x2 = 6 − 2t, Solution (c). The row of zeros leads to the equation 0x1 + 0x2 + 0x3 + 0x4 + 0x5 = 0, which places no restrictions on the solutions (why?). Thus, we can omit this equation and write the corresponding system as x1 + 6x2 x3

+ 4x5 = −2 + 3x5 = 1 x4 + 5x5 =

2

Here the leading variables are x1 , x3 , and x4 , and the free variables are x2 and x5 . Solving for the leading variables in terms of the free variables gives x1 = −2 − 6x2 − 4x5 x3 =

1 − 3x5

x4 =

2 − 5x5

Since x5 can be assigned an arbitrary value, t, and x2 can be assigned an arbitrary value, s, there are infinitely many solutions. The general solution is given by the formulas x1 = −2 − 6s − 4t, x2 = s, x3 = 1 − 3t, x4 = 2 − 5t, x5 = t Solution (d ). The last equation in the corresponding system of equations is 0x1 + 0x2 + 0x3 = 1 Since this equation cannot be satisfied, there is no solution to the system.

Elimination Methods We have just seen how easy it is to solve a system of linear equations once its augmented matrix is in reduced row-echelon form. Now we shall give a step-by-step elimination procedure that can be used to reduce any matrix to reduced row-echelon form. As we state each step in the procedure, we shall illustrate the idea by reducing the following matrix to reduced row-echelon form.   0 0 −2 0 7 12   4 −10 6 12 28 2 2 4 −5 6 −5 −1

1.2

Gaussian Elimination

• • • 11

Step 1. Locate the leftmost column that does not consist entirely of zeros.   0 0 −2 0 7 12   4 −10 6 12 28 2 2 4 −5 6 −5 −1 Leftmost nonzero column

Step 2. Interchange the top row with another row, if necessary, to bring a nonzero entry to the top of the column found in Step 1.   2 4 −10 6 12 28   The first and second rows in the preceding 0 −2 0 7 12 0 matrix were interchanged. 2 4 −5 6 −5 −1 Step 3. If the entry that is now at the top of the column found in Step 1 is a, multiply the first row by 1/a in order to introduce a leading 1.   1 2 −5 3 6 14   The first row of the preceding matrix was 0 −2 0 7 12 0 multiplied by 21 . 2 4 −5 6 −5 −1 Step 4. Add suitable multiples of the top row to the rows below so that all entries below the leading 1 become zeros.   1 2 −5 3 6 14   −2 times the first row of the preceding 0 −2 0 7 12 0 matrix was added to the third row. 0 0 5 0 −17 −29 Step 5. Now cover the top row in the matrix and begin again with Step 1 applied to the submatrix that remains. Continue in this way until the entire matrix is in row-echelon form.   1 2 −5 3 6 14   0 −2 0 7 12 0 0 0 5 0 −17 −29 Leftmost nonzero column in the submatrix



1

 0

2

−5

3

6

0

1

0

− 72 −17

 14  −6

−29  6 14 − 72 −6 

0  1 0 

0

5

0

2 0

−5 1

3 0

0

 1  0

0

0

2

−5

0

1

1  3 6 14  0 − 72 −6

0

0

0

0

0

1 2

1 2

The first row in the submatrix was multiplied by − 12 to introduce a leading 1.

−5 times the first row of the submatrix was added to the second row of the submatrix to introduce a zero below the leading 1.

The top row in the submatrix was covered, and we returned again to Step 1.

1 Leftmost nonzero column in the new submatrix

12 • • • Chapter 1 / Systems of Linear Equations and Matrices  1  0 0

2 −5 0 1 0 0

 3 6 14  0 − 72 −6 0 1 2

The first (and only) row in the new submatrix was multiplied by 2 to introduce a leading 1.

The entire matrix is now in row-echelon form. To find the reduced row-echelon form we need the following additional step. Step 6. Beginning with the last nonzero row and working upward, add suitable multiples of each row to the rows above to introduce zeros above the leading 1’s.   1 2 −5 3 6 14   7 0 1 0 0 1 2 times the third row of the preceding 0 matrix was added to the second row. 0 0 0 0 1 2   1 2 −5 3 0 2   −6 times the third row was added to the 0 1 0 0 1 0 first row. 0 0 0 0 1 2   1 2 0 3 0 7   5 times the second row was added to the 0 1 0 0 1 0 first row. 0 0 0 0 1 2 The last matrix is in reduced row-echelon form. If we use only the first five steps, the above procedure produces a row-echelon form and is called Gaussian elimination. Carrying the procedure through to the sixth step and producing a matrix in reduced row-echelon form is called Gauss–Jordan elimination. It can be shown that every matrix has a unique reduced row-echelon form; that is, one will arrive at the same reduced row-echelon form for a given matrix no matter how the row operations are varied. (A proof of this result can be found in the article “The Reduced Row Echelon Form of a Matrix Is Unique: A Simple Proof,” by Thomas Yuster, Mathematics Magazine, Vol. 57, No. 2, 1984, pp. 93–94.) In contrast, a row-echelon form of a given matrix is not unique: different sequences of row operations can produce different row-echelon forms.

REMARK.

EXAMPLE 4 Gauss–Jordan Elimination Solve by Gauss–Jordan elimination. + 2x5 = 0 x1 + 3x2 − 2x3 2x1 + 6x2 − 5x3 − 2x4 + 4x5 − 3x6 = −1 5x3 + 10x4 + 15x6 = 5 2x1 + 6x2 + 8x4 + 4x5 + 18x6 = 6 Solution. The augmented matrix for the system is  1 3 −2 0 2 6 −5 −2   0 5 10 0 2 6 0 8

2 4 0 4

0 −3 15 18

 0 −1   5 6

1.2

Karl Friedrich Gauss

Wilhelm Jordan

Karl Friedrich Gauss (1777–1855) was a German mathematician and scientist. Sometimes called the “prince of mathematicians,” Gauss ranks with Isaac Newton and Archimedes as one of the three greatest mathematicians who ever lived. In the entire history of mathematics there may never have been a child so precocious as Gauss—by his own account he worked out the rudiments of arithmetic before he could talk. One day, before he was even three years old, his genius became apparent to his parents in a very dramatic way. His father was preparing the weekly payroll for the laborers under his charge while the boy watched quietly from a corner. At the end of the long and tedious calculation, Gauss informed his father that there was an error in the result and stated the answer, which he had worked out in his head. To the astonishment of his parents, a check of the computations showed Gauss to be correct! In his doctoral dissertation Gauss gave the first complete proof of the fundamental theorem of algebra, which states that every polynomial equation has as many solutions as its degree. At age 19 he solved a problem that baffled Euclid, inscribing a regular polygon of seventeen sides in a circle using straightedge and compass; and in 1801, at age 24, he published his first masterpiece, Disquisitiones Arithmeticae, considered by many to be one of the most brilliant achievements in mathematics. In that paper Gauss systematized the study of number theory (properties of the integers) and formulated the basic concepts that form the foundation of the subject.

Gaussian Elimination

• • • 13

Among his myriad achievements, Gauss discovered the Gaussian or “bell-shaped” curve that is fundamental in probability, gave the first geometric interpretation of complex numbers and established their fundamental role in mathematics, developed methods of characterizing surfaces intrinsically by means of the curves that they contain, developed the theory of conformal (angle-preserving) maps, and discovered non-Euclidean geometry 30 years before the ideas were published by others. In physics he made major contributions to the theory of lenses and capillary action, and with Wilhelm Weber he did fundamental work in electromagnetism. Gauss invented the heliotrope, bifilar magnetometer, and an electrotelegraph. Gauss was deeply religious and aristocratic in demeanor. He mastered foreign languages with ease, read extensively, and enjoyed mineralogy and botany as hobbies. He disliked teaching and was usually cool and discouraging to other mathematicians, possibly because he had already anticipated their work. It has been said that if Gauss had published all of his discoveries, the current state of mathematics would be advanced by 50 years. He was without a doubt the greatest mathematician of the modern era. Wilhelm Jordan (1842–1899) was a German engineer who specialized in geodesy. His contribution to solving linear systems appeared in his popular book, Handbuch der Vermessungskunde (Handbook of Geodesy), in 1888.

Adding −2 times the first row to the second and fourth rows gives   1 3 −2 0 2 0 0 0 0 −1 −2 0 −3 −1     0 5 10 0 15 5 0 0 0 4 8 0 18 6 Multiplying the second row by −1 and then adding −5 times the new second row to the third row and −4 times the new second row to the fourth row gives   1 3 −2 0 2 0 0 0 0 1 2 0 3 1     0 0 0 0 0 0 0 0 0 0 0 0 6 2

14 • • • Chapter 1 / Systems of Linear Equations and Matrices Interchanging the third and fourth rows and then multiplying the third row of the resulting matrix by 16 gives the row-echelon form 

1 0   0 0

3 0 0 0

−2 1 0 0

0 2 0 0

2 0 0 0

0 3 1 0

 0 1  1  3 0

Adding −3 times the third row to the second row and then adding 2 times the second row of the resulting matrix to the first row yields the reduced row-echelon form   1 3 0 4 2 0 0 0 0 1 2 0 0 0    1 0  0 0 0 0 1 3 0 0 0 0 0 0 0 The corresponding system of equations is x1 + 3x2

+ 4x4 + 2x5 x3 + 2x4

=0 =0 x6 =

1 3

(We have discarded the last equation, 0x1 + 0x2 + 0x3 + 0x4 + 0x5 + 0x6 = 0, since it will be satisfied automatically by the solutions of the remaining equations.) Solving for the leading variables, we obtain x1 = −3x2 − 4x4 − 2x5 x3 = −2x4 x6 =

1 3

If we assign the free variables x2 , x4 , and x5 arbitrary values r, s, and t, respectively, the general solution is given by the formulas x1 = −3r − 4s − 2t, x2 = r, x3 = −2s, x4 = s, x5 = t, x6 =

1 3

Back-Substitution

It is sometimes preferable to solve a system of linear equations by using Gaussian elimination to bring the augmented matrix into row-echelon form without continuing all the way to the reduced row-echelon form. When this is done, the corresponding system of equations can be solved by a technique called backsubstitution. The next example illustates the idea.

EXAMPLE 5 Example 4 Solved by Back-Substitution From the computations in Example 4, a row-echelon form of the augmented matrix is   1 3 −2 0 2 0 0 0 0 1 2 0 3 1    1 0  0 0 0 0 1 3 0 0 0 0 0 0 0

1.2

Gaussian Elimination

• • • 15

To solve the corresponding system of equations + 2x5 =0 x1 + 3x2 − 2x3 + 3x6 = 1 x3 + 2x4 x6 =

1 3

we proceed as follows: Step 1.

Solve the equations for the leading variables. x1 = −3x2 + 2x3 − 2x5 x3 = 1 − 2x4 − 3x6 x6 =

1 3

Step 2. Beginning with the bottom equation and working upward, successively substitute each equation into all the equations above it. Substituting x6 =

1 3

into the second equation yields x1 = −3x2 + 2x3 − 2x5 x3 = −2x4 x6 =

1 3

Substituting x3 = −2x4 into the first equation yields x1 = −3x2 − 4x4 − 2x5 x3 = −2x4 x6 = Step 3.

1 3

Assign arbitrary values to the free variables, if any.

If we assign x2 , x4 , and x5 the arbitrary values r, s, and t, respectively, the general solution is given by the formulas x1 = −3r − 4s − 2t, x2 = r, x3 = −2s, x4 = s, x5 = t, x6 =

1 3

This agrees with the solution obtained in Example 4. The arbitrary values that are assigned to the free variables are often called parameters. Although we shall generally use the letters r, s, t, . . . for the parameters, any letters that do not conflict with the variable names may be used. REMARK.

EXAMPLE 6 Gaussian Elimination Solve x + y + 2z = 9 2x + 4y − 3z = 1 3x + 6y − 5z = 0 by Gaussian elimination and back-substitution.

16 • • • Chapter 1 / Systems of Linear Equations and Matrices Solution. This is the system in Example 3 of Section 1.1. augmented matrix  1 1 2  4 −3 2 3 6 −5 to the row-echelon form



1  0 0

1 1 0

2 − 27 1

In that example we converted the  9  1 0 9



 − 17 2  3

The system corresponding to this matrix is x + y + 2z =

9

=

− 17 2

z=

3

y−

7 z 2

Solving for the leading variables yields x = 9 − y − 2z + 27 z y = − 17 2 z=3 Substituting the bottom equation into those above yields x =3−y y=2 z=3 and substituting the second equation into the top yields x = 1, y = 2, z = 3. This agrees with the result found by Gauss–Jordan elimination in Example 3 of Section 1.1.

Homogeneous Linear Systems A system of linear equations is said to be homogeneous if the constant terms are all zero; that is, the system has the form a11 x1 + a12 x2 + · · · + a1n xn = 0 a21 x1 + a22 x2 + · · · + a2n xn = 0 .. .. .. .. . . . . am1 x1 + am2 x2 + · · · + amn xn = 0 Every homogeneous system of linear equations is consistent, since all such systems have x1 = 0, x2 = 0, . . . , xn = 0 as a solution. This solution is called the trivial solution; if there are other solutions, they are called nontrivial solutions. Because a homogeneous linear system always has the trivial solution, there are only two possibilities for its solutions: • The system has only the trivial solution. • The system has infinitely many solutions in addition to the trivial solution. In the special case of a homogeneous linear system of two equations in two unknowns, say a1 x + b1 y = 0 (a1 , b1 not both zero) a2 x + b2 y = 0 (a2 , b2 not both zero)

1.2 y a1x + b1 y = 0

x

Gaussian Elimination

• • • 17

the graphs of the equations are lines through the origin, and the trivial solution corresponds to the point of intersection at the origin (Figure 1.2.1). There is one case in which a homogeneous system is assured of having nontrivial solutions, namely, whenever the system involves more unknowns than equations. To see why, consider the following example of four equations in five unknowns.

EXAMPLE 7 Gauss–Jordan Elimination

a 2 x + b2 y = 0

(a) Only the trivial solution y

Solve the following homogeneous system of linear equations by using Gauss–Jordan elimination. + x5 = 0 2x1 + 2x2 − x3 −x1 − x2 + 2x3 − 3x4 + x5 = 0 (1) x1 + x2 − 2x3 − x5 = 0 x3 + x4 + x5 = 0

x

Solution. a1 x + b1 y = 0 and a2 x + b2 y = 0

(b) Infinitely many solutions Figure 1.2.1

The augmented matrix for the system is  2 2 −1 0 −1 −1 2 −3   1 −2 0  1 0 0 1 1

1 1 −1 1

 0 0   0 0

Reducing this matrix to reduced row-echelon form, we obtain   1 1 0 0 1 0 0 0 1 0 1 0     0 0 1 0 0 0 0 0 0 0 0 0 The corresponding system of equations is x1 + x2 x3

+ x5 = 0 + x5 = 0 x4 =0

(2)

Solving for the leading variables yields x1 = − x2 − x5 x3 = − x5 x4 =

0

Thus, the general solution is x1 = −s − t, x2 = s, x3 = −t, x4 = 0, x5 = t Note that the trivial solution is obtained when s = t = 0. Example 7 illustrates two important points about solving homogeneous systems of linear equations. First, none of the three elementary row operations alters the final column of zeros in the augmented matrix, so that the system of equations corresponding to the reduced row-echelon form of the augmented matrix must also be a homogeneous system [see system (2)]. Second, depending on whether the reduced row-echelon form of

18 • • • Chapter 1 / Systems of Linear Equations and Matrices the augmented matrix has any zero rows, the number of equations in the reduced system is the same as or less than the number of equations in the original system [compare systems (1) and (2)]. Thus, if the given homogeneous system has m equations in n unknowns with m < n, and if there are r nonzero rows in the reduced row-echelon form of the augmented matrix, we will have r < n. It follows that the system of equations corresponding to the reduced row-echelon form of the augmented matrix will have the form · · · x k1 + ( ) = 0 · · · xk2 + ( ) = 0 (3) .. . . . .. . . xkr + ( ) = 0 where xk1 , xk2 , . . . , xkr are the leading variables and ( ) denotes sums (possibly all different) that involve the n − r free variables [compare system (3) with system (2) above]. Solving for the leading variables gives xk1 = −( ) xk2 = −( ) .. . xkr = −( ) As in Example 7, we can assign arbitrary values to the free variables on the right-hand side and thus obtain infinitely many solutions to the system. In summary, we have the following important theorem.

Theorem 1.2.1 A homogeneous system of linear equations with more unknowns than equations has infinitely many solutions. Note that Theorem 1.2.1 applies only to homogeneous systems. A nonhomogeneous system with more unknowns than equations need not be consistent (Exercise 28); however, if the system is consistent, it will have infinitely many solutions. This will be proved later.

REMARK.

Computer Solution of Linear Systems

In applications it is not uncommon to encounter large linear systems that must be solved by computer. Most computer algorithms for solving such systems are based on Gaussian elimination or Gauss–Jordan elimination, but the basic procedures are often modified to deal with such issues as • Reducing roundoff errors • Minimizing the use of computer memory space • Solving the system with maximum speed Some of these matters will be considered in Chapter 9. For hand computations fractions are an annoyance that often cannot be avoided. However, in some cases it is possible to avoid them by varying the elementary row operations in the right way. Thus, once the methods of Gaussian elimination and Gauss–Jordan elimination have been mastered, the reader may wish to vary the steps in specific problems to avoid fractions (see Exercise 18).

Since Gauss–Jordan elimination avoids the use of back-substitution, it would seem that this method would be the more efficient of the two methods we have considered.

REMARK.

1.2

Gaussian Elimination

• • • 19

It can be argued that this statement is true when solving small systems by hand since Gauss–Jordan elimination actually involves less writing. However, for large systems of equations, it has been shown that the Gauss–Jordan elimination method requires about 50% more operations than Gaussian elimination. This is an important consideration when working on computers.

Exercise Set 1.2 1. Which of the following 3 × 3 matrices are in reduced row-echelon form?        1 0 0 1 0 1 0 0 1 0 0        (d) 0 0 (c) 0 0 1 (b) 0 1 0 (a) 0 1 0 0 0 0 0 0 0 0 0 0 0 1        0 0 1 0 2 1 1 0 0 1 0        (i) 0 0 (h) 0 1 3 (g) 0 1 0 (f ) 1 0 0 0 0 0 0 0 0 0 0 0 0 0 2. Which of the following 3 × 3 matrices are in row-echelon form?       1 0 0 1 2 0 1 0 0       (c) 0 1 0 (b) 0 1 0 (a) 0 1 0 0 2 0 0 0 0 0 0 1     1 2 3 1 5 −3     1 1 (f ) 0 0 0 (e) 0 0 0 1 0 0 0



1  (d) 0 0

 0  1 0  1  0 0

3 0 0



1  (e) 0 0  0  ( j) 0 0  4  1 0

3. In each part determine whether the matrix is in row-echelon form, reduced row-echelon form, both, or neither.     1 2 0 3 0   1 0 0 5 0 0 1 1 0 1 0 3 1     (c) (b) 0 0 1 3 (a)   0 0 0 0 1 0 1 2 4 0 1 0 4 0 0 0 0 0     1 3 0 2 0   0 0   1 −7 5 5   1 0 2 2 0  (f ) 0 0 (e)  (d)  0 0 0 0 1 0 1 3 2 0 0 0 0 0 0 0 4. In each part suppose that the augmented matrix for a system of linear equations has been reduced by row operations to the given reduced row-echelon form. Solve the system.     1 0 0 −7 8 1 0 0 −3     1 0 3 2 1 0 0 (b) 0 (a) 0 0 0 1 1 −5 0 0 1 7     1 −6 0 0 3 −2 1 −3 0 0  0 0 1 0 4 7    0 1 0 (d) 0 (c)   0 0 0 1 5 8 0 0 0 1 0 0 0 0 0 0

0 0 0 0 0 0

 0  0 1  0  0 0

20 • • • Chapter 1 / Systems of Linear Equations and Matrices 5. In each part suppose that the augmented matrix for a system of linear equations has been reduced by row operations to the given row-echelon form. Solve the system.     1 0 8 −5 6 1 −3 4 7     1 4 −9 3 1 2 2 (b) 0 (a) 0 0 0 1 5 0 0 1 1 2     1 7 −2 0 −8 −3 1 −3 7 1 0  0 1 1 6 5     1 4 0 (c)  (d) 0  0 0 0 1 3 9 0 0 0 1 0 0 0 0 0 0 6. Solve each of the following systems by Gauss–Jordan elimination. (a)

x1 + x2 + 2x3 = 8 −x1 − 2x2 + 3x3 = 1 3x1 − 7x2 + 4x3 = 10

(b)

2x1 + 2x2 + 2x3 = 0 −2x1 + 5x2 + 2x3 = 1 8x1 + x2 + 4x3 = −1

(c)

x − y + 2z − w 2x + y − 2z − 2w −x + 2y − 4z + w 3x − 3w

(d)

− 2b + 3c = 1 3a + 6b − 3c = −2 6a + 6b + 3c = 5

= −1 = −2 = 1 = −3

7. Solve each of the systems in Exercise 6 by Gaussian elimination. 8. Solve each of the following systems by Gauss–Jordan elimination. (a) 2x1 − 3x2 = −2 2x1 + x2 = 1 3x1 + 2x2 = 1 (c)

4x1 − 8x2 = 12 3x1 − 6x2 = 9 −2x1 + 4x2 = −6

(b)

3x1 5x1 3x1 −6x1

+ 2x2 + 3x2 + x2 − 4x2

(d) x 3x −2x x

+ + − −

10y 4y 2y 8y 6y

− x3 + 2x3 + 3x3 + 2x3

= −15 = 0 = 11 = 30

− 4z + w − z+ w + z + 2w + 2z − 2w + 3z

= 1 = 2 = 5 = −4 = 1

9. Solve each of the systems in Exercise 8 by Gaussian elimination. 10. Solve each of the following systems by Gauss–Jordan elimination. (a)

5x1 − 2x2 + 6x3 = 0 −2x1 + x2 + 3x3 = 1

(b) x1 − 2x2 + x3 − 4x4 = 1 x1 + 3x2 + 7x3 + 2x4 = 2 x1 − 12x2 − 11x3 − 16x4 = 5

(c)

w + 2x − y = 4 x− y=3 w + 3x − 2y = 7 2u + 4v + w + 7x =7

11. Solve each of the systems in Exercise 10 by Gaussian elimination. 12. Without using pencil and paper, determine which of the following homogeneous systems have nontrivial solutions. (a) 2x1 − 3x2 + 4x3 − x4 = 0 7x1 + x2 − 8x3 + 9x4 = 0 2x1 + 8x2 + x3 − x4 = 0

(b) x1 + 3x2 − x3 = 0 x2 − 8x3 = 0 4x3 = 0

(c) a11 x1 + a12 x2 + a13 x3 = 0 a21 x1 + a22 x2 + a23 x3 = 0

(d) 3x1 − 2x2 = 0 6x1 − 4x2 = 0

13. Solve the following homogeneous systems of linear equations by any method. (a) 2x1 + x2 + 3x3 = 0 x1 + 2x2 =0 x2 + x3 = 0

(b) 3x1 + x2 + x3 + x4 = 0 5x1 − x2 + x3 − x4 = 0

(c)

2x w 2w + 3x −2w + x

+ 2y − y + y + 3y

+ 4z = 0 − 3z = 0 + z=0 − 2z = 0

1.2

Gaussian Elimination

14. Solve the following homogeneous systems of linear equations by any method. (a) 2x − y − 3z = 0 −x + 2y − 3z = 0 x + y + 4z = 0

(b)

v 2u + v 2u + 3v −4u − 3v

+ 3w − 4w + 2w + 5w

− 2x + 3x − x − 4x

=0 =0 =0 =0

(c)

x1 + 3x2 x1 + 4x2 − 2x2 2x1 − 4x2 x1 − 2x2

+ x4 = 0 + 2x3 =0 − 2x3 − x4 = 0 + x3 + x4 = 0 − x3 + x4 = 0

15. Solve the following systems by any method. (a) 2I1 − I2 + 3I3 − 2I3 I1 3I1 − 3I2 + I3 2I1 + I2 + 4I3

+ 4I4 + 7I4 + 5I4 + 4I4

= 9 = 11 = 8 = 10

(b)

Z3 + Z4 + Z5 −Z1 − Z2 + 2Z3 − 3Z4 + Z5 Z1 + Z2 − 2Z3 − Z5 2Z1 + 2Z2 − Z3 + Z5

=0 =0 =0 =0

16. Solve the following systems, where a, b, and c are constants. (a) 2x + y = a 3x + 6y = b

(b)

x1 + x2 + x3 = a 2x1 + 2x3 = b 3x2 + 3x3 = c

17. For which values of a will the following system have no solutions? Exactly one solution? Infinitely many solutions? x + 2y −

3z = 4

3x − y +

5z = 2

4x + y + (a − 14)z = a + 2 2

18. Reduce



2  0  3

1 −2 4

 3  −29 5

to reduced row-echelon form without introducing any fractions. 19. Find two different row-echelon forms of

1 3 2 7 20. Solve the following system of nonlinear equations for the unknown angles α, β, and γ , where 0 ≤ α ≤ 2π , 0 ≤ β ≤ 2π, and 0 ≤ γ < π. 2 sin α − cos β + 3 tan γ = 3 4 sin α + 2 cos β − 2 tan γ = 2 6 sin α − 3 cos β + tan γ = 9 21. Show that the following nonlinear system has 18 solutions if 0 ≤ α ≤ 2π, 0 ≤ β ≤ 2π, and 0 ≤ γ < 2π. sin α + 2 cos β + 3 tan γ = 0 2 sin α + 5 cos β + 3 tan γ = 0 − sin α − 5 cos β + 5 tan γ = 0 22. For which value(s) of λ does the system of equations (λ − 3)x +

y=0

x + (λ − 3)y = 0 have nontrivial solutions?

• • • 21

22 • • • Chapter 1 / Systems of Linear Equations and Matrices 23. Solve the system 2x1 − x2

= λx1

2x1 − x2 + x3 = λx2 −2x1 + 2x2 + x3 = λx3 for x1 , x2 , and x3 in the two cases λ = 1, λ = 2. 24. Solve the following system for x, y, and z. 2 4 1 + − =1 x y z 3 8 2 + + =0 x y z −

1 9 10 =5 + + z x y

25. Find the coefficients a, b, c, and d so that the curve shown in the accompanying figure is the graph of the equation y = ax 3 + bx 2 + cx + d. 26. Find coefficients a, b, c, and d so that the curve shown in the accompanying figure is given by the equation ax 2 + ay 2 + bx + cy + d = 0. y (–2, 7)

y 20 (0, 10)

(–4, 5) (1, 7) x

–2

x

6 (3, –11) –20

(4, –14) (4, –3)

Figure Ex-25

Figure Ex-26

27. (a) Show that if ad − bc = 0, then the reduced row-echelon form of     1 0 a b is 0 1 c d (b) Use part (a) to show that the system ax + by = k cx + dy = l has exactly one solution when ad − bc = 0. 28. Find an inconsistent linear system that has more unknowns than equations.

Discussion and Discovery 29. Discuss the possible reduced row-echelon forms of   a b c   d e f  g h i 30. Consider the system of equations ax + by = 0 cx + dy = 0 ex + fy = 0

1.3

Matrices and Matrix Operations

• • • 23

Discuss the relative positions of the lines ax + by = 0, cx + dy = 0, and ex + fy = 0 when (a) the system has only the trivial solution, and (b) the system has nontrivial solutions. 31. Indicate whether the statement is always true or sometimes false. Justify your answer by giving a logical argument or a counterexample. (a) If a matrix is reduced to reduced row-echelon form by two different sequences of elementary row operations, the resulting matrices will be different. (b) If a matrix is reduced to row-echelon form by two different sequences of elementary row operations, the resulting matrices might be different. (c) If the reduced row-echelon form of the augmented matrix for a linear system has a row of zeros, then the system must have infinitely many solutions. (d) If three lines in the xy-plane are sides of a triangle, then the system of equations formed from their equations has three solutions, one corresponding to each vertex. 32. Indicate whether the statement is always true or sometimes false. Justify your answer by giving a logical argument or a counterexample. (a) A linear system of three equations in five unknowns must be consistent. (b) A linear system of five equations in three unknowns cannot be consistent. (c) If a linear system of n equations in n unknowns has n leading 1’s in the reduced rowechelon form of its augmented matrix, then the system has exactly one solution. (d) If a linear system of n equations in n unknowns has two equations that are multiples of one another, then the system is inconsistent.

1.3

MATRICES AND MATRIX OPERATIONS Rectangular arrays of real numbers arise in many contexts other than as augmented matrices for systems of linear equations. In this section we begin our study of matrix theory by giving some of the fundamental definitions of the subject. We shall see how matrices can be combined through the arithmetic operations of addition, subtraction, and multiplication.

Matrix Notation and Terminology In Section 1.2 we used rectangular arrays of numbers, called augmented matrices, to abbreviate systems of linear equations. However, rectangular arrays of numbers occur in other contexts as well. For example, the following rectangular array with three rows and seven columns might describe the number of hours that a student spent studying three subjects during a certain week:

Math History Language

Mon.

Tues.

Wed.

Thurs.

Fri.

Sat.

Sun.

2 0 4

3 3 1

2 1 3

4 4 1

1 3 0

4 2 0

2 2 2

If we suppress the headings, then we are left with the following rectangular array of numbers with three rows and seven columns called a “matrix”:   2 3 2 4 1 4 2   0 3 1 4 3 2 2 4 1 3 1 0 0 2

24 • • • Chapter 1 / Systems of Linear Equations and Matrices More generally, we make the following definition.

Definition A matrix is a rectangular array of numbers. The numbers in the array are called the entries in the matrix.

EXAMPLE 1 Examples of Matrices Some examples of matrices are   1 2  3 0, [2 1 0 −1 4



e  0 0

− 3],

π 1 2

0

√  − 2  1 , 0



1 , 3

[4]

The size of a matrix is described in terms of the number of rows (horizontal lines) and columns (vertical lines) it contains. For example, the first matrix in Example 1 has three rows and two columns, so its size is 3 by 2 (written 3 × 2). In a size description, the first number always denotes the number of rows and the second denotes the number of columns. The remaining matrices in Example 1 have sizes 1 × 4, 3 × 3, 2 × 1, and 1 × 1, respectively. A matrix with only one column is called a column matrix (or a column vector), and a matrix with only one row is called a row matrix (or a row vector). Thus, in Example 1 the 2 × 1 matrix is a column matrix, the 1 × 4 matrix is a row matrix, and the 1 × 1 matrix is both a row matrix and a column matrix. (The term vector has another meaning that we will discuss in subsequent chapters.) REMARK. It is common practice to omit the brackets on a 1 × 1 matrix. Thus, we might write 4 rather than [4]. Although this makes it impossible to tell whether 4 denotes the number “four” or the 1 × 1 matrix whose entry is “four,” this rarely causes problems, since it is usually possible to tell which is meant from the context in which the symbol appears.

We shall use capital letters to denote matrices and lowercase letters to denote numerical quantities; thus, we might write



2 1 7 a b c A= or C = 3 4 2 d e f When discussing matrices, it is common to refer to numerical quantities as scalars. Unless stated otherwise, scalars will be real numbers; complex scalars will be considered in Chapter 10. The entry that occurs in row i and column j of a matrix A will be denoted by aij . Thus, a general 3 × 4 matrix might be written as   a11 a12 a13 a14   A = a21 a22 a23 a24  a31 a32 a33 a34 and a general m × n matrix as



a11 a  21 A= .  ..

a12 a22 .. .

am1

am2

··· ··· ···

 a1n a2n   ..  .  amn

(1)

1.3

Matrices and Matrix Operations

• • • 25

When compactness of notation is desired, the preceding matrix can be written as [aij ]m×n or [aij ] the first notation being used when it is important in the discussion to know the size and the second when the size need not be emphasized. Usually, we shall match the letter denoting a matrix with the letter denoting its entries; thus, for a matrix B we would generally use bij for the entry in row i and column j and for a matrix C we would use the notation cij . The entry in row i and column j of a matrix A is also commonly denoted by the symbol (A)ij . Thus, for matrix (1) above, we have (A)ij = aij and for the matrix



2 A= 7



−3 0

we have (A)11 = 2, (A)12 = −3, (A)21 = 7, and (A)22 = 0. Row and column matrices are of special importance, and it is common practice to denote them by boldface lowercase letters rather than capital letters. For such matrices double subscripting of the entries is unnecessary. Thus, a general 1 × n row matrix a and a general m × 1 column matrix b would be written as   b1 b   2 a = [a1 a2 · · · an ] and b =  ..   .  bm A matrix A with n rows and n columns is called a square matrix of order n, and the shaded entries a11 , a22 , . . . , ann in (2) are said to be on the main diagonal of A.

    

a11 a21 .. . an1

a12 a22 .. . an2

··· ···

a1n a2n .. . · · · ann

    

(2)

Operations on Matrices

So far, we have used matrices to abbreviate the work in solving systems of linear equations. For other applications, however, it is desirable to develop an “arithmetic of matrices” in which matrices can be added, subtracted, and multiplied in a useful way. The remainder of this section will be devoted to developing this arithmetic.

Definition Two matrices are defined to be equal if they have the same size and their corresponding entries are equal.

In matrix notation, if A = [aij ] and B = [bij ] have the same size, then A = B if and only if (A)ij = (B)ij , or equivalently, aij = bij for all i and j .

26 • • • Chapter 1 / Systems of Linear Equations and Matrices EXAMPLE 2 Equality of Matrices Consider the matrices

1 , x

2 A= 3



2 B= 3

1 , 5



2 C= 3

1 4

0 0



If x = 5, then A = B, but for all other values of x the matrices A and B are not equal, since not all of their corresponding entries are equal. There is no value of x for which A = C since A and C have different sizes.

Definition If A and B are matrices of the same size, then the sum A + B is the matrix obtained by adding the entries of B to the corresponding entries of A, and the difference A − B is the matrix obtained by subtracting the entries of B from the corresponding entries of A. Matrices of different sizes cannot be added or subtracted.

In matrix notation, if A = [aij ] and B = [bij ] have the same size, then (A + B)ij = (A)ij + (B)ij = aij + bij and (A − B)ij = (A)ij − (B)ij = aij − bij

EXAMPLE 3 Addition and Subtraction Consider the matrices  2 1 0  0 2 A = −1 4 −2 7 Then



−2  A+B = 1 7

 3  4, 0

4 2 0

5 2 3



−4  B= 2 3

3 2 2

5 0 −4

 1  −1, 5

  4 6   3 and A − B = −3 5 1

−2 −2 −4



1 C= 2

1 2



 −5 2  2 5 11 −5

The expressions A + C, B + C, A − C, and B − C are undefined.

Definition If A is any matrix and c is any scalar, then the product cA is the matrix obtained by multiplying each entry of the matrix A by c. The matrix cA is said to be a scalar multiple of A.

In matrix notation, if A = [aij ], then (cA)ij = c(A)ij = caij

1.3

Matrices and Matrix Operations

• • • 27

EXAMPLE 4 Scalar Multiples For the matrices 2 A= 1 we have 2A =

3 3

4 , 1

4 6 8 , 2 6 2

B=

0 −1



(−1)B =

7 , −5

2 3

0 1

−2 −3

−7 , 5

C=

9 3

1 C 3

=

−6 0

3 1

3 12

−2 0

1 4

It is common practice to denote (−1)B by −B. If A1 , A2 , . . . , An are matrices of the same size and c1 , c2 , . . . , cn are scalars, then an expression of the form c1 A1 + c2 A2 + · · · + cn An is called a linear combination of A1 , A2 , . . . , An with coefficients c1 , c2 , . . . , cn . For example, if A, B, and C are the matrices in Example 4, then 2A − B + 13 C = 2A + (−1)B + 13 C

4 6 8 0 −2 = + 2 6 2 1 −3

−7 3 + 5 1

−2 0

1 7 = 4 4

2 3



2 11

is the linear combination of A, B, and C with scalar coefficients 2, −1, and 13 . Thus far we have defined multiplication of a matrix by a scalar but not the multiplication of two matrices. Since matrices are added by adding corresponding entries and subtracted by subtracting corresponding entries, it would seem natural to define multiplication of matrices by multiplying corresponding entries. However, it turns out that such a definition would not be very useful for most problems. Experience has led mathematicians to the following more useful definition of matrix multiplication.

Definition If A is an m × r matrix and B is an r × n matrix, then the product AB is the m × n matrix whose entries are determined as follows. To find the entry in row i and column j of AB, single out row i from the matrix A and column j from the matrix B. Multiply the corresponding entries from the row and column together and then add up the resulting products.

EXAMPLE 5 Multiplying Matrices Consider the matrices A=

1 2

2 6



4 , 0



4  B = 0 2

1 −1 7

4 3 5

 3  1 2

Since A is a 2 × 3 matrix and B is a 3 × 4 matrix, the product AB is a 2 × 4 matrix. To determine, for example, the entry in row 2 and column 3 of AB, we single out row 2 from A and column 3 from B. Then, as illustrated below, we multiply corresponding entries together and add up these products.

28 • • • Chapter 1 / Systems of Linear Equations and Matrices

1 2

2 6

 1

4 4  0 −1 0 2 7

4 3 5

  3   1 =  2

 26

 

(2 · 4) + (6 · 3) + (0 · 5) = 26 The entry in row 1 and column 4 of AB  1

4 1 2 4  0 −1 2 6 0 2 7

is computed as follows.   4 3   3 1 =  5 2

 13  

(1 · 3) + (2 · 1) + (4 · 2) = 13 The computations for the remaining products are (1 · 4) + (2 · 0) + (4 · 2) = 12 (1 · 1) − (2 · 1) + (4 · 7) = 27 (1 · 4) + (2 · 3) + (4 · 5) = 30 (2 · 4) + (6 · 0) + (0 · 2) = 8 (2 · 1) − (6 · 1) + (0 · 7) = −4 (2 · 3) + (6 · 1) + (0 · 2) = 12



12 AB = 8

27 −4

30 26

13 12



The definition of matrix multiplication requires that the number of columns of the first factor A be the same as the number of rows of the second factor B in order to form the product AB. If this condition is not satisfied, the product is undefined. A convenient way to determine whether a product of two matrices is defined is to write down the size of the first factor and, to the right of it, write down the size of the second factor. If, as in (3), the inside numbers are the same, then the product is defined. The outside numbers then give the size of the product.

A m × r

B AB r × n = m × n (3)

Inside Outside

EXAMPLE 6 Determining Whether a Product Is Defined Suppose that A, B, and C are matrices with the following sizes: A 3×4

B 4×7

C 7×3

Then by (3), AB is defined and is a 3 × 7 matrix; BC is defined and is a 4 × 3 matrix; and CA is defined and is a 7 × 4 matrix. The products AC, CB, and BA are all undefined.

In general, if A = [aij ] is an m × r matrix and B = [bij ] is an r × n matrix, then as illustrated by the shading in (4),

1.3



a11 a  21  .  .. AB =   ai1  .  .  .

a12 a22 .. . ai2 .. .

am1

am2

··· ··· ··· ···

Matrices and Matrix Operations

• • • 29



a1r a2r .. . air .. .

 b  11   b21  .  .  .   br 1

b12 b22 .. .

··· ···

b1 j b2 j .. .

br 2

···

br j

 · · · b1n · · · b2n   ..  .  · · · br n

(4)

amr

the entry (AB)ij in row i and column j of AB is given by (AB)ij = ai1 b1j + ai2 b2j + ai3 b3j + · · · + air brj

(5)

Partitioned Matrices

A matrix can be subdivided or partitioned into smaller matrices by inserting horizontal and vertical rules between selected rows and columns. For example, below are three possible partitions of a general 3 × 4 matrix A— the first is a partition of A into four submatrices A11 , A12 , A21 , and A22 ; the second is a partition of A into its row matrices r1 , r2 , and r3 ; and the third is a partition of A into its column matrices c1 , c2 , c3 , and c4 :   a11 a12 a13 a14

A11 A12   A = a21 a22 a23 a24  = A21 A22 a31 a32 a33 a34     a11 a12 a13 a14 r1     A = a21 a22 a23 a24  = r2  a31 a32 a33 a34 r3   a11 a12 a13 a14   A = a21 a22 a23 a24  = [c1 c2 c3 c4 ] a31 a32 a33 a34

Matrix Multiplication by Columns and by Rows Sometimes it may be desirable to find a particular row or column of a matrix product AB without computing the entire product. The following results, whose proofs are left as exercises, are useful for that purpose: j th column matrix of AB = A[j th column matrix of B]

(6)

ith row matrix of AB = [ith row matrix of A]B

(7)

EXAMPLE 7 Example 5 Revisited If A and B are the matrices in Example 5, then from (6) the second column matrix of AB can be obtained by the computation   1



1 2 4   27 −1 = 2 6 0 −4 7 ✻ Second column of B

✻ Second column of AB

30 • • • Chapter 1 / Systems of Linear Equations and Matrices and from (7) the first row matrix of AB can be obtained by the computation

[1 2

 4 1  4 ]0 −1 2 7

4 3 5

 3  1 = 2

[ 12 27 30 13 ]

First row of A

First row of AB

If a1 , a2 , . . . , am denote the row matrices of A and b1 , b2 , . . . , bn denote the column matrices of B, then it follows from Formulas (6) and (7) that AB = A[b1 b2 · · · bn ] = [Ab1 Ab2 · · · Abn ]

(8)

(AB computed column by column)

   a1 B a1 a B  a   2   2 AB =  .  B =  .   ..   ..  am B am 

(9)

(AB computed row by row)

Formulas (8) and (9) are special cases of a more general procedure for multiplying partitioned matrices (see Exercises 15–17).

REMARK.

Matrix Products as Linear Combinations Row and column matrices provide an alternative way of thinking about matrix multiplication. For example, suppose that     a11 a12 · · · a1n x1 a     21 a22 · · · a2n   x2  A= .  and x =  .  . . .. ..   ..  ..  am1 am2 · · · amn xn Then 

       a11 x1 + a12 x2 + · · · + a1n xn a11 a12 a1n a x + a x +···+ a x  a  a  a   21 1  21   22   2n  22 2 2n n  Ax =  .  = x1  .  +x2  .  +· · ·+xn  .  . . .. ..   ..  ..   ..   ..  am1 x1 + am2 x2 + · · · + amn xn am1 am2 amn (10) In words, (10) tells us that the product Ax of a matrix A with a column matrix x is a linear combination of the column matrices of A with the coefficients coming from the matrix x. In the exercises we ask the reader to show that the product yA of a 1 × m matrix y with an m × n matrix A is a linear combination of the row matrices of A with scalar coefficients coming from y.

1.3

Matrices and Matrix Operations

• • • 31

EXAMPLE 8 Linear Combinations The matrix product



−1   1 2

3 2 1

    2 2 1     −3 −1 = −9 −2 3 −3

can be written as the linear combination of column matrices         −1 3 2 1         2  1 − 1 2 + 3 −3 = −9 2 1 −2 −3 The matrix product [1



−9

−1  −3]  1 2

3 2 1

 2  −3 = [−16 −2

−18

35]

can be written as the linear combination of row matrices 1[−1

3

2] − 9[1

2

−3] − 3[2

1

−2] = [−16

−18

35]

It follows from (8) and (10) that the j th column matrix of a product AB is a linear combination of the column matrices of A with the coefficients coming from the j th column of B.

EXAMPLE 9 Columns of a Product AB as Linear Combinations We showed in Example 5 that 

4 1 2 4  AB = 0 2 6 0 2

1 −1 7

4 3 5

 3 12  1 = 8 2

27 −4

30 26

13 12



The column matrices of AB can be expressed as linear combinations of the column matrices of A as follows:







12 1 2 4 =4 +0 +2 8 2 6 0







27 1 2 4 = − +7 −4 2 6 0







30 1 2 4 =4 +3 +5 26 2 6 0







2 4 13 1 +2 =3 + 0 12 2 6

Matrix Form of a Linear System

Matrix multiplication has an important application to systems of linear equations. Consider any system of m linear equations in n unknowns. a11 x1 + a12 x2 + · · · + a1n xn = b1 a21 x1 + a22 x2 + · · · + a2n xn = b2 .. .. .. ... . . . am1 x1 + am2 x2 + · · · + amn xn = bm

32 • • • Chapter 1 / Systems of Linear Equations and Matrices Since two matrices are equal if and only if their corresponding entries are equal, we can replace the m equations in this system by the single matrix equation     b1 a11 x1 + a12 x2 + · · · + a1n xn  a x + a x + · · · + a x  b  22 2 2n n   2  21 1  .. .. ..  =  ..    .   . . . bm am1 x1 + am2 x2 + · · · + amn xn The m × 1 matrix on the left side of this equation can be written as a product to give      x1 b1 a11 a12 · · · a1n  x   b  a a · · · a 21 22 2n 2    2   .. .. ..   ..  =  ..   . . .  .   .  am1 am2 · · · amn xn bm If we designate these matrices by A, x, and b, respectively, the original system of m equations in n unknowns has been replaced by the single matrix equation Ax = b The matrix A in this equation is called the coefficient matrix of the system. The augmented matrix for the system is obtained by adjoining b to A as the last column; thus the augmented matrix is   a11 a12 · · · a1n b1  a  21 a22 · · · a2n b2  [A | b] =  .. .. .. ..   . . . .  am1 am2 · · · amn bm

Transpose of a Matrix We conclude this section by defining two matrix operations that have no analogs in the real numbers.

Definition If A is any m × n matrix, then the transpose of A, denoted by AT , is defined to be the n × m matrix that results from interchanging the rows and columns of A; that is, the first column of AT is the first row of A, the second column of AT is the second row of A, and so forth.

EXAMPLE 10 Some Transposes The following are some examples of matrices and their transposes.     2 3 a11 a12 a13 a14     B = 1 4, C = [1 3 5], D = [4] A = a21 a22 a23 a24 , a31 a32 a33 a34 5 6     a11 a21 a31 1

 a a a 2 1 5 22 32   12   AT =  BT = , C T = 3, D T = [4] , 3 4 6 a13 a23 a33  5 a14 a24 a34

1.3

Matrices and Matrix Operations

• • • 33

Observe that not only are the columns of AT the rows of A, but the rows of AT are columns of A. Thus, the entry in row i and column j of AT is the entry in row j and column i of A; that is, (AT )ij = (A)j i

(11)

Note the reversal of the subscripts. In the special case where A is a square matrix, the transpose of A can be obtained by interchanging entries that are symmetrically positioned about the main diagonal. In (12) it is shown that AT can also be obtained by “reflecting” A about its main diagonal.



1 −2  7 A= 3 −5 8

  4 1 −2   0 →  3 7 6 −5 8

  4 1   T 0 → A = −2 6 4

3 7 0

 −5  8 6

(12)

Interchange entries that are symmetrically positioned about the main diagonal.

Definition If A is a square matrix, then the trace of A, denoted by tr(A), is defined to be the sum of the entries on the main diagonal of A. The trace of A is undefined if A is not a square matrix.

EXAMPLE 11 Trace of a Matrix The following are examples of matrices and their traces.    −1 2 a11 a12 a13  3 5    B= A = a21 a22 a23 , 2  1 a31 a32 a33 4 −2 tr(A) = a11 + a22 + a33

tr(B) = −1 + 5 + 7 + 0 = 11

Exercise Set 1.3 1. Suppose that A, B, C, D, and E are matrices with the following sizes: A

B

C

D

E

(4 × 5)

(4 × 5)

(5 × 2)

(4 × 2)

(5 × 4)

Determine which of the following matrix expressions are defined. For those which are defined, give the size of the resulting matrix. (a) BA (e) E(A + B)

(b) AC + D (f ) E(AC)

(c) AE + B (g) E TA

(d) AB + B (h) (AT + E)D

 7 0 −8 4   7 −3 1 0

34 • • • Chapter 1 / Systems of Linear Equations and Matrices 2. Solve the following matrix equation for a, b, c, and d.     8 1 a−b b+c = 7 6 3d + c 2a − 4d 3. Consider the matrices    3 0 4   A = −1 2, B = 0 1 1

  −1 1 , C= 3 2

  1 2  , D = −1 5 3

4 1

5 0 2

  6 2   1, E = −1 4 4

Compute the following (where possible). (a) D + E (e) 2B − C (i) tr(D)

(b) D − E (f ) 4E − 2D ( j) tr(D − 3E)

(d) − 7C (h) A − A (l) tr(A)

(c) 5A (g) − 3(D + 2E) (k) 4 tr(7B)

4. Using the matrices in Exercise 3, compute the following (where possible). (a) 2AT + C (e) 21 C T − 41 A

(b) D T − E T (f ) B − B T

(c) (D − E)T (g) 2E T − 3D T

(d) B T + 5C T (h) (2E T − 3D T )T

5. Using the matrices in Exercise 3, compute the following (where possible). (a) AB (e) A(BC) (i) tr(DD T )

(b) BA (f ) CC T ( j) tr(4E T − D)

(c) (3E)D (g) (DA)T (k) tr(C TAT + 2E T )

(d) (AB)C (h) (C T B)AT

6. Using the matrices in Exercise 3, compute the following (where possible). (a) (2D T − E)A (d) (BAT − 2C)T 7. Let



3  A = 6 0

(b) (4B)C + 2B (e) B T(CC T − ATA)

(c) (−AC)T + 5D T (f ) D T E T − (ED)T

  6 7   4 and B = 0 7 9

−2 5 4

−2 1 7

 4  3 5

Use the method of Example 7 to find (a) the first row of AB (d) the first column of BA

(b) the third row of AB (e) the third row of AA

(c) the second column of AB (f ) the third column of AA

8. Let A and B be the matrices in Exercise 7. (a) Express each column matrix of AB as a linear combination of the column matrices of A. (b) Express each column matrix of BA as a linear combination of the column matrices of B. 9. Let

 y = [y1

y2

···

a11

a  21 ym ] and A =  .  .. am1

a12

···

a22 .. .

···

am2

···

a1n



a2n   ..  .  amn

Show that the product yA can be expressed as a linear combination of the row matrices of A with the scalar coefficients coming from y. 10. Let A and B be the matrices in Exercise 7. (a) Use the result in Exercise 9 to express each row matrix of AB as a linear combination of the row matrices of B. (b) Use the result in Exercise 9 to express each row matrix of BA as a linear combination of the row matrices of A.

1 1 1

 3  2 3

1.3

Matrices and Matrix Operations

11. Let C, D, and E be the matrices in Exercise 3. Using as few computations as possible, determine the entry in row 2 and column 3 of C(DE). 12. (a) Show that if AB and BA are both defined, then AB and BA are square matrices. (b) Show that if A is an m × n matrix and A(BA) is defined, then B is an n × m matrix. 13. In each part find matrices A, x, and b that express the given system of linear equations as a single matrix equation Ax = b. (a) 2x1 − 3x2 + 5x3 = 7 9x1 − x2 + x3 = −1 x1 + 5x2 + 4x3 = 0

− 3x3 + x4 (b) 4x1 5x1 + x2 − 8x4 2x1 − 5x2 + 9x3 − x4 3x2 − x3 + 7x4

=1 =3 =0 =2

14. In each part, express the matrix equation as a system of linear equations.           0 w 3 −2 0 1 x1 2 3 −1 2      5 0 2 −2   x  0        3 7 x2  = −1 (b)  (a)  4   =    3 1 4 7  y  0 4 −2 1 5 x3 0 z −2 5 1 6 15. If A and B are partitioned into submatrices, for example,     A11 A12 B11 B12 A= and B = A21 A22 B21 B22 then AB can be expressed as  A11 B11 + A12 B21 AB = A21 B11 + A22 B21

A11 B12 + A12 B22 A21 B12 + A22 B22



provided the sizes of the submatrices of A and B are such that the indicated operations can be performed. This method of multiplying partitioned matrices is called block multiplication. In each part compute the product by block multiplication. Check your results by multiplying directly.     4 2 1 −1 2 1 5 −3 5 2     4 2, (a) A =  0 −3 B=   7 −1 5 1 5 6 1 0 3 −3     4 2 1 −1 2 1 5 −3 5 2     (b) A =  0 −3 B= 4 2,   7 −1 5 1 5 6 1 0 3 −3 16. Adapt the method of Exercise 15 to compute the following products by block multiplication.     2 −5  1   2 −4  1 3 0 2 3 −4 3 −1 0 −3     2 −1 3 (b) (a)     0 5 0 5 1 5 7 2 1 4 5 1 −3 2 1 4 1 4    1 0 0 3 3 0 0 0  4 1 0 0 0    −1    5 0 1 0 0  1 (c) 0    0 0 0 2 0  2 −2 0

0

0

−1

2

1

6

• • • 35

36 • • • Chapter 1 / Systems of Linear Equations and Matrices 17. In each part determine whether block multiplication can be used to compute AB from the given partitions. If so, compute the product by block multiplication.     4 2 1 −1 2 1 5 −3 5 2     2, 4 (a) A =  0 −3 B=   7 −1 5 1 5 6 1 0 3 −3     1 4 2 −1 2 1 5 −3 5 2     4 2, (b) A =  0 −3 B=   7 −1 5 1 5 6 1 0 3 −3 18. (a) Show that if A has a row of zeros and B is any matrix for which AB is defined, then AB also has a row of zeros. (b) Find a similar result involving a column of zeros. 19. Let A be any m × n matrix and let 0 be the m × n matrix each of whose entries is zero. Show that if kA = 0, then k = 0 or A = 0. 20. Let I be the n × n matrix whose entry in row i and column j is 1 if i = j 0 if i = j Show that AI = I A = A for every n × n matrix A. 21. In each part find a 6 × 6 matrix [aij ] that satisfies the stated condition. Make your answers as general as possible by using letters rather than specific numbers for the nonzero entries. (a) aij = 0

if

i = j

(b) aij = 0

if

i>j

(c) aij = 0

if

i 1 j −1 (a) aij = i + j (b) aij = i (c) aij = −1 if |i − j | ≤ 1 23. Prove: If A and B are n × n matrices, then tr(A + B) = tr(A) + tr(B).

Discussion and Discovery 24. Describe three different methods for computing a matrix product, and illustrate the methods by computing some product AB three different ways. 25. How many 3 × 3 matrices A can you find such that     x+y x     A y  = x − y  0 z for all choices of x, y, and z? 26. How many 3 × 3 matrices A can you find such that     xy x     A y  =  0  0 z for all choices of x, y, and z? 27. A matrix B is said to be a square root of a matrix A if BB = A.   2 2 . (a) Find two square roots of A = 2 2

if

|i − j | > 1

1.4 

5 (b) How many different square roots can you find of A = 0

Inverses; Rules of Matrix Arithmetic

• • • 37

 0 ? 9

(c) Do you think that every 2×2 matrix has at least one square root? Explain your reasoning. 28. Let 0 denote a 2 × 2 matrix, each of whose entries is zero. (a) Is there a 2 × 2 matrix A such that A = 0 and AA = 0 ? Justify your answer. (b) Is there a 2 × 2 matrix A such that A = 0 and AA = A? Justify your answer. 29. Indicate whether the statement is always true or sometimes false. Justify your answer with a logical argument or a counterexample. (a) (b) (c) (d)

The expressions tr(AAT ) and tr(ATA) are always defined, regardless of the size of A. tr(AAT ) = tr(ATA) for every matrix A. If the first column of A has all zeros, then so does the first column of every product AB. If the first row of A has all zeros, then so does the first row of every product AB.

30. Indicate whether the statement is always true or sometimes false. Justify your answer with a logical argument or a counterexample. (a) If A is a square matrix with two identical rows, then AA has two identical rows. (b) If A is a square matrix and AA has a column of zeros, then A must have a column of zeros. (c) If B is an n × n matrix whose entries are positive even integers, and if A is an n × n matrix whose entries are positive integers, then the entries of AB and BA are positive even integers. (d) If the matrix sum AB + BA is defined, then A and B must be square.

1.4

INVERSES; RULES OF MATRIX ARITHMETIC In this section we shall discuss some properties of the arithmetic operations on matrices. We shall see that many of the basic rules of arithmetic for real numbers also hold for matrices but a few do not.

Properties of Matrix Operations

For real numbers a and b, we always have ab = ba, which is called the commutative law for multiplication. For matrices, however, AB and BA need not be equal. Equality can fail to hold for three reasons: It can happen that the product AB is defined but BA is undefined. For example, this is the case if A is a 2 × 3 matrix and B is a 3 × 4 matrix. Also, it can happen that AB and BA are both defined but have different sizes. This is the situation if A is a 2 × 3 matrix and B is a 3 × 2 matrix. Finally, as Example 1 shows, it is possible to have AB = BA even if both AB and BA are defined and have the same size.

EXAMPLE 1 AB and BA Need Not Be Equal Consider the matrices

Multiplying gives



−1 A= 2

−1 AB = 11 Thus, AB = BA.

0 , 3

−2 , 4



1 B= 3

2 0

3 BA = −3





6 0

38 • • • Chapter 1 / Systems of Linear Equations and Matrices Although the commutative law for multiplication is not valid in matrix arithmetic, many familiar laws of arithmetic are valid for matrices. Some of the most important ones and their names are summarized in the following theorem.

Theorem 1.4.1

Properties of Matrix Arithmetic

Assuming that the sizes of the matrices are such that the indicated operations can be performed, the following rules of matrix arithmetic are valid. (a) (b) (c) (d ) (e) (f) (g) (h) (i)

A+B =B +A A + (B + C) = (A + B) + C A(BC) = (AB)C A(B + C) = AB + AC (B + C)A = BA + CA A(B − C) = AB − AC (B − C)A = BA − CA a(B + C) = aB + aC a(B − C) = aB − aC

(Commutative law for addition) (Associative law for addition) (Associative law for multiplication) (Left distributive law) (Right distributive law)

( j) (k) (l ) (m)

(a + b)C = aC + bC (a − b)C = aC − bC a(bC) = (ab)C a(BC) = (aB)C = B(aC)

To prove the equalities in this theorem we must show that the matrix on the left side has the same size as the matrix on the right side and that corresponding entries on the two sides are equal. With the exception of the associative law in part (c), the proofs all follow the same general pattern. We shall prove part (d ) as an illustration. The proof of the associative law, which is more complicated, is outlined in the exercises. Proof (d ). We must show that A(B + C) and AB + AC have the same size and that corresponding entries are equal. To form A(B + C), the matrices B and C must have the same size, say m × n, and the matrix A must then have m columns, so its size must be of the form r × m. This makes A(B + C) an r × n matrix. It follows that AB + AC is also an r × n matrix and, consequently, A(B + C) and AB + AC have the same size. Suppose that A = [aij ], B = [bij ], and C = [cij ]. We want to show that corresponding entries of A(B + C) and AB + AC are equal; that is, [A(B + C)]ij = [AB + AC]ij for all values of i and j . But from the definitions of matrix addition and matrix multiplication we have [A(B + C)]ij = ai1 (b1j + c1j ) + ai2 (b2j + c2j ) + · · · + aim (bmj + cmj ) = (ai1 b1j + ai2 b2j + · · · + aim bmj ) + (ai1 c1j + ai2 c2j + · · · + aim cmj ) = [AB]ij + [AC]ij = [AB + AC]ij

Although the operations of matrix addition and matrix multiplication were defined for pairs of matrices, associative laws (b) and (c) enable us to denote sums and products of three matrices as A + B + C and ABC without inserting any parentheses. This is justified by the fact that no matter how parentheses are inserted, the associative laws guarantee that the same end result will be obtained. In general, given any sum or any product of matrices, pairs of parentheses can be inserted or deleted anywhere within the expression without affecting the end result.

REMARK.

1.4

Inverses; Rules of Matrix Arithmetic

• • • 39

EXAMPLE 2 Associativity of Matrix Multiplication As an illustration of the associative law for matrix multiplication, consider   1 2



4 3 1 0   A = 3 4, B= , C= 2 1 2 3 0 1 Then



1  AB = 3 0

 2  4 4 2 1

Thus,

 8 5 3 4   = 20 13 and BC = 1 2 2 1





 8 5   1 (AB)C = 20 13 2 2 1

and



1  A(BC) = 3 0

 2  10 4 4 1





1 2



 15  39 3



 15  39 3

18 0  = 46 3 4



3 1

18 9  = 46 3 4

0 10 = 3 4

9 3

so (AB)C = A(BC), as guaranteed by Theorem 1.4.1c.

Zero Matrices A matrix, all of whose entries are zero, such as

0 0

0 , 0



0  0 0

0 0 0



0  0 , 0



0 0

0 0

0 0



0 , 0

  0 0    , 0 0

[0]

is called a zero matrix. A zero matrix will be denoted by 0; if it is important to emphasize the size, we shall write 0m×n for the m × n zero matrix. Moreover, in keeping with our convention of using boldface symbols for matrices with one column, we will denote a zero matrix with one column by 0. If A is any matrix and 0 is the zero matrix with the same size, it is obvious that A + 0 = 0 + A = A. The matrix 0 plays much the same role in these matrix equations as the number 0 plays in the numerical equations a + 0 = 0 + a = a. Since we already know that some of the rules of arithmetic for real numbers do not carry over to matrix arithmetic, it would be foolhardy to assume that all the properties of the real number zero carry over to zero matrices. For example, consider the following two standard results in the arithmetic of real numbers. • If ab = ac and a = 0, then b = c. (This is called the cancellation law.) • If ad = 0, then at least one of the factors on the left is 0. As the next example shows, the corresponding results are not generally true in matrix arithmetic.

40 • • • Chapter 1 / Systems of Linear Equations and Matrices EXAMPLE 3 The Cancellation Law Does Not Hold Consider the matrices

0 1 A= , 0 2



1 , 4

1 B= 3

You should verify that



3 AB = AC = 6

4 8





2 C= 3

5 , 4

0 and AD = 0



3 D= 0

0 0

7 0





Thus, although A = 0, it is incorrect to cancel the A from both sides of the equation AB = AC and write B = C. Also, AD = 0, yet A = 0 and D = 0. Thus, the cancellation law is not valid for matrix multiplication, and it is possible for a product of matrices to be zero without either factor being zero. In spite of the above example, there are a number of familiar properties of the real number 0 that do carry over to zero matrices. Some of the more important ones are summarized in the next theorem. The proofs are left as exercises.

Theorem 1.4.2

Properties of Zero Matrices

Assuming that the sizes of the matrices are such that the indicated operations can be performed, the following rules of matrix arithmetic are valid. (a) (b) (c) (d )

A+0=0+A=A A−A=0 0 − A = −A A0 = 0; 0A = 0

Identity Matrices Of special interest are square matrices with 1’s on the main diagonal and 0’s off the main diagonal, such as    1 1 0 0

0 1 0    ,  0 1 0, 0 1 0 0 0 1 0

0 1 0 0

0 0 1 0

 0 0  , 0 1

and so on.

A matrix of this form is called an identity matrix and is denoted by I . If it is important to emphasize the size, we shall write In for the n × n identity matrix. If A is an m × n matrix, then, as illustrated in the next example, AIn = A and Im A = A Thus, an identity matrix plays much the same role in matrix arithmetic as the number 1 plays in the numerical relationships a · 1 = 1 · a = a.

EXAMPLE 4 Multiplication by an Identity Matrix Consider the matrix

A=

a11 a21

a12 a22

a13 a23



Then

I2 A =

1 0

0 1

1.4

Inverses; Rules of Matrix Arithmetic

a11 a21

a12 a22



and



1 a13  0 a23 0

a12 a22

a11 AI3 = a21

a13 a11 = a23 a21 0 1 0

a12 a22

 0 a11  0 = a21 1

• • • 41

a13 =A a23

a13 =A a23

a12 a22

As the next theorem shows, identity matrices arise naturally in studying reduced row-echelon forms of square matrices.

Theorem 1.4.3 If R is the reduced row-echelon form of an n × n matrix A, then either R has a row of zeros or R is the identity matrix In . Proof. Suppose that the reduced row-echelon form of A is   r11 r12 · · · r1n r   21 r22 · · · r2n  R= .  . . .. ..   .. rn1 rn2 · · · rnn Either the last row in this matrix consists entirely of zeros or it does not. If not, the matrix contains no zero rows, and consequently each of the n rows has a leading entry of 1. Since these leading 1’s occur progressively further to the right as we move down the matrix, each of these 1’s must occur on the main diagonal. Since the other entries in the same column as one of these 1’s are zero, R must be In . Thus, either R has a row of zeros or R = In .

Definition If A is a square matrix, and if a matrix B of the same size can be found such that AB = BA = I , then A is said to be invertible and B is called an inverse of A. If no such matrix B can be found, then A is said to be singular.

EXAMPLE 5 Verifying the Inverse Requirements The matrix

B=

3 1

since

5 2



is an inverse of A =



−5 3

2 AB = −1 and

BA =

3 1

5 2



3 1

2 −1

2 −1



−5 3

1 5 = 2 0

0 =I 1

−5 1 = 3 0

0 =I 1

42 • • • Chapter 1 / Systems of Linear Equations and Matrices EXAMPLE 6 A Matrix with No Inverse The matrix



1  A = 2 3 is singular. To see why, let



b11  B = b21 b31

 0  0 0

4 5 6

 b13  b23  b33

b12 b22 b32

be any 3 × 3 matrix. The third column of BA is      b11 b12 b13 0 0      b b b 0  21 23    = 0 22 0 0 b31 b32 b33 Thus,



1  BA = I = 0 0

0 1 0

 0  0 1

Properties of Inverses It is reasonable to ask whether an invertible matrix can have more than one inverse. The next theorem shows that the answer is no—an invertible matrix has exactly one inverse.

Theorem 1.4.4 If B and C are both inverses of the matrix A, then B = C. Proof. Since B is an inverse of A, we have BA = I . Multiplying both sides on the right by C gives (BA)C = I C = C. But (BA)C = B(AC) = BI = B, so that C = B.

As a consequence of this important result, we can now speak of “the” inverse of an invertible matrix. If A is invertible, then its inverse will be denoted by the symbol A−1 . Thus, AA−1 = I and A−1 A = I The inverse of A plays much the same role in matrix arithmetic that the reciprocal a −1 plays in the numerical relationships aa −1 = 1 and a −1 a = 1. In the next section we shall develop a method for finding inverses of invertible matrices of any size; however, the following theorem gives conditions under which a 2 × 2 matrix is invertible and provides a simple formula for the inverse.

1.4

Inverses; Rules of Matrix Arithmetic

• • • 43

Theorem 1.4.5 The matrix



a c

A=

b d



is invertible if ad − bc = 0, in which case the inverse is given by the formula   b d

−  ad − bc d −b 1 ad − bc   A−1 = =   a ad − bc −c c a − ad − bc ad − bc Proof. We leave it for the reader to verify that AA−1 = I2 and A−1 A = I2 .

Theorem 1.4.6 If A and B are invertible matrices of the same size, then AB is invertible and (AB)−1 = B −1 A−1 Proof. If we can show that (AB)(B −1 A−1 ) = (B −1 A−1 )(AB) = I , then we will have simultaneously shown that the matrix AB is invertible and that (AB)−1 = B −1 A−1 . But (AB)(B −1 A−1 ) = A(BB −1 )A−1 = AIA−1 = AA−1 = I . A similar argument shows that (B −1 A−1 )(AB) = I . Although we will not prove it, this result can be extended to include three or more factors; that is, A product of any number of invertible matrices is invertible, and the inverse of the product is the product of the inverses in the reverse order.

EXAMPLE 7 Inverse of a Product Consider the matrices



A=

1 1

2 , 3

B=

3 2

2 , 2

Applying the formula in Theorem 1.4.5, we obtain  

1 −1 3 −2 −1 −1 A = , B = 3 , −1 1 −1 2 Also,



B

−1

A

−1

1 = −1

 −1 3 3 −1 2



7 9

AB =

6 8



 (AB)

−1

 4 −2 = 1 − 29

=

4

−3

− 29

7 2



 −3 7 2

Therefore, (AB)−1 = B −1 A−1 as guaranteed by Theorem 1.4.6.

Powers of a Matrix discuss their properties.

Next, we shall define powers of a square matrix and

44 • • • Chapter 1 / Systems of Linear Equations and Matrices Definition If A is a square matrix, then we define the nonnegative integer powers of A to be A0 = I

An = AA · · · A 

(n > 0)

n factors

Moreover, if A is invertible, then we define the negative integer powers to be A−n = (A−1 )n = A−1 A−1 · · · A−1 n factors

Because this definition parallels that for real numbers, the usual laws of exponents hold. (We omit the details.)

Theorem 1.4.7

Laws of Exponents

If A is a square matrix and r and s are integers, then ArAs = Ar+s ,

(Ar )s = Ars

The next theorem provides some useful properties of negative exponents.

Theorem 1.4.8

Laws of Exponents

If A is an invertible matrix, then: (a) A−1 is invertible and (A−1 )−1 = A. (b) An is invertible and (An )−1 = (A−1 )n for n = 0, 1, 2, . . . . 1 (c) For any nonzero scalar k, the matrix kA is invertible and (kA)−1 = A−1 . k Proof. (a) Since AA−1 = A−1 A = I , the matrix A−1 is invertible and (A−1 )−1 = A. (b) This part is left as an exercise. (c) If k is any nonzero scalar, results (l) and (m) of Theorem 1.4.1 enable us to write     1 −1 1 1 −1 (kA) = (kA)A = k AA−1 = (1)I = I A k k k   1 −1 1 Similarly, (kA) = I so that kA is invertible and (kA)−1 = A−1 . A k k

EXAMPLE 8 Powers of a Matrix Let A and A−1 be as in Example 7, that is,

1 2 A= and 1 3

A−1 =



3 −1

−2 1



1.4 Then



1 1

A3 =

−3

A

3 = (A ) = −1 −1 3

2 3

Inverses; Rules of Matrix Arithmetic





1 2 1 2 11 30 = 1 3 1 3 15 41





−2 3 −2 3 −2 41 = 1 −1 1 −1 1 −15

• • • 45





−30 11

Polynomial Expressions Involving Matrices If A is a square matrix, say m × m, and if

p(x) = a0 + a1 x + · · · + an x n

(1)

is any polynomial, then we define p(A) = a0 I + a1 A + · · · + an An where I is the m × m identity matrix. In words, p(A) is the m × m matrix that results when A is substituted for x in (1) and a0 is replaced by a0 I .

EXAMPLE 9 Matrix Polynomial If



−1 p(x) = 2x − 3x + 4 and A = 0 2

then



2 = 0

8 −3 − 18 0



2

−1 2 −1 2 1 −3 +4 0 3 0 3 0





6 4 0 9 2 + = 9 0 4 0 13

p(A) = 2A2 − 3A + 4I = 2

2 3

0 1



Properties of the Transpose The next theorem lists the main properties of the transpose operation.

Theorem 1.4.9

Properties of the Transpose

If the sizes of the matrices are such that the stated operations can be performed, then (a) (b) (c) (d)

((A)T )T = A (A + B)T = AT + B T and (A − B)T = AT − B T (kA)T = kAT , where k is any scalar (AB)T = B TAT

Keeping in mind that transposing a matrix interchanges its rows and columns, parts (a), (b), and (c) should be self-evident. For example, part (a) states that interchanging rows and columns twice leaves a matrix unchanged; part (b) asserts that adding and then interchanging rows and columns yields the same result as first interchanging rows and columns, then adding; and part (c) asserts that multiplying by a scalar and then interchanging rows and columns yields the same result as first interchanging rows and columns, then multiplying by the scalar. Part (d ) is not so obvious, so we give its proof.

46 • • • Chapter 1 / Systems of Linear Equations and Matrices Proof (d ). Let A = [aij ]m×r and B = [bij ]r×n so that the products AB and B TAT can both be formed. We leave it for the reader to check that (AB)T and B TAT have the same size, namely n × m. Thus, it only remains to show that corresponding entries of (AB)T and B TAT are the same; that is,   (AB)T ij = (B TAT )ij (2) Applying Formula (11) of Section 1.3 to the left side of this equation and using the definition of matrix multiplication, we obtain   (AB)T ij = (AB)j i = aj 1 b1i + aj 2 b2i + · · · + aj r bri (3) To evaluate the right side of (2) it will be convenient to let aij and bij denote the ij th entries of AT and B T , respectively, so aij = aj i and

bij = bj i

From these relationships and the definition of matrix multiplication we obtain       (B TAT )ij = bi1 a1j + bi2 a2j + · · · + bir arj

= b1i aj 1 + b2i aj 2 + · · · + bri aj r = aj 1 b1i + aj 2 b2i + · · · + aj r bri This, together with (3), proves (2). Although we shall not prove it, part (d ) of this theorem can be extended to include three or more factors; that is, The transpose of a product of any number of matrices is equal to the product of their transposes in the reverse order. Note the similarity between this result and the result following Theorem 1.4.6 about the inverse of a product of matrices.

REMARK.

Invertibility of a Transpose The following theorem establishes a relationship between the inverse of an invertible matrix and the inverse of its transpose.

Theorem 1.4.10 If A is an invertible matrix, then AT is also invertible and (AT )−1 = (A−1 )T Proof. We can prove the invertibility of AT and obtain (4) by showing that AT(A−1 )T = (A−1 )TAT = I But from part (d ) of Theorem 1.4.9 and the fact that I T = I we have AT(A−1 )T = (A−1 A)T = I T = I (A−1 )TAT = (AA−1 )T = I T = I which completes the proof.

(4)

1.4

Inverses; Rules of Matrix Arithmetic

• • • 47

EXAMPLE 10 Verifying Theorem 1.4.10 Consider the matrices

−5 A= 2

−3 , 1



−5 A = −3

2 1

T

Applying Theorem 1.4.5 yields

1 1 3 A−1 = , (A−1 )T = 3 −2 −5

−2 , −5



(AT )−1 =



1 3

As guaranteed by Theorem 1.4.10, these matrices satisfy (4).

Exercise Set 1.4 1. Let



−1 4 1

2  A= 0 −2

 3  5, 4



 −5  2 , 6

−3 1 −7

8  B = 0 4



0  C = 1 3

−2 7 5

 3  4, 9

a = 4,

Show that (a) A + (B + C) = (A + B) + C (d) a(B − C) = aB − aC

(b) (AB)C = A(BC)

(c) (a + b)C = aC + bC

2. Using the matrices and scalars in Exercise 1, verify that (a) a(BC) = (aB)C = B(aC) (d) a(bC) = (ab)C

(b) A(B − C) = AB − AC

(c) (B + C)A = BA + CA

3. Using the matrices and scalars in Exercise 1, verify that (a) (AT )T = A

(b) (A + B)T = AT + B T

(c) (aC)T = aC T

4. Use Theorem 1.4.5 to compute the inverses of the following matrices.       6 4 2 −3 3 1 (c) C = (b) B = (a) A = −2 −1 4 4 5 2 5. Use the matrices A and B in Exercise 4 to verify that (a) (A−1 )−1 = A

(b) (B T )−1 = (B −1 )T

6. Use the matrices A, B, and C in Exercise 4 to verify that (a) (AB)−1 = B −1 A−1

(b) (ABC)−1 = C −1 B −1 A−1

7. In each part use the given information to find A.     2 −1 −3 7 −1 −1 (b) (7A) = (a) A = 3 5 1 −2 

T −1

(c) (5A )

−3 = 5

 −1 2

−1

(d) (I + 2A)

8. Let A be the matrix   2 0 4 1 Compute A3 , A−3 , and A2 − 2A + I .

 −1 = 4



2 5

(d) (AB)T = B TAT 

2 (d) C = 0

0 3



b = −7

−2 −5



48 • • • Chapter 1 / Systems of Linear Equations and Matrices 9. Let A be the matrix   3 1 2 1 In each part find p(A). (b) p(x) = 2x 2 − x + 1

(a) p(x) = x − 2

(c) p(x) = x 3 − 2x + 4

10. Let p1 (x) = x 2 − 9, p2 (x) = x + 3, and p3 (x) = x − 3. (a) Show that p1 (A) = p2 (A)p3 (A) for the matrix A in Exercise 9. (b) Show that p1 (A) = p2 (A)p3 (A) for any square matrix A. 11. Find the inverse of   cos θ sin θ − sin θ cos θ 12. Find the inverse of  1 x (e + e−x ) 2  1 x (e − e−x ) 2 13. Consider the matrix  a11 0  A= .  .. 0

0 a22 .. . 0



1 x (e 2

− e−x )

1 x (e 2

+ e−x )

··· ··· ···



0 0 .. .

    

ann

where a11 a22 · · · ann = 0. Show that A is invertible and find its inverse. 14. Show that if a square matrix A satisfies A2 − 3A + I = 0, then A−1 = 3I − A. 15. (a) Show that a matrix with a row of zeros cannot have an inverse. (b) Show that a matrix with a column of zeros cannot have an inverse. 16. Is the sum of two invertible matrices necessarily invertible? 17. Let A and B be square matrices such that AB = 0. Show that if A is invertible, then B = 0. 18. Let A, B, and 0 be 2 × 2 matrices. Assuming that A is invertible, find a matrix C so that   0 A−1 C A−1 is the inverse of the partitioned matrix   A 0 B A (See Exercise 15 of the preceding section.) 19. Use the result in Exercise 18 to find the inverses of the following matrices.     1 1 0 0 1 1 0 0 0 1 0 0 −1 1 0 0     (b)  (a)    0 0 1 1  1 1 1 1 0 0 0 1 1 1 −1 1 20. (a) Find a nonzero 3 × 3 matrix A such that AT = A. (b) Find a nonzero 3 × 3 matrix A such that AT = −A. 21. A square matrix A is called symmetric if AT = A and skew-symmetric if AT = −A. Show that if B is a square matrix, then (a) BB T and B + B T are symmetric

(b) B − B T is skew-symmetric

1.4

Inverses; Rules of Matrix Arithmetic

22. If A is a square matrix and n is a positive integer, is it true that (An )T = (AT )n ? Justify your answer. 23. Let A be the matrix   1 0 1   1 1 0  0 1 1 Determine whether A is invertible, and if so, find its inverse. [Hint. Solve AX = I by equating corresponding entries on the two sides.] 24. Prove: (a) part (b) of Theorem 1.4.1

(b) part (i ) of Theorem 1.4.1

(c) part (m) of Theorem 1.4.1

25. Apply parts (d ) and (m) of Theorem 1.4.1 to the matrices A, B, and (−1)C to derive the result in part ( f ). 26. Prove Theorem 1.4.2. 27. Consider the laws of exponents ArAs = Ar+s and (Ar )s = Ars . (a) Show that if A is any square matrix, these laws are valid for all nonnegative integer values of r and s. (b) Show that if A is invertible, these laws hold for all negative integer values of r and s. 28. Show that if A is invertible and k is any nonzero scalar, then (kA)n = k n An for all integer values of n. 29. (a) Show that if A is invertible and AB = AC, then B = C. (b) Explain why part (a) and Example 3 do not contradict one another. 30. Prove part (c) of Theorem 1.4.1. [Hint. Assume that A is m × n, B is n × p, and C is p × q. The ij th entry on the left side is lij = ai1 [BC]1j + ai2 [BC]2j + · · · + ain [BC]nj and the ij th entry on the right side is rij = [AB]i1 c1j + [AB]i2 c2j + · · · + [AB]ip cpj . Verify that lij = rij .]

Discussion and Discovery 31. Let A and B be square matrices with the same size. (a) Give an example in which (A + B)2 = A2 + 2AB + B 2 . (b) Fill in the blank to create a matrix identity that is valid for all choices of A and B. (A + B)2 = A2 + B 2 + . 32. Let A and B be square matrices with the same size. (a) Give an example in which (A + B)(A − B) = A2 − B 2 . (b) Let A and B be square matrices with the same size. Fill in the blank to create a matrix identity that is valid for all choices of A and B. (A + B)(A − B) = . 33. In the real number system the equation a 2 = 1 has exactly two solutions. Find at least eight different 3 × 3 matrices that satisfy the equation A2 = I3 . [Hint. Look for solutions in which all entries off the main diagonal are zero.] 34. A statement of the form “If p, then q” is logically equivalent to the statement “If not q, then not p.” (The second statement is called the logical contrapositive of the first.) For example, the logical contrapositive of the statement “If it is raining, then the ground is wet” is “If the ground is not wet, then it is not raining.” (a) Find the logical contrapositive of the following statement: If AT is singular, then A is singular. (b) Is the statement true or false? Explain. 35. Let A and B be n × n matrices. Indicate whether the statement is true or false. Justify each answer. (a) (AB)2 = A2 B 2 must be true. (c) (AB −1 )(BA−1 ) = In must be true.

(b) (A − B)2 = (B − A)2 must be true. (d) It is never true that AB = BA.

• • • 49

50 • • • Chapter 1 / Systems of Linear Equations and Matrices

1.5

ELEMENTARY MATRICES AND A METHOD FOR FINDING A−1 In this section we shall develop an algorithm for finding the inverse of an invertible matrix. We shall also discuss some of the basic properties of invertible matrices. We begin with the definition of a special type of matrix that can be used to carry out an elementary row operation by matrix multiplication.

Definition An n × n matrix is called an elementary matrix if it can be obtained from the n × n identity matrix In by performing a single elementary row operation.

EXAMPLE 1 Elementary Matrices and Row Operations Listed below are four elementary matrices and the operations that produce them.       1 0 0 0 1 0 3 1 0 0

  1 0 0 0 0 1       0 1 0 0 1 0 0 −3 0 0 1 0 0 0 1 0 0 1 0 1 0 0 ✻ Multiply the second row of I2 by −3.





Interchange the second and fourth rows of I4 .

Add 3 times the third row of I3 to the first row.

✻ Multiply the first row of I3 by 1.

When a matrix A is multiplied on the left by an elementary matrix E, the effect is to perform an elementary row operation on A. This is the content of the following theorem, the proof of which is left for the exercises.

Theorem 1.5.1

Row Operations by Matrix Multiplication

If the elementary matrix E results from performing a certain row operation on Im and if A is an m × n matrix, then the product EA is the matrix that results when this same row operation is performed on A.

EXAMPLE 2 Using Elementary Matrices Consider the matrix



1  A = 2 1 and consider the elementary matrix

0 −1 4

2 3 4

 3  6 0

1.5

Elementary Matrices and a Method for Finding A−1 

1  E = 0 3

0 1 0

• • • 51

 0  0 1

which results from adding 3 times the first row of I3 to the third row. The product EA is   1 0 2 3   3 6 EA = 2 −1 4 4 10 9 which is precisely the same matrix that results when we add 3 times the first row of A to the third row.

Theorem 1.5.1 is primarily of theoretical interest and will be used for developing some results about matrices and systems of linear equations. Computationally, it is preferable to perform row operations directly rather than multiplying on the left by an elementary matrix.

REMARK.

If an elementary row operation is applied to an identity matrix I to produce an elementary matrix E, then there is a second row operation that, when applied to E, produces I back again. For example, if E is obtained by multiplying the ith row of I by a nonzero constant c, then I can be recovered if the ith row of E is multiplied by 1/c. The various possibilities are listed in Table 1. The operations on the right side of this table are called the inverse operations of the corresponding operations on the left.

TABLE 1 Row Operation on I That Produces E

Row Operation on E That Reproduces I

Multiply row i by c ≠ 0

Multiply row i by 1 / c

Interchange rows i and j

Interchange rows i and j

Add c times row i to row j

Add − c times row i to row j

EXAMPLE 3 Row Operations and Inverse Row Operations In each of the following, an elementary row operation is applied to the 2 × 2 identity matrix to obtain an elementary matrix E, then E is restored to the identity matrix by applying the inverse row operation.





1 0 1 0 1 0 −→ −→ 0 1 0 7 0 1 ✻ Multiply the second row by 7.

✻ Multiply the second row by 17 .

52 • • • Chapter 1 / Systems of Linear Equations and Matrices

1 0

0 1



−→

0 1



1 0





1 0

0 1



−→

0 1





Interchange the first and second rows.



1 0

−→

1 0

Interchange the first and second rows.



5 1

−→

✻ Add 5 times the second row to the first.

1 0

0 1



✻ Add −5 times the second row to the first.

The next theorem gives an important property of elementary matrices.

Theorem 1.5.2 Every elementary matrix is invertible, and the inverse is also an elementary matrix.

Proof. If E is an elementary matrix, then E results from performing some row operation on I . Let E0 be the matrix that results when the inverse of this operation is performed on I . Applying Theorem 1.5.1 and using the fact that inverse row operations cancel the effect of each other, it follows that E0 E = I and EE0 = I Thus, the elementary matrix E0 is the inverse of E. The next theorem establishes some fundamental relationships between invertibility, homogeneous linear systems, reduced row-echelon forms, and elementary matrices. These results are extremely important and will be used many times in later sections.

Theorem 1.5.3

Equivalent Statements

If A is an n × n matrix, then the following statements are equivalent, that is, all true or all false. (a) (b) (c) (d )

A is invertible. Ax = 0 has only the trivial solution. The reduced row-echelon form of A is In . A is expressible as a product of elementary matrices.

Proof. We shall prove the equivalence by establishing the chain of implications: (a) ⇒ (b) ⇒ (c) ⇒ (d) ⇒ (a). (a) ⇒ (b). Assume A is invertible and let x0 be any solution of Ax = 0; thus, Ax0 = 0. Multiplying both sides of this equation by the matrix A−1 gives A−1 (Ax0 ) = A−1 0, or (A−1 A)x0 = 0, or I x0 = 0, or x0 = 0. Thus, Ax = 0 has only the trivial solution.

1.5

Elementary Matrices and a Method for Finding A−1

• • • 53

(b) ⇒ (c). Let Ax = 0 be the matrix form of the system a11 x1 + a12 x2 + · · · + a1n xn = 0 a21 x1 + a22 x2 + · · · + a2n xn = 0 .. .. .. .. . . . . an1 x1 + an2 x2 + · · · + ann xn = 0

(1)

and assume that the system has only the trivial solution. If we solve by Gauss–Jordan elimination, then the system of equations corresponding to the reduced row-echelon form of the augmented matrix will be =0 =0

x1 x2

..

(2)

. xn = 0

Thus, the augmented matrix



a11 a  21  .  .. an1

a12 a22 .. . an2

··· ··· ···

 0 0  ..  . 0

a1n a2n .. . ann

for (1) can be reduced to the augmented matrix  1 0 0 ··· 0  0 1 0 · · · 0  0 0 1 · · · 0 . . . .. . . . . . . . 0 0 0 ··· 1

 0  0  0 ..   . 0

for (2) by a sequence of elementary row operations. If we disregard the last column (of zeros) in each of these matrices, we can conclude that the reduced row-echelon form of A is In . (c) ⇒ (d ). Assume that the reduced row-echelon form of A is In , so that A can be reduced to In by a finite sequence of elementary row operations. By Theorem 1.5.1 each of these operations can be accomplished by multiplying on the left by an appropriate elementary matrix. Thus, we can find elementary matrices E1 , E2 , . . . , Ek such that Ek · · · E2 E1 A = In

(3)

By Theorem 1.5.2, E1 , E2 , . . . , Ek are invertible. Multiplying both sides of Equation (3) on the left successively by Ek−1 , . . . , E2−1 , E1−1 we obtain A = E1−1 E2−1 · · · Ek−1 In = E1−1 E2−1 · · · Ek−1

(4)

By Theorem 1.5.2, this equation expresses A as a product of elementary matrices. (d ) ⇒ (a). If A is a product of elementary matrices, then from Theorems 1.4.6 and 1.5.2 the matrix A is a product of invertible matrices, and hence is invertible.

Row Equivalence

If a matrix B can be obtained from a matrix A by performing a finite sequence of elementary row operations, then obviously we can get from B back to A by performing the inverses of these elementary row operations in reverse order. Matrices that can be obtained from one another by a finite sequence of elementary row operations are said to be row equivalent. With this terminology it follows from

54 • • • Chapter 1 / Systems of Linear Equations and Matrices parts (a) and (c) of Theorem 1.5.3 that an n × n matrix A is invertible if and only if it is row equivalent to the n × n identity matrix.

A Method for Inverting Matrices As our first application of Theorem 1.5.3, we shall establish a method for determining the inverse of an invertible matrix. Multiplying (3) on the right by A−1 yields A−1 = Ek · · · E2 E1 In

(5)

which tells us that A−1 can be obtained by multiplying In successively on the left by the elementary matrices E1 , E2 , . . . , Ek . Since each multiplication on the left by one of these elementary matrices performs a row operation, it follows, by comparing Equations (3) and (5), that the sequence of row operations that reduces A to In will reduce In to A−1 . Thus, we have the following result: To find the inverse of an invertible matrix A, we must find a sequence of elementary row operations that reduces A to the identity and then perform this same sequence of operations on In to obtain A−1 . A simple method for carrying out this procedure is given in the following example.

EXAMPLE 4 Using Row Operations to Find A−1 Find the inverse of



1  A = 2 1

2 5 0

 3  3 8

Solution. We want to reduce A to the identity matrix by row operations and simultaneously apply these operations to I to produce A−1 . To accomplish this we shall adjoin the identity matrix to the right side of A, thereby producing a matrix of the form [A | I ] Then we shall apply row operations to this matrix until the left side is reduced to I ; these operations will convert the right side to A−1 , so that the final matrix will have the form [I | A−1 ] The computations are as follows:  1 2 3 1  2 5 3 0  1 0 8 0  1 1 2 3  0 1 −3 −2  0 −2 5 −1  1 2 3 1  0 1 −3 −2  −5 0 0 −1

0 1 0 0 1 0 0 1 2

 0  0 1  0  0 1  0  0 1

We added −2 times the first row to the second and −1 times the first row to the third.

We added 2 times the second row to the third.

Elementary Matrices and a Method for Finding A−1

1.5 

1  0 0  1  0 0  1  0 0

2 1 0

3 −3 1

1 −2 5

2 1 0

0 −14 0 13 1 5

0 1 0

0 0 1

Thus,

−40 13 5 

A−1

−40  =  13 5

 0 0  1 0 −2 −1  6 3  −5 −3 −2 −1  16 9  −5 −3 −2 −1

16 −5 −2

• • • 55

We multiplied the third row by −1.

We added 3 times the third row to the second and −3 times the third row to the first.

We added −2 times the second row to the first.

 9  −3 −1

Often it will not be known in advance whether a given matrix is invertible. If an n×n matrix A is not invertible, then it cannot be reduced to In by elementary row operations [part (c) of Theorem 1.5.3]. Stated another way, the reduced row-echelon form of A has at least one row of zeros. Thus, if the procedure in the last example is attempted on a matrix that is not invertible, then at some point in the computations a row of zeros will occur on the left side. It can then be concluded that the given matrix is not invertible, and the computations can be stopped.

EXAMPLE 5 Showing That a Matrix Is Not Invertible Consider the matrix



1  A= 2 −1

6 4 2

 4  −1 5

Applying the procedure of Example 4 yields   1 6 4 1 0 0   4 −1 0 1 0  2 −1 2 5 0 0 1   1 6 4 1 0 0   1 0  0 −8 −9 −2 1 0 1 0 8 9   1 0 0 1 6 4   1 0  0 −8 −9 −2 0 0 0 −1 1 1

We added −2 times the first row to the second and added the first row to the third.

We added the second row to the third.

Since we have obtained a row of zeros on the left side, A is not invertible.

56 • • • Chapter 1 / Systems of Linear Equations and Matrices EXAMPLE 6 A Consequence of Invertibility In Example 4 we showed that



1  A = 2 1

2 5 0

 3  3 8

is an invertible matrix. From Theorem 1.5.3 it follows that the homogeneous system x1 + 2x2 + 3x3 = 0 2x1 + 5x2 + 3x3 = 0 x1 + 8x3 = 0 has only the trivial solution.

Exercise Set 1.5 1. Which of the following are elementary matrices?  (a)

1 −5



1  (e) 0 0

0 1 1 0 0

 (b)  0  1 0

 1 0



−5 1



1  (f ) 0 0

0 1 0

 (c)

 0  9 1

1

0  2 0  (g)  0 0





0 √ 3 0 1 0 0

0 0 1 0

 2 0   0 1

0  (d) 0 1

0 1 0

 1  0 0

2. Find a row operation that will restore the given elementary matrix to an identity matrix.       1 0 − 17 0 0 0 0 1   1 0 0 0 1 0 1 0 0 1 0 0 0       (d)  (c)  (b) 0 1 0 (a)   0 0 0 0 1 0 −3 1 1 0 0 0 3 1 0 0 0 0 0 0 1 3. Consider the matrices  3 4  A = 2 −7 8 1

 1  −1, 5

 8  B = 2 3

1 −7 4

 5  −1, 1



3  C = 2 2

4 −7 −7

 1  −1 3

Find elementary matrices, E1 , E2 , E3 , and E4 such that (a) E1 A = B

(b) E2 B = A

(c) E3 A = C

(d) E4 C = A

4. In Exercise 3 is it possible to find an elementary matrix E such that EB = C? Justify your answer. In Exercises 5–7 use the method shown in Examples 4 and 5 to find the inverse of the given matrix if the matrix is invertible and check your answer by multiplication.       6 −4 −3 6 1 4 (c) (b) 5. (a) −3 2 4 5 2 7

Elementary Matrices and a Method for Finding A−1

1.5 

3  6. (a) 1 2  7. (a)

 −1  3 −4

4 0 5

1  51  5 1 5

− 25

1 5 1 5 − 45



−8

  4 (d)    0 −1



−1  (b)  2 −4

 

2

0

2 5

0 13

0 4

 −4  1 −9

 √ 2  √ (b) −4 2 0

1  10  1 10

17

3 4 2

1 3



 −9   0 2



0 1  (e)  0 2

0 0 −1 1



1  (c) 0 1 √ 3 2 √ 2 0 2 0 3 5

0

0 1 1



 0 1

 1  1 0

 2  (d) 2 2



1 1  (c)  1 1

0 3 3 3

0 0 5 5

6 7 7

 6  6 7

 0 0   0 7

 0 1   0 −3

8. Find the inverse of each of the following 4 × 4 matrices, where k1 , k2 , nonzero.      k 0 0 0 0 k1 k1 0 0 0  1 k  0 0 k 0 k 0 0 0 2 2      (c)  (b)  (a)    0 1  0 k3 0 0   0 0 k3 0  0 0 0 0 0 k4 k4 0 0 0

k3 , k4 , and k are all 0 0 k 1

 0 0   0 k

9. Consider the matrix   1 0 A= −5 2 (a) Find elementary matrices E1 and E2 such that E2 E1 A = I . (b) Write A−1 as a product of two elementary matrices. (c) Write A as a product of two elementary matrices. 10. In each part perform the stated row operation on   2 −1 0   5 −3 4 1 −4 7 by multiplying A on the left by a suitable elementary matrix. Check your answer in each case by performing the row operation directly on A. (a) Interchange the first and third rows. (b) Multiply the second row by 13 . (c) Add twice the second row to the first row. 11. Express the matrix  0  A= 1 −2

1 3 −5

7 3 1

 8  8 −8

in the form A = EF GR, where E, F , and G are elementary matrices, and R is in row-echelon form. 12. Show that if



1  A = 0 a

0 1 b

 0  0 c

is an elementary matrix, then at least one entry in the third row must be a zero.



1  (e) −1 0

0 1 1

• • • 57

 1  1 0

58 • • • Chapter 1 / Systems of Linear Equations and Matrices 13. Show that



0  b  A= 0 0  0

a 0 d 0 0

0 c 0 f 0

0 0 e 0 h

 0  0  0  g  0

is not invertible for any values of the entries. 14. Prove that if A is an m × n matrix, there is an invertible matrix C such that CA is in reduced row-echelon form. 15. Prove that if A is an invertible matrix and B is row equivalent to A, then B is also invertible. 16. (a) Prove: If A and B are m × n matrices, then A and B are row equivalent if and only if A and B have the same reduced row-echelon form. (b) Show that A and B are row equivalent, and find a sequence of elementary row operations that produces B from A.     1 0 5 1 2 3     2 −2 B = 0 A = 1 4 1, 1 1 4 2 1 9 17. Prove Theorem 1.5.1.

Discussion and Discovery 18. Suppose that A is some unknown invertible matrix, but you know of a sequence of elementary row operations that produces the identity matrix when applied in succession to A. Explain how you can use the known information to find A. 19. Indicate whether the statement is always true or sometimes false. Justify your answer with a logical argument or a counterexample. (a) Every square matrix can be expressed as a product of elementary matrices. (b) The product of two elementary matrices is an elementary matrix. (c) If A is invertible and a multiple of the first row of A is added to the second row, then the resulting matrix is invertible. (d) If A is invertible and AB = 0, then it must be true that B = 0. 20. Indicate whether the statement is always true or sometimes false. Justify your answer with a logical argument or a counterexample. (a) If A is a singular n × n matrix, then Ax = 0 has infinitely many solutions. (b) If A is a singular n × n matrix, then the reduced row-echelon form of A has at least one row of zeros. (c) If A−1 is expressible as a product of elementary matrices, then the homogeneous linear system Ax = 0 has only the trivial solution. (d) If A is a singular n × n matrix, and B results by interchanging two rows of A, then B may or may not be singular. 21. Do you think that there is a 2 × 2 matrix A such that     b d a b = A a c c d for all values of a, b, c, and d? Explain your reasoning.

1.6

1.6

Further Results on Systems of Equations and Invertibility

• • • 59

FURTHER RESULTS ON SYSTEMS OF EQUATIONS AND INVERTIBILITY In this section we shall establish more results about systems of linear equations and invertibility of matrices. Our work will lead to a new method for solving n equations in n unknowns.

A Basic Theorem

In Section 1.1 we made the statement (based on Figure 1.1.1) that every linear system has either no solutions, one solution, or infinitely many solutions. We are now in a position to prove this fundamental result.

Theorem 1.6.1 Every system of linear equations has either no solutions, exactly one solution, or infinitely many solutions. Proof. If Ax = b is a system of linear equations, exactly one of the following is true: (a) the system has no solutions, (b) the system has exactly one solution, or (c) the system has more than one solution. The proof will be complete if we can show that the system has infinitely many solutions in case (c). Assume that Ax = b has more than one solution, and let x0 = x1 − x2 , where x1 and x2 are any two distinct solutions. Because x1 and x2 are distinct, the matrix x0 is nonzero; moreover, Ax0 = A(x1 − x2 ) = Ax1 − Ax2 = b − b = 0 If we now let k be any scalar, then A(x1 + kx0 ) = Ax1 + A(kx0 ) = Ax1 + k(Ax0 ) = b + k0 = b + 0 = b But this says that x1 + kx0 is a solution of Ax = b. Since x0 is nonzero and there are infinitely many choices for k, the system Ax = b has infinitely many solutions.

Solving Linear Systems by Matrix Inversion

Thus far, we have studied two methods for solving linear systems: Gaussian elimination and Gauss– Jordan elimination. The following theorem provides a new method for solving certain linear systems.

Theorem 1.6.2 If A is an invertible n×n matrix, then for each n×1 matrix b, the system of equations Ax = b has exactly one solution, namely, x = A−1 b. Proof. Since A(A−1 b) = b, it follows that x = A−1 b is a solution of Ax = b. To show that this is the only solution, we will assume that x0 is an arbitrary solution and then show that x0 must be the solution A−1 b. If x0 is any solution, then Ax0 = b. Multiplying both sides by A−1 , we obtain x0 = A−1 b.

60 • • • Chapter 1 / Systems of Linear Equations and Matrices EXAMPLE 1 Solution of a Linear System Using A−1 Consider the system of linear equations x1 + 2x2 + 3x3 = 5 2x1 + 5x2 + 3x3 = 3 + 8x3 = 17 x1 In matrix form this system can be written as Ax = b, where       1 2 3 x1 5       A = 2 5 3, x = x2 , b =  3 1 0 8 17 x3 In Example 4 of the preceding section we showed that A is invertible and   −40 16 9   A−1 =  13 −5 −3 5 −2 −1 By Theorem 1.6.2 the solution of the system is      −40 16 9 5 1      −1 x = A b =  13 −5 −3  3 = −1 5 −2 −1 17 2 or x1 = 1, x2 = −1, x3 = 2. Note that the method of Example 1 applies only when the system has as many equations as unknowns and the coefficient matrix is invertible.

REMARK.

Linear Systems with a Common Coefficient Matrix Frequently, one is concerned with solving a sequence of systems Ax = b1 , Ax = b2 , Ax = b3 , . . . , Ax = bk each of which has the same square coefficient matrix A. If A is invertible, then the solutions x1 = A−1 b1 , x2 = A−1 b2 , x3 = A−1 b3 , . . . , xk = A−1 bk can be obtained with one matrix inversion and k matrix multiplications. However, a more efficient method is to form the matrix [A | b1 | b2 | · · · | bk ]

(1)

in which the coefficient matrix A is “augmented” by all k of the matrices b1 , b2 , . . . , bk . By reducing (1) to reduced row-echelon form we can solve all k systems at once by Gauss–Jordan elimination. This method has the added advantage that it applies even when A is not invertible.

EXAMPLE 2 Solving Two Linear Systems at Once Solve the systems (a)

x1 + 2x2 + 3x3 = 4 2x1 + 5x2 + 3x3 = 5 x1 + 8x3 = 9

(b)

x1 + 2x2 + 3x3 = 1 2x1 + 5x2 + 3x3 = 6 x1 + 8x3 = −6

1.6

Further Results on Systems of Equations and Invertibility

• • • 61

Solution. The two systems have the same coefficient matrix. If we augment this coefficient matrix with the columns of constants on the right sides of these systems, we obtain   4 1 1 2 3   5 3 5 6 2 1 0 8 9 −6 Reducing this matrix to reduced row-echelon form yields (verify)   2 1 1 0 0   1 1 0 0 0 0 0 1 1 −1 It follows from the last two columns that the solution of system (a) is x1 = 1, x2 = 0, x3 = 1 and of system (b) is x1 = 2, x2 = 1, x3 = −1.

Properties of Invertible Matrices

Up to now, to show that an n × n matrix A is invertible, it has been necessary to find an n × n matrix B such that AB = I and BA = I The next theorem shows that if we produce an n × n matrix B satisfying either condition, then the other condition holds automatically.

Theorem 1.6.3 Let A be a square matrix. (a) If B is a square matrix satisfying BA = I, then B = A−1 . (b) If B is a square matrix satisfying AB = I, then B = A−1 . We shall prove part (a) and leave part (b) as an exercise. Proof (a). Assume that BA = I . If we can show that A is invertible, the proof can be completed by multiplying BA = I on both sides by A−1 to obtain BAA−1 = I A−1 or BI = I A−1 or B = A−1 To show that A is invertible, it suffices to show that the system Ax = 0 has only the trivial solution (see Theorem 1.5.3). Let x0 be any solution of this system. If we multiply both sides of Ax0 = 0 on the left by B, we obtain BAx0 = B0 or I x0 = 0 or x0 = 0. Thus, the system of equations Ax = 0 has only the trivial solution. We are now in a position to add two more statements that are equivalent to the four given in Theorem 1.5.3.

Theorem 1.6.4

Equivalent Statements

If A is an n × n matrix, then the following are equivalent. (a) (b) (c) (d ) (e) (f)

A is invertible. Ax = 0 has only the trivial solution. The reduced row-echelon form of A is In . A is expressible as a product of elementary matrices. Ax = b is consistent for every n × 1 matrix b. Ax = b has exactly one solution for every n × 1 matrix b.

62 • • • Chapter 1 / Systems of Linear Equations and Matrices Proof. Since we proved in Theorem 1.5.3 that (a), (b), (c), and (d ) are equivalent, it will be sufficient to prove that (a) ⇒ ( f ) ⇒ (e) ⇒ (a). (a) ⇒ (f ). This was already proved in Theorem 1.6.2. (f ) ⇒ (e). This is self-evident: If Ax = b has exactly one solution for every n × 1 matrix b, then Ax = b is consistent for every n × 1 matrix b. (e) ⇒ (a). If the system Ax = b is consistent for every n×1 matrix b, then in particular, the systems       1 0 0       0 1 0          Ax =  Ax =  Ax =  0. , 0. , . . . , 0.  . . . . . . 0

0

1

are consistent. Let x1 , x2 , . . . , xn be solutions of the respective systems, and let us form an n × n matrix C having these solutions as columns. Thus, C has the form C = [x1 | x2 | · · · | xn ] As discussed in Section 1.3, the successive columns of the product AC will be Ax1 , Ax2 , . . . , Axn Thus,



1  0  AC = [Ax1 | Ax2 | · · · | Axn ] =  0. . .

0 1 0 .. .

0

0

 ··· 0  · · · 0  · · · 0 =I ..   . ···

1

By part (b) of Theorem 1.6.3 it follows that C = A−1 . Thus, A is invertible. We know from earlier work that invertible matrix factors produce an invertible product. The following theorem, which will be proved later, looks at the converse: It shows that if the product of square matrices is invertible, then the factors themselves must be invertible.

Theorem 1.6.5 Let A and B be square matrices of the same size. If AB is invertible, then A and B must also be invertible. In our later work the following fundamental problem will occur frequently in various contexts. A Fundamental Problem. Let A be a fixed m × n matrix. Find all m × 1 matrices b such that the system of equations Ax = b is consistent. If A is an invertible matrix, Theorem 1.6.2 completely solves this problem by asserting that for every m × 1 matrix b, the linear system Ax = b has the unique solution x = A−1 b. If A is not square, or if A is square but not invertible, then Theorem 1.6.2 does not apply. In these cases the matrix b must usually satisfy certain conditions in

1.6

Further Results on Systems of Equations and Invertibility

• • • 63

order for Ax = b to be consistent. The following example illustrates how the elimination methods of Section 1.2 can be used to determine such conditions.

EXAMPLE 3 Determining Consistency by Elimination What conditions must b1 , b2 , and b3 satisfy in order for the system of equations x1 + x2 + 2x3 = b1 x1 + x3 = b2 2x1 + x2 + 3x3 = b3 to be consistent? Solution. The augmented matrix is



1  1 2

1 0 1

2 1 3

 b1  b2  b3

which can be reduced to row-echelon form as follows.   1 1 2 b1   −1 times the first row was added b 2 − b1  0 −1 −1 to the second and −2 times the 0 −1 −1 b3 − 2b1 first row was added to the third.   1 1 2 b1   The second row was 1 1 b1 − b2  0 multiplied by −1. 0 −1 −1 b3 − 2b1   1 1 2 b1   The second row was added 1 1 b1 − b2 0  to the third. 0 0 0 b3 − b2 − b1 It is now evident from the third row in the matrix that the system has a solution if and only if b1 , b2 , and b3 satisfy the condition b3 − b2 − b1 = 0 or b3 = b1 + b2 To express this condition another way, Ax = b is consistent if and only if b is a matrix of the form   b1   b =  b2  b1 + b 2 where b1 and b2 are arbitrary.

EXAMPLE 4 Determining Consistency by Elimination What conditions must b1 , b2 , and b3 satisfy in order for the system of equations x1 + 2x2 + 3x3 = b1 2x1 + 5x2 + 3x3 = b2 + 8x3 = b3 x1 to be consistent?

64 • • • Chapter 1 / Systems of Linear Equations and Matrices Solution. The augmented matrix is



1  2 1

2 5 0

 3 b1  3 b2  8 b3

Reducing this to reduced row-echelon form yields (verify)   1 0 0 −40b1 + 16b2 + 9b3   13b1 − 5b2 − 3b3  0 1 0 0 0 1 5b1 − 2b2 − b3

(2)

In this case there are no restrictions on b1 , b2 , and b3 ; that is, the given system Ax = b has the unique solution x1 = −40b1 + 16b2 + 9b3 , x2 = 13b1 − 5b2 − 3b3 , x3 = 5b1 − 2b2 − b3

(3)

for all b. REMARK. Because the system Ax = b in the preceding example is consistent for all b, it follows from Theorem 1.6.4 that A is invertible. We leave it for the reader to verify that the formulas in (3) can also be obtained by calculating x = A−1 b.

Exercise Set 1.6 In Exercises 1–8 solve the system by inverting the coefficient matrix and using Theorem 1.6.2. 1.

x1 + x2 = 2 5x1 + 6x2 = 9

2. 4x1 − 3x2 = −3 2x1 − 5x2 = 9

4. 5x1 + 3x2 + 2x3 = 4 3x1 + 3x2 + 2x3 = 2 x2 + x3 = 5

5.

x+y+ z= 5 x + y − 4z = 10 −4x + y + z = 0

7. 3x1 + 5x2 = b1 x1 + 2x2 = b2

8.

x1 + 2x2 + 3x3 = b1 2x1 + 5x2 + 5x3 = b2 3x1 + 5x2 + 8x3 = b3

3.

x1 + 3x2 + x3 = 4 2x1 + 2x2 + x3 = −1 2x1 + 3x2 + x3 = 3

6.

− x − 2y w + x + 4y w + 3x + 7y −w − 2x − 4y

− 3z = 0 + 4z = 7 + 9z = 4 − 6z = 6

9. Solve the following general system by inverting the coefficient matrix and using Theorem 1.6.2. x1 + 2x2 + x3 = b1 x1 − x2 + x3 = b2 x1 + x2

= b3

Use the resulting formulas to find the solution if (a) b1 = −1,

b2 = 3,

b3 = 4

(b) b1 = 5,

b2 = 0,

b3 = 0

10. Solve the three systems in Exercise 9 using the method of Example 2.

(c) b1 = −1, b2 = −1, b3 = 3

1.6

Further Results on Systems of Equations and Invertibility

In Exercises 11–14 use the method of Example 2 to solve the systems in all parts simultaneously. 11.

12. −x1 + 4x2 + x3 = b1 x1 + 9x2 − 2x3 = b2 6x1 + 4x2 − 8x3 = b3

x1 − 5x2 = b1 3x1 + 2x2 = b2 (a) b1 = 1, b2 = 4 (b) b1 = −2, b2 = 5

(a) b1 = 0, b2 = 1, b3 = 0 (b) b1 = −3, b2 = 4, b3 = −5

13. 4x1 − 7x2 = b1 x1 + 2x2 = b2 (a) (b) (c) (d)

14.

b1 = 0, b2 = 1 b1 = −4, b2 = 6 b1 = −1, b2 = 3 b1 = −5, b2 = 1

x1 + 3x2 + 5x3 = b1 = b2 −x1 − 2x2 2x1 + 5x2 + 4x3 = b3 (a) b1 = 1, b2 = 0, b3 = −1 (b) b1 = 0, b2 = 1, b3 = 1 (c) b1 = −1, b2 = −1, b3 = 0

15. The method of Example 2 can be used for linear systems with infinitely many solutions. Use that method to solve the systems in both parts at the same time. (a)

x1 − 2x2 + x3 = −2 2x1 − 5x2 + x3 = 1 3x1 − 7x2 + 2x3 = −1

(b)

x1 − 2x2 + x3 = 1 2x1 − 5x2 + x3 = −1 3x1 − 7x2 + 2x3 = 0

In Exercises 16–19 find conditions that b’s must satisfy for the system to be consistent. 16. 6x1 − 4x2 = b1 3x1 − 2x2 = b2 18.

x1 − 2x2 − x3 = b1 −4x1 + 5x2 + 2x3 = b2 −4x1 + 7x2 + 4x3 = b3

20. Consider the matrices  2 1  2 A = 2 3 1

17.

x1 − 2x2 + 5x3 = b1 4x1 − 5x2 + 8x3 = b2 −3x1 + 3x2 − 3x3 = b3

19.

x1 −2x1 −3x1 4x1

− x2 + x2 + 2x2 − 3x2

+ 3x3 + 5x3 + 2x3 + x3

+ 2x1 + x1 − x1 + 3x1

= b1 = b2 = b3 = b4

   x1 2    −2 and x = x2  1 x3

(a) Show that the equation Ax = x can be rewritten as (A − I )x = 0 and use this result to solve Ax = x for x. (b) Solve Ax = 4x. 21. Solve the following matrix equation for X.    2 −1 5 1 −1 1    0 −3 3 0  X = 4 2 3 5 −7 0 2 −1

7 0 2

 8  1 1

22. In each part determine whether the homogeneous system has a nontrivial solution (without using pencil and paper); then state whether the given matrix is invertible.   2 1 −3 1 (a) 2x1 + x2 − 3x3 + x4 = 0 0 5 4 3 5x2 + 4x3 + 3x4 = 0     x3 + 2x4 = 0 0 0 1 2 3x4 = 0 0 0 0 3   5 1 4 1 (b) 5x1 + x2 + 4x3 + x4 = 0 0 0 2 −1 2x3 − x4 = 0     x3 + x4 = 0 0 0 1 1 7x4 = 0 0 0 0 7

• • • 65

66 • • • Chapter 1 / Systems of Linear Equations and Matrices 23. Let Ax = 0 be a homogeneous system of n linear equations in n unknowns that has only the trivial solution. Show that if k is any positive integer, then the system Ak x = 0 also has only the trivial solution. 24. Let Ax = 0 be a homogeneous system of n linear equations in n unknowns, and let Q be an invertible n × n matrix. Show that Ax = 0 has just the trivial solution if and only if (QA)x = 0 has just the trivial solution. 25. Let Ax = b be any consistent system of linear equations, and let x1 be a fixed solution. Show that every solution to the system can be written in the form x = x1 + x0 , where x0 is a solution to Ax = 0. Show also that every matrix of this form is a solution. 26. Use part (a) of Theorem 1.6.3 to prove part (b).

Discussion and Discovery 27. (a) If A is an n × n matrix and if b is an n × 1 matrix, what conditions would you impose to ensure that the equation x = Ax + b has a unique solution for x? (b) Assuming that your conditions are satisfied, find a formula for the solution in terms of an appropriate inverse. 28. Suppose that A is an invertible n × n matrix. Must the system of equations Ax = x have a unique solution? Explain your reasoning. 29. Is it possible to have AB = I without B being the inverse of A? Explain your reasoning. 30. Create a theorem by rewriting Theorem 1.6.5 in contrapositive form (see Exercise 34 of Section 1.4).

1.7

DIAGONAL, TRIANGULAR, AND SYMMETRIC MATRICES In this section we shall consider certain classes of matrices that have special forms. The matrices that we study in this section are among the most important kinds of matrices encountered in linear algebra and will arise in many different settings throughout the text.

Diagonal Matrices

A square matrix in which all the entries off the main diagonal are zero is called a diagonal matrix. Here are some examples.     6 0 0 0 1 0 0

0 −4 2 0 0 0     ,   0 1 0, 0 −5 0 0 0 0 0 0 1 0 0 0 8 A general n × n diagonal matrix D can be written as   d1 0 · · · 0 0 d ··· 0  2   D =  .. .. ..  . . . 0 0 · · · dn

(1)

A diagonal matrix is invertible if and only if all of its diagonal entries are nonzero; in

1.7

Diagonal, Triangular, and Symmetric Matrices

this case the inverse of (1) is

D −1



0 1/d2 .. .

1/d1  0  =  ..  . 0

0

··· ···

0 0 .. .

• • • 67

    

· · · 1/dn

The reader should verify that DD −1 = D −1 D = I . Powers of diagonal matrices are easy to compute; we leave it for the reader to verify that if D is the diagonal matrix (1) and k is a positive integer, then   d1 k 0 · · · 0    0 d2 k · · · 0  k  .. ..  D =  .. . .    . k 0 0 · · · dn

EXAMPLE 1 Inverses and Powers of Diagonal Matrices If



1  A = 0 0 then A−1



1  = 0 0

0 − 13 0

  0 1   0, A5 = 0 1 0 2

0 −3 0

0 −243 0

 0  0 2   1 0   −5 0, A = 0 32 0

0 1 − 243

0

0



 0

1 32

Matrix products that involve diagonal factors are especially easy to compute. For example,      a11 a12 a13 a14 d1 a11 d1 a12 d1 a13 d1 a14 d1 0 0       0 d2 0  a21 a22 a23 a24  = d2 a21 d2 a22 d2 a23 d2 a24  0 0 d3 a31 a32 a33 a34 d3 a31 d3 a32 d3 a33 d3 a34      a11 a12 a13  d1 a11 d2 a12 d3 a13 a  d1 0 0    21 a22 a23    d1 a21 d2 a22 d3 a23    0 d2 0  =   a31 a32 a33  d1 a31 d2 a32 d3 a33  0 0 d3 a41 a42 a43 d1 a41 d2 a42 d3 a43 In words, to multiply a matrix A on the left by a diagonal matrix D, one can multiply successive rows of A by the successive diagonal entries of D, and to multiply A on the right by D one can multiply successive columns of A by the successive diagonal entries of D.

Triangular Matrices A square matrix in which all the entries above the main diagonal are zero is called lower triangular, and a square matrix in which all the entries below the main diagonal are zero is called upper triangular. A matrix that is either upper triangular or lower triangular is called triangular.

68 • • • Chapter 1 / Systems of Linear Equations and Matrices EXAMPLE 2 Upper and Lower Triangular Matrices  a11 0   0 0

a12 a22 0 0

a13 a23 a33 0

 a14 a24    a34  a44

A general 4 × 4 upper triangular matrix

 a11 a  21  a31 a41

0 a22 a32 a42

0 0 a33 a43

 0 0    0  a44

A general 4 × 4 lower triangular matrix

Observe that diagonal matrices are both upper triangular and lower triangular since they have zeros below and above the main diagonal. Observe also that a square matrix in row-echelon form is upper triangular since it has zeros below the main diagonal.

REMARK.

The following are four useful characterizations of triangular matrices. The reader will find it instructive to verify that the matrices in Example 2 have the stated properties. • A square matrix A = [aij ] is upper triangular if and only if the ith row starts with at least i − 1 zeros. • A square matrix A = [aij ] is lower triangular if and only if the j th column starts with at least j − 1 zeros. • A square matrix A = [aij ] is upper triangular if and only if aij = 0 for i > j . • A square matrix A = [aij ] is lower triangular if and only if aij = 0 for i < j . The following theorem lists some of the basic properties of triangular matrices.

Theorem 1.7.1 (a) The transpose of a lower triangular matrix is upper triangular, and the transpose of an upper triangular matrix is lower triangular. (b) The product of lower triangular matrices is lower triangular, and the product of upper triangular matrices is upper triangular. (c) A triangular matrix is invertible if and only if its diagonal entries are all nonzero. (d ) The inverse of an invertible lower triangular matrix is lower triangular, and the inverse of an invertible upper triangular matrix is upper triangular.

Part (a) is evident from the fact that transposing a square matrix can be accomplished by reflecting the entries about the main diagonal; we omit the formal proof. We will prove (b), but we will defer the proofs of (c) and (d ) to the next chapter, where we will have the tools to prove those results more efficiently. Proof (b). We will prove the result for lower triangular matrices; the proof for upper triangular matrices is similar. Let A = [aij ] and B = [bij ] be lower triangular n × n matrices, and let C = [cij ] be the product C = AB. From the remark preceding this theorem, we can prove that C is lower triangular by showing that cij = 0 for i < j . But from the definition of matrix multiplication, cij = ai1 b1j + ai2 b2j + · · · + ain bnj

1.7

Diagonal, Triangular, and Symmetric Matrices

• • • 69

If we assume that i < j , then the terms in this expression can be grouped as follows: cij = ai1 b1j + ai2 b2j + · · · + ai(j −1) b(j −1)j + aij bjj + · · · + ain bnj

 

  Terms in which the row number of b is less than the column number of b

Terms in which the row number of a is less than the column number of a

In the first grouping all of the b factors are zero since B is lower triangular, and in the second grouping all of the a factors are zero since A is lower triangular. Thus, cij = 0, which is what we wanted to prove.

EXAMPLE 3 Upper Triangular Matrices Consider the upper triangular matrices   1 3 −1   2 4 , A = 0 0 0 5



3  B = 0 0

−2 0 0

 2  −1 1

The matrix A is invertible, since its diagonal entries are nonzero, but the matrix B is not. We leave it for the reader to calculate the inverse of A by the method of Section 1.5 and show that   7 1 − 23 5   1 2 A−1 =  0 − 2 5  1 0 0 5 This inverse is upper triangular, as guaranteed by part (d ) of Theorem 1.7.1. We also leave it for the reader to check that the product AB is   3 −2 −2   0 2 AB = 0 0 0 5 This product is upper triangular, as guaranteed by part (b) of Theorem 1.7.1.

Symmetric Matrices A square matrix A is called symmetric if A = AT . EXAMPLE 4 Symmetric Matrices The following matrices are symmetric, since each is equal to its own transpose (verify).     d1 0 0 0 1 4 5

0 d 7 −3 0 0 2     4 −3 0 ,    , −3 5  0 0 d3 0  5 0 7 0 0 0 d4 It is easy to recognize symmetric matrices by inspection: The entries on the main diagonal may be arbitrary, but as shown in (2),“mirror images” of entries across the main diagonal must be equal.   1 4 5   0 4 −3 (2) 5 0 7

70 • • • Chapter 1 / Systems of Linear Equations and Matrices This follows from the fact that transposing a square matrix can be accomplished by interchanging entries that are symmetrically positioned about the main diagonal. Expressed in terms of the individual entries, a matrix A = [aij ] is symmetric if and only if aij = aj i for all values of i and j . As illustrated in Example 4, all diagonal matrices are symmetric. The following theorem lists the main algebraic properties of symmetric matrices. The proofs are direct consequences of Theorem 1.4.9 and are left for the reader.

Theorem 1.7.2 If A and B are symmetric matrices with the same size, and if k is any scalar, then: (a) AT is symmetric. (b) A + B and A − B are symmetric. (c) kA is symmetric.

It is not true, in general, that the product of symmetric matrices is symmetric. To see why this is so, let A and B be symmetric matrices with the same size. Then from part (d ) of Theorem 1.4.9 and the symmetry we have

REMARK.

(AB)T = B TAT = BA Since AB and BA are not usually equal, it follows that AB will not usually be symmetric. However, in the special case where AB = BA, the product AB will be symmetric. If A and B are matrices such that AB = BA, then we say that A and B commute. In summary: The product of two symmetric matrices is symmetric if and only if the matrices commute.

EXAMPLE 5 Products of Symmetric Matrices The first of the following equations shows a product of symmetric matrices that is not symmetric, and the second shows a product of symmetric matrices that is symmetric. We conclude that the factors in the first equation do not commute, but those in the second equation do. We leave it for the reader to verify that this is so.





1 2 −4 1 −2 1 = −5 2 2 3 1 0





1 2 −4 3 2 1 = 1 3 2 3 3 −1 In general, a symmetric matrix need not be invertible; for example, a square zero matrix is symmetric, but not invertible. However, if a symmetric matrix is invertible, then that inverse is also symmetric.

Theorem 1.7.3 If A is an invertible symmetric matrix, then A−1 is symmetric.

Proof. Assume that A is symmetric and invertible. From Theorem 1.4.10 and the fact that A = AT we have (A−1 )T = (AT )−1 = A−1 which proves that A−1 is symmetric.

1.7

Diagonal, Triangular, and Symmetric Matrices

• • • 71

Products AAT and ATA Matrix products of the form AAT and ATA arise in

a variety of applications. If A is an m × n matrix, then AT is an n × m matrix, so the products AAT and ATA are both square matrices—the matrix AAT has size m × m and the matrix ATA has size n × n. Such products are always symmetric since (AAT )T = (AT )TAT = AAT and (ATA)T = AT(AT )T = ATA

EXAMPLE 6 The Product of a Matrix and Its Transpose Is Symmetric Let A be the 2 × 3 matrix

A=

1 3

−2 0

4 −5





   1 3 10 −2 −11

4   1 −2   0 4 −8 ATA = −2 =  −2 3 0 −5 4 −5 −11 −8 41   1 3



1 −2 4  21 −17  −2 0 AAT = =   3 0 −5 −17 34 4 −5

Then

Observe that ATA and AAT are symmetric as expected. Later in this text, we will obtain general conditions on A under which AAT and ATA are invertible. However, in the special case where A is square we have the following result.

Theorem 1.7.4 If A is an invertible matrix, then AAT and ATA are also invertible. Proof. Since A is invertible, so is AT by Theorem 1.4.10. Thus, AAT and ATA are invertible, since they are the products of invertible matrices.

Exercise Set 1.7 1. Determine whether the matrix is invertible; if so, find the inverse by inspection.       −1 0 0 4 0 0 2 0     (c)  0 2 0 (b) 0 0 0 (a) 0 −5 0 0 13 0 0 5 2. Compute the product by inspection.     2 2 1 3 0 0     0 −4 1 (b) 0 (a) 0 −1 0 2 5 0 0 2 3. Find A2 , A−2 , and A−k by inspection. 1   0 2 1 0  (b) A =  0 13 (a) A = 0 −2 0 0

0 −1 0  0  0 1 4

 4 0  0  1 −5 4

−1 2 1

 −3 3  0  0 0 −2

0 5 0

 0  0 2

72 • • • Chapter 1 / Systems of Linear Equations and Matrices 4. Which of the following matrices are symmetric?      2 −1 2 −1 3 4  5 (a) (b) (c) −1 1 2 4 0 3 1

 3  1 7



0  (d) 0 3

0 2 0

 1  0 0

5. By inspection, determine whether the given triangular matrix is invertible.     0 1 −2 5 −1 2 4 0 1 5 6     (b)  (a)  0 3 0  0 0 −3 1 0 0 5 0 0 0 5 6. Find all values of a, b, and c for which A is symmetric.   2 a − 2b + 2c 2a + b + c   5 a+c  A = 3 0 −2 7 7. Find all values of a and b for which A and B are both not invertible.     5 0 a+b−1 0 , B= A= 0 2a − 3b − 7 0 3 8. Use the given equation to determine by inspection whether the matrices on the left commute.           4 3 2 −1 3 2 1 −5 1 −3 4 1 = (b) = (a) 3 1 −1 3 2 1 −10 1 −3 2 1 2 9. Show that A and B commute if a − d = 7b.  

2 1 a b , B= A= b d 1 −5 10. Find a diagonal matrix A that satisfies    9 1 0 0    0 (a) A5 = 0 −1 (b) A−2 = 0 0 0 0 −1

0 4 0

 0  0 1

11. (a) Factor A into the form A = BD, where D is a diagonal matrix.   3a11 5a12 7a13   A = 3a21 5a22 7a23  3a31 5a32 7a33 (b) Is your factorization the only one possible? Explain. 12. Verify Theorem 1.7.1b for the product AB, where    2 −8 −1 2 5    2 1 3, B = 0 A= 0 0 0 0 0 −4

 0  1 3

13. Verify Theorem 1.7.1d for the matrices A and B in Exercise 12. 14. Verify Theorem 1.7.3 for the given matrix A.    1 −2 2 −1  1 (b) A = −2 (a) A = −1 3 3 −7

 3  −7 4

1.7

Diagonal, Triangular, and Symmetric Matrices

15. Let A be a symmetric matrix. (a) Show that A2 is symmetric. (b) Show that 2A2 − 3A + I is symmetric. 16. Let A be a symmetric matrix. (a) Show that Ak is symmetric if k is any nonnegative integer. (b) If p(x) is a polynomial, is p(A) necessarily symmetric? Explain. 17. Let A be an upper triangular matrix and let p(x) be a polynomial. Is p(A) necessarily upper triangular? Explain. 18. Prove: If ATA = A, then A is symmetric and A = A2 . 19. Find all 3 × 3 diagonal matrices A that satisfy A2 − 3A − 4I = 0. 20. Let A = [aij ] be an n × n matrix. Determine whether A is symmetric. (a) aij = i 2 + j 2 (c) aij = 2i + 2j

(b) aij = i 2 − j 2 (d) aij = 2i 2 + 2j 3

21. Based on your experience with Exercise 20, devise a general test that can be applied to a formula for aij to determine whether A = [aij ] is symmetric. 22. A square matrix A is called skew-symmetric if AT = −A. Prove: (a) If A is an invertible skew-symmetric matrix, then A−1 is skew-symmetric. (b) If A and B are skew-symmetric, then so are AT , A + B, A − B, and kA for any scalar k. (c) Every square matrix A can be expressed as the sum of a symmetric matrix and a skewsymmetric matrix. [Hint. Note the identity A = 21 (A + AT ) + 21 (A − AT ).] 23. We showed in the text that the product of symmetric matrices is symmetric if and only if the matrices commute. Is the product of commuting skew-symmetric matrices skew-symmetric? Explain. [Note. See Exercise 22 for terminology.] 24. If the n × n matrix A can be expressed as A = LU , where L is a lower triangular matrix and U is an upper triangular matrix, then the linear system Ax = b can be expressed as LU x = b and can be solved in two steps: Step 1. Let U x = y, so that LU x = b can be expressed as Ly = b. Solve this system. Step 2. Solve the system U x = y for x. In each part use this two-step method to solve the given system.       x1 2 −1 3 1 0 0 1       1 2 x2  = −2 (a) −2 3 0 0 0 0 4 2 4 1 0 x3 

2  (b)  4 −3

0 1 −2

 3 0  0 0 0 3

−5 4 0

    x1 2 4     1 x2  = −5 2 2 x3

25. Find an upper triangular matrix that satisfies   1 30 3 A = 0 −8

Discussion and Discovery 26. What is the maximum number of distinct entries that an n × n symmetric matrix can have? Explain your reasoning. 27. Invent and prove a theorem that describes how to multiply two diagonal matrices. 28. Suppose that A is a square matrix and D is a diagonal matrix such that AD = I. What can you say about the matrix A? Explain your reasoning.

• • • 73

74 • • • Chapter 1 / Systems of Linear Equations and Matrices 29. (a) Make up a consistent linear system of five equations in five unknowns that has a lower triangular coefficient matrix with no zeros on or below the main diagonal. (b) Devise an efficient procedure for solving your system by hand. (c) Invent an appropriate name for your procedure. 30. Indicate whether the statement is always true or sometimes false. Justify each answer. (a) (b) (c) (d)

If AAT is singular, then so is A. If A + B is symmetric, then so are A and B. If A is an n × n matrix and Ax = 0 has only the trivial solution, then so does AT x = 0. If A2 is symmetric, then so is A.

Chapter 1 Supplementary Exercises 1. Use Gauss–Jordan elimination to solve for x  and y  in terms of x and y. x = 35 x  − 45 y  y = 45 x  + 35 y  2. Use Gauss–Jordan elimination to solve for x  and y  in terms of x and y. x = x  cos θ − y  sin θ y = x  sin θ + y  cos θ 3. Find a homogeneous linear system with two equations that are not multiples of one another and such that x1 = 1, x2 = −1, x3 = 1, x4 = 2 and x1 = 2, x2 = 0, x3 = 3, x4 = −1 are solutions of the system. 4. A box containing pennies, nickels, and dimes has 13 coins with a total value of 83 cents. How many coins of each type are in the box? 5. Find positive integers that satisfy x+ y+

z= 9

x + 5y + 10z = 44 6. For which value(s) of a does the following system have zero, one, infinitely many solutions? x1 + x2 + x3 = 4 x3 = 2 (a − 4)x3 = a − 2 2

7. Let



a  a 0

0 a a

b 4 2

 2  4 b

be the augmented matrix for a linear system. For what values of a and b does the system have (a) a unique solution, (c) a two-parameter solution,

(b) a one-parameter solution, (d) no solution?

Supplementary Exercises 8. Solve for x, y, and z. √ xy − 2 y + 3zy = 8 √ 2xy − 3 y + 2zy = 7 √ −xy + y + 2zy = 4 9. Find a matrix K such that AKB = C given that     1 4 2 0 0   3, , B= A = −2 0 1 −1 1 −2



8  C= 6 −4

6 −1 0

 −6  1 0

10. How should the coefficients a, b, and c be chosen so that the system ax + by − 3z = −3 −2x − by + cz = −1 ax + 3y − cz = −3 has the solution x = 1, y = −1, and z = 2? 11. In each part solve the matrix equation for X.     −1 0 1 1 2 0   1 0 = (a) X  1 −3 1 5 3 1 −1       2 −2 1 4 3 1 = X−X (c) 5 4 2 0 −1 2

 1 (b) X 3

−1 0

  −5 2 = 6 1

−1 −3



0 7

12. (a) Express the equations y1 =

x1 − x2 + x3

y2 =

3x1 + x2 − 4x3

y3 = −2x1 − 2x2 + 3x3

and

z1 = 4y1 − y2 + y3 z2 = −3y1 + 5y2 − y3

in the matrix forms Y = AX and Z = BY . Then use these to obtain a direct relationship Z = CX between Z and X. (b) Use the equation Z = CX obtained in (a) to express z1 and z2 in terms of x1 , x2 , and x3 . (c) Check the result in (b) by directly substituting the equations for y1 , y2 , and y3 into the equations for z1 and z2 and then simplifying. 13. If A is m × n and B is n × p, how many multiplication operations and how many addition operations are needed to calculate the matrix product AB? 14. Let A be a square matrix. (a) Show that (I − A)−1 = I + A + A2 + A3 if A4 = 0. (b) Show that (I − A)−1 = I + A + A2 + · · · + An if An+1 = 0. 15. Find values of a, b, and c so that the graph of the polynomial p(x) = ax 2 + bx + c passes through the points (1, 2), (−1, 6), and (2, 3). 16. (For readers who have studied calculus.) Find values of a, b, and c so that the graph of the polynomial p(x) = ax 2 + bx + c passes through the point (−1, 0) and has a horizontal tangent at (2, −9). 17. Let Jn be the n × n matrix each of whose entries is 1. Show that if n > 1, then (I − Jn )−1 = I −

1 Jn n−1

18. Show that if a square matrix A satisfies A3 + 4A2 − 2A + 7I = 0, then so does AT . 19. Prove: If B is invertible, then AB −1 = B −1 A if and only if AB = BA. 20. Prove: If A is invertible, then A + B and I + BA−1 are both invertible or both not invertible.

• • • 75

76 • • • Chapter 1 / Systems of Linear Equations and Matrices 21. Prove that if A and B are n × n matrices, then (a) tr(A + B) = tr(A) + tr(B)

(c) tr(AT ) = tr(A)

(b) tr(kA) = k tr(A)

(d) tr(AB) = tr(BA)

22. Use Exercise 21 to show that there are no square matrices A and B such that AB − BA = I 23. Prove: If A is an m × n matrix and B is the n × 1 matrix each of whose entries is 1/n, then   r1 r2    AB =  .   ..  rm where r i is the average of the entries in the ith row of A. 24. (For readers who have studied calculus.) If the entries of the matrix   c12 (x) · · · c1n (x) c11 (x)  c21 (x) c22 (x) · · · c2n (x)    C= . ..  ..  .. .  . cm1 (x)

cm2 (x)

···

cmn (x)

are differentiable functions of x, then we define      c12 (x) · · · c1n (x) c11 (x)    c (x) c22 (x) · · · c2n (x)  dC  21  = . ..  .. .  . dx .  .  cm1 (x)

 cm2 (x)

···

 cmn (x)

Show that if the entries in A and B are differentiable functions of x and the sizes of the matrices are such that the stated operations can be performed, then (a)

dA d (kA) = k dx dx

(b)

d dA dB (A + B) = + dx dx dx

(c)

d dA dB (AB) = B +A dx dx dx

25. (For readers who have studied calculus.) Use part (c) of Exercise 24 to show that dA−1 dA −1 = −A−1 A dx dx State all the assumptions you make in obtaining this formula. 26. Find the values of A, B, and C that will make the equation A Bx + C x2 + x − 2 = + 2 (3x − 1)(x 2 + 1) 3x − 1 x +1 an identity. [Hint. Multiply through by (3x − 1)(x 2 + 1) and equate the corresponding coefficients of the polynomials on each side of the resulting equation.] 27. If P is an n × 1 matrix such that P T P = 1, then H = I − 2P P T is called the corresponding Householder matrix (named after the American mathematician A. S. Householder).   (a) Verify that P T P = 1 if P T = 43 61 41 125 125 and compute the corresponding Householder matrix. (b) Prove that if H is any Householder matrix, then H = H T and H T H = I . (c) Verify that the Householder matrix found in part (a) satisfies the conditions proved in part (b). 28. Assuming that the stated inverses exist, prove the following equalities. (a) (C −1 + D −1 )−1 = C(C + D)−1 D (b) (I + CD)−1 C = C(I + DC)−1 (c) (C + DD T )−1 D = C −1 D(I + D T C −1 D)−1

Technology Exercises 29. (a) Show that if a = b, then a n + a n−1 b + a n−2 b2 + · · · + abn−1 + bn =

a n+1 − bn+1 a−b

(b) Use the result in part (a) to find An if   a 0 0   A =  0 b 0 1 0 c [Note. This exercise is based on a problem by John M. Johnson, The Mathematics Teacher, Vol. 85, No. 9, 1992.]

Chapter 1 Technology Exercises The following exercises are designed to be solved using a technology utility. Typically, this will be MATLAB, Mathematica, Maple, Derive, or Mathcad, but it may also be some other type of linear algebra software or a scientific calculator with some linear algebra capabilities. For each exercise you will need to read the relevant documentation for the particular utility you are using. The goal of these exercises is to provide you with a basic proficiency with your technology utility. Once you have mastered the techniques in these exercises, you will be able to use your technology utility to solve many of the problems in the regular exercise sets.

Section 1.1 T1. (Numbers and numerical operations) Read your documentation on entering and displaying numbers and performing the basic arithmetic operations of addition, subtraction, multiplication, division, raising numbers to powers, and extraction of roots. Determine how to control the number of digits in the screen display of a decimal number. If you are using a CAS, in which case you can compute with exact√numbers rather than decimal approximations, then learn how to enter such numbers as π, 2, and 13 exactly and convert them to decimal form. Experiment with numbers of your own choosing until you feel you have mastered the procedures and operations.

Section 1.2 T1. (Matrices and reduced row-echelon form) Read your documentation on how to enter matrices and how to find the reduced row-echelon form of a matrix. Then use your utility to find the reduced row-echelon form of the augmented matrix in Example 4 of Section 1.2. T2. (Linear systems with a unique solution) Read your documentation on how to solve a linear system, and then use your utility to solve the linear system in Example 3 of Section 1.1. Also, solve the system by reducing the augmented matrix to reduced row-echelon form. T3. (Linear systems with infinitely many solutions) Technology utilities vary on how they handle linear systems with infinitely many solutions. See how your utility handles the system in Example 4 of Section 1.2. T4. (Inconsistent linear systems) Technology utilities will often successfully identify inconsistent linear systems, but they can sometimes be fooled into reporting an inconsistent system as consistent or vice versa. This typically occurs when some of the numbers that occur in the computations are so small that roundoff error makes it difficult for the utility to determine whether or not they are equal to zero. Create some inconsistent linear systems and see how your utility handles them. T5. A polynomial whose graph passes through a given set of points is called an interpolating polynomial for those points. Some technology utilities have specific commands for finding

• • • 77

78 • • • Chapter 1 / Systems of Linear Equations and Matrices interpolating polynomials. If your utility has this capability, read the documentation and then use this feature to solve Exercise 25 of Section 1.2.

Section 1.3 T1. (Matrix operations) Read your documentation on how to perform the basic operations on matrices—addition, subtraction, multiplication by scalars, and multiplication of matrices. Then perform the computations in Examples 3, 4, and 5. See what happens when you try to perform an operation on matrices with inconsistent sizes. T2. Evaluate the expression A5 − 3A3 + 7A − 4I for the matrix   1 −2 3   5 −6 A = −4 7 −8 9 T3. (Extracting rows and columns) Read your documentation on how to extract rows and columns from a matrix, and then use your utility to extract various rows and columns from a matrix of your choice. T4. (Transpose and trace) Read your documentation on how to find the transpose and trace of a matrix, and then use your utility to find the transpose of the matrix A in Formula (12) and the trace of the matrix B in Example 11. T5. (Constructing an augmented matrix) Read your documentation on how to create an augmented matrix [A | b] from matrices A and b that have previously been entered. Then use your utility to form the augmented matrix for the system Ax = b in Example 4 of Section 1.1 from the matrices A and b.

Section 1.4 T1. (Zero and identity matrices) Typing in entries of a matrix can be tedious, so many technology utilities provide shortcuts for entering zero and identity matrices. Read your documentation on how to do this, and then enter some zero and identity matrices of various sizes. T2. (Inverse) Read your documentation on how to find the inverse of a matrix, and then use your utility to perform the computations in Example 7. T3. (Formula for the inverse) If you are working with a CAS, use it to confirm Theorem 1.4.5. T4. (Powers of a matrix) Read your documentation on how to find powers of a matrix, and then use your utility to find various positive and negative powers of the matrix A in Example 8. T5. Let



1

1 2

1 A= 4

1

1 6

1 7



1 3  1 5

1

Describe what happens to the matrix Ak when k is allowed to increase indefinitely (that is, as k → ⬁). T6. By experimenting with different values of n, find an expression for the inverse of an n × n matrix of the form   1 2 3 4 ··· n − 1 n 0 1 2 3 · · · n − 2 n − 1     0 0 1 2 · · · n − 3 n − 2  A= . . . . . . . . . . ..  ..  . . . .   0 0 0 0 · · · 1 2  0 0 0 0 ··· 0 1

Technology Exercises

Section 1.5 T1. (Singular matrices) Find the inverse of the matrix in Example 4, and then see what your utility does when you try to invert the matrix in Example 5.

Section 1.6 T1. (Solving Ax = b by inversion) Use the method of Example 4 to solve the system in Example 3 of Section 1.1. T2. Solve the linear system Ax = 2x, given that   0 0 −2   2 1 A = 1 1 0 3

Section 1.7 T1. (Diagonal, symmetric, and triangular matrices) Many technology utilities provide shortcuts for entering diagonal, symmetric, and triangular matrices. Read your documentation on how to do this, and then experiment with entering various matrices of these types. T2. (Properties of triangular matrices) Confirm the results in Theorem 1.7.1 using some triangular matrices of your choice.

• • • 79