Transcript

okay here we go with the quiz review for the third quiz that's coming on Friday so one key point is that the quiz covers the quiz covers through chapter six chapter 7 on linear Transformations will appear on the final exam but not on the quiz so I won't review linear Transformations today but they'll come into the full course review on the very last lecture so today I'm reviewing chapter six and I'm going to take some old exams and I'm always ready to answer questions and I thought kind of helps our memories if I write down the main topics in chapter six so already on the previous quiz we knew how to find igen values and igen vectors well we knew how to find them by that determinant of a minus Lambda I equals z but of course there could be shortcuts there could be like useful information about the igen values that that that we can uh speed things up with okay then the new stuff starts out with with a differential equation so I'll I'll do a problem I'll do a differential equation problem first then the what's special about symmetric matrices can we just say that in words I better write it down though what's special about symmetric matrices their igen values are real the I values of a symmetric Matrix always come out real and there always are enough igen vectors even if there're repeated igen values there are enough igen vectors and we can choose those IG vectors to be orthogonal so if a equals a transpose the big fact will be that we can Factor it into we can diagonalize it and those igen Vector Matrix with the igen vectors in the column can be an orthogonal Matrix so we get a q Lambda Q transpose that's the that that in three symbols expresses a wonderful fact a fundamental fact for symmetric matrices okay then we went beyond that fact to ask about positive definite matrices when the igen values were positive I'll do an example of that similar matrices that's now we've left left symmetry similar matrices or any Square matrices but the two matrices are similar if they're related that way and what's the key point about similar matrices somehow those matrices are representing the same thing in different basis in chapter 7even language in chapter 6 language what's up with these similar matrices what's the key fact the key positive fact about similar matrices they have the same igen values same IG values so if one of them grows the other one grows if we if one of them decays to zero the other one decays to zero if a that was that was or powers of a powers of powers of a will look like powers of B Because powers of a and powers of B only differ by an M inverse and an M way on the outside so if these are similar then B to the K power is M inverse a to the K power M and that's why I say this m it it does change the igen vectors but it doesn't change the igen value so same lambdas and then finally I've got to review the point about the SVD the singular value decomposition okay so that's what's this quiz has got to cover and now I'll just take problems from earlier exams uh starting with a differential equation okay and always ready for questions so here's an exam from about the year zero uh and it has a 3X3 so that was and but it's a pretty special looking Matrix it's got zeros on the diagonal it's got minus ones above and it's got plus ones like that so that's the Matrix a okay step one is find the well I want to solve that equation I want to find the general solution I haven't given you a u of zero here so I'm looking for the general solution so now what's the form of the general solution with with three arbitrary constants going to be inside it because those will be used to match the initial condition so the general form is U at time T is Su multiple of the first special solution the first special solution will be growing like the igen value and it's the igen vector so that's a pure exponential solution just staying with that igen Vector of course I haven't found yet the igen values and igen vectors that's normally the first job now there'll be a second one growing like e to the Lambda 2 and a third one growing like e to the Lambda 3 so we're all done well we haven't done anything yet actually uh I've got to find the igen values and IG vectors and then I would match U of Zer by choosing the right three constants okay so now I ask ask you about the igen values and igen vectors and you look at this Matrix then what do you see in that Matrix um well I guess of course we might ask ourselves right away is it singular is it singular because if so then we really have a head start we know one of the igen values is zero is that Matrix singular I don't know would you take the determinant to find out or do you maybe you look at the first row and third row and say hey the first row and third row are just opposite signs they're they're they're linear dependent the First Column and third column are depend it's singular so one I value is zero let's make that Lambda 1 Lambda one then will be zero okay now we've got a couple of other IG values to find and I suppose the simplest way is to look at a minus Lambda I so let me just put minus Lambda in here minus On's above ones below but actually before I do it so that Matrix is not symmetric for sure right in fact it's the very opposite of symmetric that Matrix a transpose how is transpose connected to a it's negative a it's an anti-symmetric Matrix skew symmetric Matrix and we've met maybe a 2 by two example of skew symmetric matrices and let me just say what's the deal with their igen values they're pure imaginary they'll be on the imaginary axis they'll be some multiple of I if it's a an if it's an anti-symmetric skew symmetric Matrix so I'm looking for multiples of I and of course that's 0 * I that's that's on the imaginary axis but maybe I just do it out here Lambda cubed well maybe that's minus Lambda cubed and then a zero and a zero a zero and then maybe I have a plus a Lambda and another plus Lambda but those go with a minus sign am I getting minus 2 Lambda equals z so so I'm solving Lambda Cub + 2 Lambda equals 0 so one one root factors out Lambda and the other the rest is Lambda 2 + 2 okay this is going the way we expect right because this gives the root Lambda equals zero and this gives the other two Roots which are Lambda equal what the solutions of when is Lambda 2 + 2 equal 0 then the igen values those guys are what are they they're they're a multiple of I they're just square root of 2 I when I set when I set this equal to zero I have Lambda 2 = to minus 2 right to make that zero and the roots are < TK of 2 I and minus the squ < T of two I so now I know what those I'll put those in now e to the 0o t is just a one so I so I don't even just it's just a one this is square < TK of two I and this is minus < TK of two I so is the solution decaying to zero is this a completely stable problem where the solution is going to zero no in fact all these things are staying the same size this thing is getting multiplied by this number e to the I something T that's a number that has magnitude one and sort of wanders around the unit circle same for this so that the solution doesn't blow up and it doesn't go to zero okay and to find out what it actually is we would have to plug in initial conditions but actually the next question I ask is when does the solution return to its initial value I won't even say what's the initial value this is a case in which the the I think this this solution is periodic after at at T equals Zer it starts at with C1 C2 and C3 and then at some value of T it comes back to that so that's a very special question I'm not let's just take three seconds because that special question isn't likely to be on the quiz but it comes back to the start when well whenever we have e to the 2 pii that's one and we've come back again so it comes back to the start period Peri it's periodic when this Square < TK of 2 I shall I call it capital T for the period for that particular T if that equals 2 pi I then then e to this thing is one and we've come around again so the period is T is determined here cancel the eyes and T is pi * time the < TK two so that's pretty neat we get all the information about all solutions we haven't fixed on only one particular solution but it comes around again so this was probably my first chance to say something about the whole family of anti- symmetric skew symmetric matrices okay and then finally I ask take take two igen vectors again I haven't computed the igen vectors and it turns out they're orthogonal they're orthogonal the ion vectors of a symmetric Matrix or a SK symmetric Matrix are always orthogonal I guess my conscience makes me tell you what are all the matrices that have orthogonal igen vectors and and symmetric is is the most important class that's the one we've spoken about but let's look let me just put put that little fact down here orthogonal X's igen vectors A Matrix has orthogonal igen vectors the exact Condition it's quite beautiful that that I can tell you exactly when that happens it happens when a * a transpose equals a transpose time a anytime that that's the condition for orthogonal Lon vectors and because we're interested in special families of vectors tell me the some special families that fit this is the whole requirement that's a pretty special requirement most Vector most matrices have I mean so the average 3x3 Matrix has three igen vectors but not orthogonal but if it happens to commute with its transposed then wonderfully the M the igen vectors are orthogonal now do you see how symmetric matrices pass this test of course if a transpose equals a then both sides are a squ we've got it how do anti-symmetric matrices pass this test if a transpose equals minus a then we've got it again because we've got minus a^2 on both sides so those that's another group and finally let me ask you about our other favorite family orthogonal matrices do orthogonal matrices pass this test if a is a q do they pass the test for orthogonal Ian vectors well if a is Q an orthogonal Matrix what is Q transpose Q it's I and what is QQ transpose it's I we're talking Square matrices here so yes it passes is the test so the special cases are symmetric anti-symmetric I'll say skew symmetric and orthogonal that's those are the three important special classes that that are in this family okay that's like a comment that uh um could have been made back in uh section 6.4 okay um I can pursue this with I I better better pursue the differential equations although this question didn't ask it to ask you to tell me how would I find this Matrix exponential e to the a so can I erase this I'll I'll just stay with this same how would I find e to the a because how does that come in that's the the key Matrix for differential equation because the solution is the solution is U of T is e to the A T U of Z so this is like the the fundamental Matrix that multiplies the given function and gives the answer and how do we how would we compute it if we wanted that we don't always have to find e to the a because I can go directly to the answer with without any e to the a TS but hiding here is an e to the A and how would I compute it well if if a is diagonalizable if so I'm now going to put in my usual if if a can be diagonalized and everybody remembers that there is an if there because it might not have enough I vectors this example does have enough random matrices have enough so if we can diagonalize then we get a nice formula for this because an S comes way out at the beginning an S inverse comes way out at the end and we only have to take the exponential of Lambda and that's just a diagonal matrix so that's just e to the lambda1 T these these guys are showing up now in the e to the Lambda n t okay that's a really quick review of that formula it's something we can compute it quickly if we have done the S and Lambda part if we know s and lamb then it's not hard to take that step okay that's some comments on differential equations I would like to go on to uh a next question that I started here uh and it's uh got several parts and I I can just read it out what we're given is a 3X3 Matrix and we're told it's I values except one of these is like we don't know and we're told the I vectors and I want to ask you about the Matrix okay so first question is the is the Matrix diagonalizable and I really mean for which for which C because I don't know C so my questions will all be for which is is there a condition on C does one C work but but what I your answer should tell me all the C's that work I'm not asking like to for you to tell me Well c equal 4 yeah that checks out I want to know all the C's that make it diagonalized ible okay what's the deal on diagonalizable we need enough igen vectors right we don't care what those igen values are it's igen vectors that count for diagonalizable and we need three independent ones and are those three guys independent Yes actually let's look at them for a moment what do you see about those three vectors right away they're more than independent they're can you see what's why uh those three got chosen because it'll come up in the next Parts they are they're orthogonal those ion vectors are orthogonal they're certainly independent so the answer to diagonalizable Is yes all see all see doesn't matter C could be a repeated guy but we've got enough I vectors so that's what we care about okay second question for which values of c is it symmetric okay what's the answer to that one if we know the same same setup if we know that much about it we know those igen vectors and we've noticed they're orthogonal then then which C's will work so the I values of that symmetric Matrix have to be real so all real C if C was I The Matrix wouldn't have been symmetric but if C is a real number then we've got real I values we've got orthogonal I vectors that Matrix is symmetric okay positive defin okay so that's now this is a subcase of symmetric so we need c to be real so we've got a symmetric Matrix but we also want the thing to be positive definite now we're looking at igen values we got a lot of tests for positive definite but Ian values if we know them is certainly a good quick clean test could this Matrix be positive definite no no because it's got an igen value zero it could be positive semi-definite you know like constellation price if if C was greater or equal zero it would be positive semi-definite but it's not no semi-definite if I put that comment in in semi definite that the condition would be C greater or equal Z then we'd be all right okay next part is it a Markoff Matrix H is could this Matrix be if I choose the number c correctly a Markoff Matrix well what do we know about Markoff matrices mainly we know something about their igen values one igen value is always one and the other IG values are smaller not larger so an IG value two can't happen so the answer is no not a that's never a Markoff Matrix okay and finally could 1 half of a be a projection Matrix so could it could this could this be twice a projection Matrix or let me write it this way could could a over two be a projection Matrix okay what are projection matrices they're real I mean they're symmetric so their IG values are real but more than that we know what those IG values have to be What do the I values of a projection Matrix have to be see any any nice Matrix we've got we've got an idea about its igen values so the igen values of projection matrices are zero and one zero and one only because p^2 equals P let me call this Matrix P so p s = p so Lambda s equal Lambda CU I values of p^2 or Lambda squ and we must have that so Lambda equal 0 or 1 okay now if what what value of C will work there so then we need there are some value that will work and what what will work Cals 0 will work or what else will work c equal to two because if C is two then when we divide by two this this I value of two will drop to one and and so will the other one so or c equal to two Okay those are the guys that will work and then and was the fact that those ion vectors were orthogonal the fact that those igon vectors were orthogonal carried us a lot of the way here if they weren't orthogonal then symmetric would have been dead positive definite would have been dead projection would have been dead but those I vectors were orthogonal so it came down to the igen values okay that's a that was like a chance to review a lot of this chapter um so I take the so I jump to the singular value decomposition then as the third uh topic for um for the review okay so I'm going to jump to this okay so this is the singular value decomposition known as to everybody as the SVD and that's a factorization of a into orthogonal time diagonal times orthogonal and we always call those U and sigma and V transpose okay and the key to that this is this this is for every Matrix every a every a rectangular doesn't matter whatever can be has has this decomposition so it's really important and the key to it is to look at things like a transpose a can we remember what happens with a transpose a if I just transpose that I get V Sigma transpose U transpose that's multiplying a which is U Sigma V transpose and the result is V on the outside U transpose U is the identity because it's an orthogonal Matrix so I'm just left with Sigma transpose Sigma in the middle that's a that's a diagonal possibly rectangular diagonal by its transpose so the result is this is orthogonal diagonal orthogonal so I guess actually this is the SVD for a transpose a here I see orthogonal diagonal and orthogonal great but little more is happening for a transpose a the difference is the orthogonal guys are the same it's V and V transpose what am I seeing here I'm seeing the factorization for a symmetric Matrix this thing is symmetric so in a symmetric case U is the same as v u is the same as V for this symmetric Matrix and of course we see it happening okay so that tells us right away what these what V is V is the en Vector Matrix for a transpose a okay now you if you were here when I lectured about this topic when I gave the lecture on on singular value decompositions you'll remember that I got into trouble I'm sorry to remember that myself but it happened okay how did it happen I did I was in great shape for a while cruising along so I found the ion vectors for a transpose a good I found the singular values what were they what were the singular values the singular value singular value number I for these are the guys in Sigma this has this is diagonal with the number Sigma in it this diagonal is Sigma 1 Sigma 2 up to the rank Sigma R those are the nonzero ones so I found those and what are they remind me about that well here I'm seeing them squared so they're squares are the I values of a transpose a good so I just take the square root if I want the I values of a transpose if I want the sigmas and I know these I take the square root the positive square root okay where did I run into trouble well then my final step was to find U and I didn't read the book uh so uh I I did something that was practically right but well I guess practically right is not quite the same okay so I thought okay I'll look at a a transpose what happened when I looked at AA transpose let me just put it here and then I can conceal it okay so here's here's AA transpose so that's U Sigma V transpose that's a and then the transpose is V Sigma transpose U transpose fine and then in the middle is the identity again so it looks great U Sigma Sigma transpose U transpose fine all good and again the now the igen vector now these Columns of U are the igen vector vectors that's U is the igen vector Matrix for this guy that was correct so I did that fine where did something go wrong A A Sign went wrong a sign went wrong because and now now I see actually somebody told me right after class we can't tell from this description which sign to give the igen vectors if I if this is if these are the igen vectors of this Matrix well if you give me an igen vector and I change all its signs you we've still got another igen Vector so what I wasn't able to determine and I had a 50/50 chance and life let me down the signs I just happened to pick for the igen vectors one of them I should have reversed the sign so from this I can't tell whether the IG vector or it negative is the right one to use in there so the right way to do it is to having settled on the signs the v's also I don't know which sign to choose but I choose one I choose one and then the then the I should have used instead I should have used the one that tells me what sign to choose the rule that a time a v is Sigma times the U so having decided on the v i multiply by a I'll notice the factor Sigma coming out and there'll be a unit Vector there and I now know which you know what the exactly what it is and and not only up to a change of sign so that's the good and and of course this is the main point about the SVD that's the point that we've Diagon that's a * The Matrix of of V's equals U * the M diagonal matrix of sigmas that's that's the same as that okay so that's like correcting um the the the wrong sign from that earlier lecture and that would complete that so that's how you would compute the SVD now on the quiz am I going to ask well maybe on the final so we've got quiz and final ahead uh sometimes you might be asked to find the SVD if I give you the Matrix let me come back now to the main board or I might give you the pieces and I might ask you something about the Matrix for example suppose I ask you oh let's say um well I if I tell you what Sigma is well let's okay let's take one example suppose Sigma is uh so all all that's how we would compute them but now suppose I give you these suppose I give you Sigma is say 32 and I tell you that U is has a couple of columns and V has a couple of columns okay those are orthogonal columns of course because u and v orthogonal i I'm just sort of like getting you to think about the SVD because we only had that one lecture about it and one homework and uh what kind of a matrix have I got what do I know about this Matrix all I really know right now is that it's singular values those sigmas are three and two and the only thing interesting that I can see in that is that they're not zero I I know that this Matrix is non- singular right that that's invertible I don't have any zero I values any zero singular values that's invertible there's a typical SVD for a nice 2x two non singular invertible good Matrix if I actually gave you a matrix then you'd have to find the U's and the v's as we just spoke but there now what if what if the two wasn't a two but it was well let me make an extreme case here suppose it was minus5 that's wrong right away that's not a singular value decomposition right the S the singular values are not negative so that that's not a singular value decomposition and forget it okay so let me ask you about that one what can you tell me about that matrix it's singular right it's got a singular Matrix there in the middle and let's see can you so okay it's singular maybe you can tell me um it's rank what's the rank of a it's clearly somebody just say it one thanks the rank is one uh so the null space what's the dimension of the null space one right we've got a 2X two Matrix of rank one so all that stuff from the beginning of the course is still with us the dimensions of those fundamental spaces is still Central and a basis for them now can you tell me a vector that's in the null space and then that's that'll be my last point to make about the SVD can you tell me a vector that's in the null space so I'm it's really it's somehow what would I multiply by and get zero here I think the answer is probably V2 I think probably V2 is in the null space because I think that must be the I Vector going with this zero I value yeah have a look at that and the and and I could ask you the null space of a transpose and I could ask you the column space all that stuff everything is sitting there in the SVD the SV D takes a little more time to compute but it displays all the good stuff about a matrix okay any question about the SVD uh let me keep going with uh uh further topics now let's see similar matrices we've talked about let let me let me see if I've got another uh okay here's a true false so we can do that uh easily so question a given a is symmetric and and orthogonal Okay so matrices like that don't come along every day but what can we say first about its zigen values actually of course we got here are two most important classes of matrices and we're looking at the intersection so those really are neat matrices and what can you tell me about the what could the possible igen values be igen values can be what what do I know about the I values of a symmetric Matrix Lambda is real what do I know about the igen values of an orthogonal Matrix H maybe nothing but no that can't be what do I know about the I values of an orthogonal Matrix well what feels right basing mathematics on just a little gut instinct here the I values of an orthogonal Matrix ought to have magnitude one orthogonal matrices are like rotations they're not changing the length so orthogonal the ion values are one let me just show you why why so the Matrix let's let's call it can I call it Q for orthogonal for the moment I'm if I look at QX Lambda X how do I see that this thing has magnitude one I take the length of both sides this is taking lengths taking lengths this is whatever the magnitude is times the length of X and what's the length of QX if Q is an orthogonal Matrix this is something you should know it's the same as the length of X orthogonal matrices don't change lengths so so Lambda has to be one right okay that's worth committing to memory that could show up again okay so what's the answer now to the to to this question what can the igen values be there's only two possibilities and they are one and the other one the other possibility is negative one right because these have the right magnitude and they're real okay okay uh true okay true or false a is sure to be positive definite well this is a great Matrix but is it sure to be positive definite no if it could have an igen value minus one it wouldn't be positive definite true or false it has no repeated igen values that's false too in fact it's going to have repeated igen values if it's as big as 3x3 one of these one of these at least will have to get repeated sure so it's got repeated I values but is it diagonalizable it's got these many many repeated IG values if it's 50 by 50 it's certainly got a lot of repetitions is it diagonalizable yes all symmetric matrices all orthogonal matrices can be diagonalized and in fact the igen vectors can even be chosen orthogonal so it can be sort of like diagonalized the best way with a Q and not just any old s okay is it non singular is is a symetric orthogonal matrix non singular sure orthogonal matrices are always non singular and obviously we don't have any zero igen values is it sure to be diagonalizable yes prove that now here's a final step show that 12 of a + I is a this is proof 12 of a + I is a projection Matrix okay uh let's see what do I do I could see two ways to do this I could check the properties of a projection Matrix which are what a projection Matrix is symmetric well that's certainly symmetric because a is and what's the other property I should Square it and hopefully get the same thing back so can I do that square and see if I get the same thing back so if I Square it I'll get one4 of a^ 2 + 2 a + I right and the question is does that agree with P the thing itself 12 a + i h I guess I'd like to know something about a squar what is a squar that's our problem what is a s if a is symmetric in orthogonal a is symmetric and orthogonal this is what we're given right it's symmetric and it's orthogonal so what's a s i a s is I because a * a if a a equals its own inverse so a * a is the same as a * a inverse which is I so this a s here is I and now we've got it we've got two identities over four that's good and we've got two A's over four that's good okay so it it turned out to be a projection Matrix safely and we could also have said well what are the igen values of this thing what are the igen values of a half a + I if the IG values of a are 1 and minus one what are the I values of a plus I just stay with it this last 30 seconds here what what are the if if I know these igen values of a and I add the identity the IG values of a plus I are 0er and two and then when I divide by two the igen values are zero and one so it's symmetric it's got the right IG values it's a projection Matrix okay you're seeing a lot of stuff about igen values and special matrixes and that's what the quiz is about okay so good luck on the quiz for