S.O.S. Mathematics CyberBoard

Your Resource for mathematics help on the web!
It is currently Fri, 24 May 2013 01:36:04 UTC

All times are UTC [ DST ]




Post new topic Reply to topic  [ 3 posts ] 
Author Message
 Post subject: Relation of an inner product to an SVD
PostPosted: Thu, 5 Apr 2012 12:57:15 UTC 
Offline
Member of the 'S.O.S. Math' Hall of Fame

Joined: Tue, 20 Nov 2007 04:36:12 UTC
Posts: 826
Location: Las Cruces
On the physicsforums.com forum, the poster sunjin09 pointed out a relation between an inner product and a singular value decomposition of a product of matrices.

Let A be a N by N_A dimensional matrix.
Let D be a N by N_D dimensional matrix.
Let a be a N_A dimensional row vector.
Let x = Aa so x is the N dimensional column vector obtain by interpreting a as defining a linear combination of the columns of A.
Let b be an N_D dimensional row vector.
Let y = Db so y is the N dimensional column vector obtained by interpreting b as defining a linear combination of the columns of D.

Use U' to indicate the transpose of a matrix U. Assume A,D,a,b are real valued.

sunjin09 points out that the inner product <x,y> can be written in terms of the SVD of A'D.

Let U' S V be the singular value decomposition of A'D

<x,y>=(Aa)'(Db)=a'A'Db=a'U'SVb=(Ua)'S(Vb)

So the value of the inner product is determined by the a, b and the SVD of A'D. (Which, of course, implies that you if you kept a,b and A'D constant while varying A and D, the inner product <x,y> would remain constant.)

Can this fact be understood in terms of any of the intuitive ways of looking at the SVD? I've read descriptions of how the SVD can be interpreted as the natural way to express a single matrix as mapping but I don't see how to apply that to an understanding of this result.

In the thread where this result arose, A and D represent two sets of N dimensional column vectors and the span of the column vectors in A only intersects the span of the column vectors of B at the zero vector. Sunjin09 thinks that max_{a,b} of \frac{<x,y>}{|x||y|} is the largest singular value in the matrix S.


Top
 Profile  
 
 Post subject: Re: Relation of an inner product to an SVD
PostPosted: Thu, 5 Apr 2012 16:40:25 UTC 
Offline
Moderator
User avatar

Joined: Wed, 30 Mar 2005 04:25:14 UTC
Posts: 12103
Location: Austin, TX
http://en.wikipedia.org/wiki/Singular_v ... omposition

explains the theory pretty well I think.

_________________
(\ /)
(O.o)
(> <)
This is Bunny. Copy Bunny into your signature to help him on his way to world domination


Top
 Profile  
 
 Post subject: Re: Relation of an inner product to an SVD
PostPosted: Thu, 5 Apr 2012 18:36:13 UTC 
Offline
Member of the 'S.O.S. Math' Hall of Fame

Joined: Tue, 20 Nov 2007 04:36:12 UTC
Posts: 826
Location: Las Cruces
Is sunjin09's result in that article?

I'm familiar with the theory of the SVD and I've looked at that article. I don't see how to apply the interpretations of the SVD to explain sunjin09's result - I meant to explain it in some intuitive manner. The algebraic explanation of his result is clear.

Perhaps what I don't understand is the significance A'D as a mapping being related to the inner product of two vectors from the respective column spans of A and D. Is this some property of linear operators and inner products that "everybody knows"?


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 3 posts ] 

All times are UTC [ DST ]


Who is online

Users browsing this forum: No registered users


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
Contact Us | S.O.S. Mathematics Homepage
Privacy Statement | Search the "old" CyberBoard

users online during the last hour
Powered by phpBB © 2001, 2005-2011 phpBB Group.
Copyright © 1999-2013 MathMedics, LLC. All rights reserved.
Math Medics, LLC. - P.O. Box 12395 - El Paso TX 79913 - USA