Skip to content
Prev 286806 / 398502 Next

orthogonal distance regression package?

My understanding is that TLS, EIV, and orthogonal regression are closely related but separate concepts.
If you read the  'Talk' at the Wikipedia page referenced below, you will see that many people have
terminology problems as well.
My take is that TLS is a special case of EIV and orthogonal linear regression is a special case of TLS.
** If your data is centered, then the orthogonal regression slope is just the ratio of the standard deviations of the two variables. **
You can get the same thing from PCA if you first scale by the SD's and then restore them after finding the first eigenvector.
The TLS and EIV approaches are more general, but assuming that the relative errors in the variables are equal, and things are 'nice' gives the simple result above.

The page Mark refers to from Sabine van Huffel's book on TLS is visible in Google books.

HTH,
-- David


-----Original Message-----
From: r-help-bounces at r-project.org [mailto:r-help-bounces at r-project.org] On Behalf Of Mark Leeds
Sent: Wednesday, February 29, 2012 12:37 PM
To: Adam Waytz
Cc: <r-help at r-project.org>; Bert Gunter
Subject: Re: [R] orthogonal distance regression package?

Hi: I can't find it anywhere on the internet but I have a book that shows that, as long as the SVD of the X matrix can be obtained, then the coefficient solution to TLS ( least angle regression )  is only a function of the eigenvectors.
Therefore, principal components can be used to obtain the coefficients in TLS which could be why there may not be an R package out there.

The book is titled "The Total Least Squares Problem" Huffel and Vandewalle.

Paul Teetor's paper ( see link below ) has an example of using principal components to calculate the coefficients in a univariate TLS.

Disclaimer: I've never used TLS regression and never studied it so there could be subtlleties where the result doesn't hold. The result is on page
37 of the book and the book is almost 300 pages so the SVD approach must not work all the time.

https://docs.google.com/viewer?a=v&q=cache:h5YT7w7fQXkJ:quanttrader.info/public/betterHedgeRatios.pdf+&hl=en&gl=us&pid=bl&srcid=ADGEESjbXq-o_3J148Ex376HqUTLCTbDyuH921wEkyze_uT8wlwhvpK8ywgp9ZBNPFTe9p7TbxTgHdNhD3BwjFSPD6H9ln1mIKDN1y0yKXOb9c3zHYhQnAuCtVx3aptuL7P2FtvIrl-0&sig=AHIEtbRl0WGG4c551EHnuOYP3cQ1RaEsBA&pli=1
''
On Wed, Feb 29, 2012 at 1:19 PM, Adam Waytz < a-waytz at kellogg.northwestern.edu> wrote:

            
______________________________________________
R-help at r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.


This e-mail and any materials attached hereto, including, without limitation, all content hereof and thereof (collectively, "XR Content") are confidential and proprietary to XR Trading, LLC ("XR") and/or its affiliates, and are protected by intellectual property laws.  Without the prior written consent of XR, the XR Content may not (i) be disclosed to any third party or (ii) be reproduced or otherwise used by anyone other than current employees of XR or its affiliates, on behalf of XR or its affiliates.

THE XR CONTENT IS PROVIDED AS IS, WITHOUT REPRESENTATIONS OR WARRANTIES OF ANY KIND.  TO THE MAXIMUM EXTENT PERMISSIBLE UNDER APPLICABLE LAW, XR HEREBY DISCLAIMS ANY AND ALL WARRANTIES, EXPRESS AND IMPLIED, RELATING TO THE XR CONTENT, AND NEITHER XR NOR ANY OF ITS AFFILIATES SHALL IN ANY EVENT BE LIABLE FOR ANY DAMAGES OF ANY NATURE WHATSOEVER, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, CONSEQUENTIAL, SPECIAL AND PUNITIVE DAMAGES, LOSS OF PROFITS AND TRADING LOSSES, RESULTING FROM ANY PERSON'S USE OR RELIANCE UPON, OR INABILITY TO USE, ANY XR CONTENT, EVEN IF XR IS ADVISED OF THE POSSIBILITY OF SUCH DAMAGES OR IF SUCH DAMAGES WERE FORESEEABLE.