More...  A colleague mentions: "this circulated on R-help yesterday. The
blog  actually has details of the error. They are saying it does not change
the conclusion, but it is pretty sad. It at least says a lot about
providing enough for others to check your work."
 _______________

Date: Wed, 17 Apr 2013 09:16:15 -0400
From: Gabor Grothendieck <ggrothendieck@gmail.com>
To: Sarah Goslee <sarah.goslee@gmail.com>
Cc: r-help <r-help@r-project.org>
Subject: Re: [R] the joy of spreadsheets (off-topic)
Message-ID:
    <CAP01uRnBeo4NV86H_O6fcqMViK8LsNb3xiMqYe54-2x-WpxrZw@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1

On Tue, Apr 16, 2013 at 1:25 PM, Sarah Goslee <sarah.goslee@gmail.com>
wrote:
> Given that we occasionally run into problems with comparing Excel
> results to R results, and other spreadsheet-induced errors, I thought
> this might be of interest.
>
>
http://www.nextnewdeal.net/rortybomb/researchers-finally-replicated-reinhart-rogoff-and-there-are-serious-problems
>
> The punchline:
>
> "If this error turns out to be an actual mistake Reinhart-Rogoff made,
> well, all I can hope is that future historians note that one of the
> core empirical points providing the intellectual foundation for the
> global move to austerity in the early 2010s was based on someone
> accidentally not updating a row formula in Excel."
>
> Ouch.
>
> (Note: I know nothing about the site, the author of the article, or
> the study in question. I was pointed to it by someone else. But if
> true: highly problematic.)
>

Herndon, Ash and Pollin (HAP), the authors of the critique, found that
in the highest debt category the Excel error in Rienhart and Rogoff
(RR)  was -0.3 percent points compared to a total error (from that
plus RR's other 2 mistakes) of -2.3 percentage points.  See Figure 1
of HAP. Thus aside from the dubiousness of attributing the coding
error in Excel to Excel itself it was not the main source of the
discrepancy.

Also even if one backs out all three errors that they found, the key
conclusion that GDP growth is declining with debt still occurs (but to
a lesser extent) as pointed out by RR in an initial responding email
reported by Bloomberg News.

The key takeaway here is really unrelated to Excel but rather is that
until data and analyses are shared or made public so that the analysis
can be reproduced one cannot have any real confidence in research
results.

RR
http://www.nber.org/papers/w15639.pdf

HAP
http://www.peri.umass.edu/fileadmin/pdf/working_papers/working_papers_301-350/WP322.pdf

Bloomberg News
http://www.bloomberg.com/news/2013-04-16/reinhart-rogoff-paper-cited-by-ryan-faulted-for-serious-errors-.html

-- 
Statistics & Software Consulting
GKX Group, GKX Associates Inc.
tel: 1-877-GKX-GROUP
email: ggrothendieck at gmail.com


On Thu, Apr 18, 2013 at 8:47 PM, Joseph Potvin <jpotvin@opman.ca> wrote:

> For fans of http://www.eusprig.org/ here's somebody who caught a big fish:
>
> http://business.financialpost.com/2013/04/18/reinhart-rogoff-austerity-study/
>
> --
> Joseph Potvin
> Operations Manager | Gestionnaire des operations
> The Opman Company | La compagnie Opman
> http://www.projectmanagementhotel.com/projects/opman-portfolio
> jpotvin@opman.ca <http://--esfsecev------/>
> Mobile: 819-593-5983 <http://--esfsecev------/>
> LinkedIn (Google short URL): http://goo.gl/Ssp56
>



-- 
Joseph Potvin
Operations Manager | Gestionnaire des operations
The Opman Company | La compagnie Opman
http://www.projectmanagementhotel.com/projects/opman-portfolio
jpotvin@opman.ca <http://--esfsecev------/>
Mobile: 819-593-5983 <http://--esfsecev------/>
LinkedIn (Google short URL): http://goo.gl/Ssp56

	[[alternative HTML version deleted]]

