Subscribe Now!

Wednesday, 1 September 2010

Marc Hauser's Scapegoat?

The dust is starting to settle after the Hauser-gate scandal which rocked psychology a couple of weeks back.

Harvard Professor Marc Hauser has been investigated by a faculty committee and the verdict was released on the 20th August: Hauser was "found solely responsible... for eight instances of scientific misconduct." He's taking a year's "leave", his future uncertain.

Unfortunately, there has been no official news on what exactly the misconduct was, and how much of Hauser's work is suspect. According to Harvard, only three publications were affected: a 2002 paper in Cognition, which has been retracted; a 2007 paper which has been "corrected" (see below), and another 2007 Science paper, which is still under discussion.

But what happened? Cognition editor Gerry Altmann writes that he was given access to some of the Harvard internal investigation. He concludes that Hauser simply invented some of the crucial data in the retracted 2002 paper.

Essentially, some monkeys were supposed to have been tested on two conditions, X and Y, and their responses were videotaped. The difference in the monkey's behaviour between the two conditions was the scientifically interesting outcome.

In fact, the videos of the experiment showed them being tested only on condition X. There was no video evidence that condition Y was even tested. The "data" from condition Y, and by extension the differences, were, apparently, simply made up.

If this is true, it is, in Altmann's words, "the worst form of academic misconduct." As he says, it's not quite a smoking gun: maybe tapes of Y did exist, but they got lost somehow. However, this seems implausible. If so, Hauser would presumably have told Harvard so in his defence. Yet they found him guilty - and Hauser retracted the paper.

So it seems that either Hauser never tested the monkeys on condition B at all, and just made up the data, or he did test them, saw that they weren't behaving the "right" way, deleted the videos... and just made up the data. Either way it's fraud.

Was this a one-off? The Cognition paper is the only one that's been retracted. But another 2007 paper was "replicated", with Hauser & a colleague recently writing:
In the original [2007] study by Hauser et al., we reported videotaped experiments on action perception with free ranging rhesus macaques living on the island of Cayo Santiago, Puerto Rico. It has been discovered that the video records and field notes collected by the researcher who performed the experiments (D. Glynn) are incomplete for two of the conditions.
Luckily, Hauser said, when he and a colleague went back to Puerto Rico and repeated the experiment, they found "the exact same pattern of results" as originally reported. Phew.

This note, however, was sent to the journal in July, several weeks before the scandal broke - back when Hauser's reputation was intact. Was this an attempt by Hauser to pin the blame on someone else - David Glynn, who worked as a research assistant in Hauser's lab for three years, and has since left academia?

As I wrote in my previous post:
Glynn was not an author on the only paper which has actually been retracted [the Cognition 2002 paper that Altmann refers to]... according to his resume, he didn't arrive in Hauser's lab until 2005.
Glynn cannot possibly have been involved in the retracted 2002 paper. And Harvard's investigation concluded that Hauser was "solely responsible", remember. So we're to believe that Hauser, guilty of misconduct, was himself an innocent victim of some entirely unrelated mischief in 2007 - but that it was all OK in the end, because when Hauser checked the data, it was fine.

Maybe that's what happened. I am not convinced.

Personally, if I were David Glynn, I would want to clear my name. He's left science, but still, a letter to a peer reviewed journal accuses him of having produced "incomplete video records and field notes", which is not a nice thing to say about someone.

Hmm. On August 19th, the Chronicle of Higher Education ran an article about the case, based on a leaked Harvard document. They say that "A copy of the document was provided to The Chronicle by a former research assistant in the lab who has since left psychology."

Hmm. Who could blame them for leaking it? It's worth remembering that it was a research assistant in Hauser's lab who originally blew the whistle on the whole deal, according to the Chronicle.

Apparently, what originally rang alarm bells was that Hauser appeared to be reporting monkey behaviours which had never happened, according to the video evidence. So at least in that case, there were videos, and it was the inconsistency between Hauser's data and the videos that drew attention. This is what makes me suspect that maybe there were videos and field notes in every case, and the "inconvenient" ones were deleted to try to hide the smoking gun. But that's just speculation.

What's clear is that science owes the whistle-blowing research assistant, whoever it is, a huge debt.

16 comments:

Anonymous said...

Nice summary. One thing though: According to the reported methodology of the Cognition paper, the monkeys alternated between A and B. Therefore, A and B *had* to be on the same tape if B was done. The tapes for B could not have simply been lost or erased. That's probably why Hauser couldn't use "lost tapes" as an excuse.

veri said...

I don't buy it. Maybe in the acadamia this doesn't mean anything:

http://www.nytimes.com/2010/08/12/education/12harvard.html?_r=1

In a widely noticed book of 2006, “Moral Minds,” he argued that a universal moral grammar is genetically wired into the human mind, similar to the universal grammar posited by Noam Chomsky to underlie the language faculty. Dr. Hauser is currently working on a book called “Evilicious: Why We Evolved a Taste for Being Bad.”

But this would be seen as a classic case of character assassination. He must've pissed some politicians off. The investigations began after he released that book.

They took 3? years to investigate more like 3 years to pressure him into retracting something.

veri said...

I noticed his article titles are kinda sexy.. he must've been an influential orator, no doubt involved in politics. I guess you need to when you're up there, come to think about it academics are celebs in a way..

Anonymous said...

The former assistant who leaked the document to the CHE was not Glynn.

And veri, you're a nut.

Anonymous said...

Hey veri:
Do you think Bill and Hillary Clinton killed Vince Foster?

veri said...

Politics is alot more complex.

The Hauser affair and the acadamia is none of my business I could find out if I cared enough but Harvard is known for political theatrics so my guess is either this was a PR motive or he pissed people off. Plus Chomsky isn't discussed in the acadamia but is extremely influential underground.

veri said...

I think I'm also right to assume academics make occasional errors so long as it isn't consistent, but I doubt he made those errors. Seems ridiculous to be halted for one study so I'm absolutely certain there must be more to this story.

ex-hedgehog freak said...

Good post. I agree with the first comment above - my understanding of the report was that the videotapes of the material were independently reviewed and there was no correlation between the tamarins behavior and the changes in audio sounds between type A and type B strings of syllables. So I believe the material does exist, and by inference it should be on those tapes.

And unfortunately Veri, there is no such conspiracy theory or political shenanigans involved here. It simply takes this long to conduct these investigations in academic settings. The reality is that Harvard would have wanted to do anything they could to protect someone who brings in significant levels of research funding, publishes highly-visible papers and is considered a leader in the field. The fact that it took this long for Harvard only indicates that there was a very thorough and comprehensive investigation, before they came to conclusions we see here. And they are very convincing; Hauser was clearly guilty of fraud on a scary level.

Who I feel sorry for are the other researchers in a field like this. Grants have been proposed and funded, and research investigations have been begun, based on published findings that at this point resemble a house of cards in cognitive function theory. What is citable at this point? What else by Hauser has to be called into question?

Neuroskeptic said...

I'm basing my statements on Gerry Altman's post on his blog called "Harvard misconduct: setting the record straight"

He says that...

the monkeys were trained on what we might call two different grammars (i.e. underlying patterns of sequences of syllables). One group of monkeys were trained on Grammar A, and another group on Grammar B. At test, they were given, according to the published paper, one sequence from Grammar A, and another sequence from Grammar B - so for each monkey, one sequence was drawn from the "same" grammar as it had been trained on, and the other sequence was drawn from the "different" grammar. The critical test was whether their response to the "different" sequence was different to their response to the "same" sequence (this would then allow the conclusion, as reported in the paper, that the monkeys were able to discriminate between the two underlying grammars). On investigation of the original videotapes, it was found that the monkeys had only been tested on sequences from the "different" grammar - that is, the different underlying grammatical patterns to those they had been trained on. There was no evidence they had been tested on sequences from the "same" grammar (that is, with the same underlying grammatical patterns).

Note that in my post I did something a little confusing which was to call the Different condition "A" and the Same condition "B". Hence why I said there was no B. That's potentially confusing because the grammars were also called A and B. I've now changed my post to refer to X and Y.

Altmann is very clear that, as far as he is aware, there is no video evidence of the monkeys being tested on the same grammar they were trained on.

See his most recent post for more details.

veri said...

Have you ever challenged the competancy of an academic? I have, twice, one was a complete fraud. The procedure doesn't take 3 years but there's alot of paperwork and meetings involved presenting your case, you win, they get a warning not a splash in the NY Times.

Harvard has enough superstars not to 'protect'. I'm still absolutely convinced there's more to this story. Chomsky is very influential among activists.

veri said...

Let me also just add the academia is a small world in comparison to the rest of the world. When you look at it like that, Hauser may've dipped his toes too readily into hostile waters. I think he should've stuck to his field.

Anonymous said...

Veri:
I think you have made your points "veri" well. But you have too much time on your hands! And thank you "veri" much in advance!

veri said...

Lab rat, how do I say this as kindly as possible, me commenting on Neo's posts has nothing to do with you. It isn't my fault you're bored of your job, but your fears are preventing you from whatever. Between you and I the bridge is burnt, I moved on, so should you. Sorry, I really am.

veri said...

Let me also just add, you are not my mother, I can take care of myself including how I spend my time. http://www.youtube.com/watch?v=2mNB_VG_shc No more! I deserve some respect.

Anonymous said...

I am the Anonymous of the "Cats, Bins and Stalin" thread and I want to distance myself (*) from the Anonymous of this thread who is not me.

* Though, not that much, :-)

Anonymous said...

most confusing comment thread ever ...