By Paul Temple
Peer review has been in the news recently (well, what counts as news in our business): which perhaps isn’t surprising considering the effect it can have on academic careers – and much more besides.
Richard Smith, when editor of the BMJ, conducted an experiment by deliberately inserting errors into a paper (presumably one written specially for the occasion – this isn’t made clear!) and sending it to reviewers who were in the dark about what was going on. (A university ethics committee would have had fun with this.) None of the chosen reviewers apparently spotted all the errors: from which (along with other findings) Smith concluded that “peer review simply doesn’t work” (THE, 28 May 2015). But one of the reviewers, Trisha Greenhalgh of Oxford University, presents the same facts in an interestingly different light (THE, 4 June 2015). She spotted a couple of serious errors early in the paper, concluded it was rubbish, told the BMJ so, and read no further. So, for her, peer review was working just fine.
This is an interesting methodological point – Continue reading