Archive for April 6th, 2005

Does the peer review system work?

Posted in Libraries on April 6th, 2005

Time for a little provocation: a Slate article on peer review for scholarly articles. Not, to be sure, a peer-reviewed article, but interesting nonetheless.

I’d suggest three things:

  • In many, perhaps most fields, peer review does not determine whether a paper will be published–only where it will be published. (A point the article raises, if indirectly.)
  • It’s nearly impossible to do a proper study of the worth of peer review because virtually all scholarly articles go through the process. (A point also raised directly in the article: That is, where would you find a control group for a study?)
  • Peer review implies to many people a standard of quality that it doesn’t and probably can’t consistently deliver.

Easy for me to say, of course: I don’t claim to be a scholar, and have done maybe half a dozen peer-reviewed articles in my entire career (maybe not that many). I have served as a peer reviewer, to be sure–but not in STM. And I have seen articles that I judged to be pretty much worthless show up in print, if not in the journal for which I reviewed them. (No names, please, especially since it’s been many years…)

This blog is protected by dr Dave\\\\\\\'s Spam Karma 2: 105825 Spams eaten and counting...