Peer Review Reform Hypothesis-Testing

Stevan Harnad harnad at ecs.soton.ac.uk
Sat Nov 29 07:45:34 EST 2003


On Fri, 28 Nov 2003, Gerry Mckiernan wrote:

>     "Invisible Hand(s) Quality Assurance in the Age of Author
>     Self-Archiving," Jekyll.comm: International Journal of Science
>     Communication no. 6 (September 2003)
>     http://jekyll.sissa.it/jekyll_comm/commenti/foc06_01.pdf

Gerry Mckiernan's interesting and witty conjectures about ways in which peer
review might be modified are valuable and welcome, but two things about them
should be clearly noted: 

(1) Peer-review reform proposals are untested empirical conjectures. Until
and unless they are empirically tested, and demonstrated to work,
and to scale up to the literature as a whole, and to yield a research
literature of a quality-level and reliability at least equal to
what we have now, they are merely speculations -- and speculations
that already face prima facie critiques and counter-speculations:
http://www.ecs.soton.ac.uk/~harnad/Temp/peerev.ppt

(2) Peer-review reform has nothing to do with open access (even if
open access is one of the *premises* of a particular peer-review reform
conjecture). Open access, written out longhand, means "open access to
the peer-reviewed literature" (such as it is). It is not about open
access to some *other* literature, conditional on the correctness of
untested speculations about peer review. Or, to put it another way, open
access is about freeing the peer-reviewed literature, right now, from
access-tolls, not from peer-review. Open access should not be delayed,
distracted, or redirected toward peer-review reform. (There are too many
things needlessly delaying it already!)

See:

    Peer Review Reform Hypothesis-Testing
    http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/0479.html

    A Note of Caution About "Reforming the System"
    http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/1169.html

    Self-Selected Vetting vs. Peer Review: Supplement or Substitute?
    http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/2340.html

    http://www.eprints.org/self-faq/#Peer-review-reform

    The Invisible Hand of Peer Review.
    http://www.nature.com/nature/webmatters/invisible/invisible.html

Stevan Harnad

NOTE: A complete archive of the ongoing discussion of providing open
access to the peer-reviewed research literature online is available at
the American Scientist September Forum (98 & 99 & 00 & 01 & 02 & 03):
    http://amsci-forum.amsci.org/archives/september98-forum.html
    http://www.cogsci.soton.ac.uk/~harnad/Hypermail/Amsci/index.html
    Post discussion to: september98-forum at amsci-forum.amsci.org 

Dual Open-Access Strategy:
    BOAI-2 ("gold"): Publish your article in a suitable open-access
            journal whenever one exists.
    BOAI-1 ("green"): Otherwise, publish your article in a suitable
            toll-access journal and also self-archive it.
    http://www.soros.org/openaccess/read.shtml
    http://www.ecs.soton.ac.uk/~harnad/Temp/berlin.htm
http://www.ecs.soton.ac.uk/~harnad/Temp/self-archiving_files/Slide0026.gif
http://www.ecs.soton.ac.uk/~harnad/Temp/self-archiving_files/Slide0021.gif
http://www.ecs.soton.ac.uk/~harnad/Temp/self-archiving_files/Slide0024.gif
http://www.ecs.soton.ac.uk/~harnad/Temp/self-archiving_files/Slide0028.gif





More information about the Jrnlnote mailing list