by Martin Eve, The Conversation
Isn’t open access better? Credit: fuzzcaminski
In a sting operation, John Bohannon, a correspondent of Science, claims to have exposed dodgy open access journals. His argument seems to be that, because of their business model, some journals are biased towards accepting scientific articles, regardless of their quality. Sadly, Bohannon's operation adds little to what we already know.
Much new knowledge, often created by the use of taxpayers' money, is locked behind paywalls of subscription-based journals. But there is a growing movement to make this knowledge freely available. Researchers around the world are being urged to publish in open access journals, and many are seeking to do so.
Where there is demand, the market learns to supply. This has come in form of thousands of open access journal publishers. But in this rapid rise, the journal Science finds in a sting operation that many such journals will accept anything in the hope of earning some money.
For the sting operation, Bohannon confected a scientific paper and sent it to more than 300 journals listed in the Directory of Open Access Journals. Some of these journals were also on Beall's list, managed by Jeffrey Beall, a library scientist at the University of Colorado, Denver, to weed out the bad ones.
More than half of those journals accepted the bogus manuscript, which was riddled with ethical approval problems and scientific anomalies. Many of these publishers misrepresented their locations. They all claimed to be peer-reviewed journals, but many of them didn't bother to do any sort of review. A few provided reviewer comments, but agreed to publish the article even when the reviewers raised serious questions.
Bohannon claims these journals would publish anything, because in the "author pays gold model" the publisher makes money only when the article is published.
It would seem that Bohannon has neatly demonstrated a fatal flaw in open access publishing. Bohannon never explicitly compares open access model to the subscription model (in which the researcher submitting the article doesn't pay but those reading it do), but his hypothesis seems to be that open access journals driven by publication charges will be inherently biased towards acceptance.
On the surface this looks like a potentially deadly blow to open access journals that levy Article Processing Charges (APCs). But I found some glaring problems with the article and its premises.
In short, Bohannon's article isn't really about open access. It's about a flawed system of trusting journals and the inherent problems in peer review, but he targets only open access here.
Problems of this nature have been explored before. For instance, in a 1982 paper, researchers submitted articles that a journal had already published under different author names. Nearly all the submissions were rejected. Many reviewers described the manuscript as having "serious methodological flaw".
Does Science do science?
Bohannon's methodology in the sting operation is questionable. He goes to great lengths to concoct a bogus methodology for submission and to ensure the scientific flaws in his paper were credible. The key problem, however, lies in two sentences, tucked away in Bohannon's coda. He writes:
Some say that the open-access model itself is not to blame for the poor quality control revealed by Science's investigation. If I had targeted the bottom tier of traditional, subscription-based journals, [David] Roos told me, "I strongly suspect you would get the same result."
Sadly, these two sentences appear at the very end of the article. All along it seems to be an attack on open access journals. While it is not directly mentioned, the implication is "it would never happen in the subscription model". But, given this wasn't tested, how do we know?
Value addition in the publication process happens at the peer review stage, as most journals claim. The journals exposed were clearly not adding that value. But this value addition is the same whether the journal is open access or not.
So, why did Science publish such a clearly incomplete study? The harsh truth is that Bohannon's article is hostile. He submitted articles only to open access journals. This omission then wrongly links the failure of deeper problems in academia to a single business model.
While he acknowledges that the top players (including the journal PLOS ONE) provided rigorous review, Bohannon submitted his bogus paper mostly to poor journals. They do not represent open access as a whole. Although Bohannon argues that "open access has multiplied that underclass of journals", I would like to counter that it is only through a history of masking editorial processes amid claims of "value added" that we have arrived at this mess.
Peer review is a function of academic labour. Editorial decisions should be made by qualified and respected academics who run journals. If we used this model, not even the most gullible of authors would attempt submission to this underclass of journals and their predatory behaviour wouldn't exist.
Explore further: Research paper publishing sting reveals lax standards of many open-access journals
More information: Research paper publishing sting reveals lax standards of many open-access journals: phys.org/news/2013-10-paper-publishing-reveals-lax-standards.html
This story is published courtesy of The Conversation (under Creative Commons-Attribution/No derivatives).
Medical Xpress on facebook
Related Stories
Research paper publishing sting reveals lax standards of many open-access journals
1 minute ago
(Phys.org) —John Bohannon, contributing news correspondent for Science, the highly respected peer-reviewed journal has conducted what he calls a "sting operation" that reveals problems with open-access publis ...
Open access journals reaching the same scientific impact as subscription journals
Jul 16, 2012
BioMed Central's open access journal BMC Medicine adds scientific rigour to the debate about open access research, by publishing an article which compares the scientific impact of open access with traditional subscription publis ...
University of California adopts open-access policy for research papers
Aug 05, 2013
The University of California (UC)—the biggest public research university in the world, has decided to adopt a university wide open-access policy for research papers produced by its faculty. The move marks a major victory ...
Ten-fold increase in Open Access publishing during the last decade
Jun 13, 2011
Since the World Wide Web emerged in the mid 1990s scientists have dreamed of having the whole body of scientific peer reviewed literature freely available on the web, openly available without any hindrance. In the "Open Access" ...
Huge transition costs will mean a bumpy ride to reach UK's Open Access, says RSC Chief Executive
Jul 18, 2012
The Chief Executive of the Royal Society of Chemistry has welcomed the government's Open Access proposals announced yesterday, but said the estimated £50 million annual transition costs would mean a bumpy ride ahead ...
Recommended for you
Alcoholism treatment before, after liver transplantation reduces relapse
21 hours ago
New research reports that liver transplant recipients who receive substance abuse treatment before and after transplantation have much lower alcohol relapse rates than those untreated or only treated prior to transplantation. ...
Liquorice alleviates troublesome symptoms following intubation
21 hours ago
In Traditional Chinese Medicine (TCM), liquorice is regarded as a "panacea". A recent study by the University Department of Anaesthetics, General Intensive Care Medicine and Pain Therapy at the MedUni Vienna ...
New bio bank to resolve legal and ethical issues
21 hours ago
When researchers collect human tissue in a so-called bio bank, the purpose is usually to learn about various diseases and improve curing of them. But at the University of Copenhagen a group of researchers ...
Scientist researches parasite that he removed from his own body
Oct 02, 2013
Early one morning in December, Jon Allen had decided that enough was enough. He was up anyway, having taken his young son back to bed after a trip to the bathroom. Allen returned to the bathroom with a pair ...
NIH official says spending cuts pose unprecedented threat to biomedical research
Oct 02, 2013
Scientific progress and innovation are speeding along, faster than ever before, but arbitrary spending cuts are posing an unprecedented threat.
China's e-cigarette inventor fights for financial rewards
Oct 02, 2013
The Chinese inventor who dreamed up the electronic cigarette in a nicotine-induced vision says that despite its global popularity, copycat versions and legal disputes mean he has battled to cash in on his creation.
User comments
© Medical Xpress 2011-2013, Phys.org network
by Martin Eve, The Conversation
Isn’t open access better? Credit: fuzzcaminski
In a sting operation, John Bohannon, a correspondent of Science, claims to have exposed dodgy open access journals. His argument seems to be that, because of their business model, some journals are biased towards accepting scientific articles, regardless of their quality. Sadly, Bohannon's operation adds little to what we already know.
Much new knowledge, often created by the use of taxpayers' money, is locked behind paywalls of subscription-based journals. But there is a growing movement to make this knowledge freely available. Researchers around the world are being urged to publish in open access journals, and many are seeking to do so.
Where there is demand, the market learns to supply. This has come in form of thousands of open access journal publishers. But in this rapid rise, the journal Science finds in a sting operation that many such journals will accept anything in the hope of earning some money.
For the sting operation, Bohannon confected a scientific paper and sent it to more than 300 journals listed in the Directory of Open Access Journals. Some of these journals were also on Beall's list, managed by Jeffrey Beall, a library scientist at the University of Colorado, Denver, to weed out the bad ones.
More than half of those journals accepted the bogus manuscript, which was riddled with ethical approval problems and scientific anomalies. Many of these publishers misrepresented their locations. They all claimed to be peer-reviewed journals, but many of them didn't bother to do any sort of review. A few provided reviewer comments, but agreed to publish the article even when the reviewers raised serious questions.
Bohannon claims these journals would publish anything, because in the "author pays gold model" the publisher makes money only when the article is published.
It would seem that Bohannon has neatly demonstrated a fatal flaw in open access publishing. Bohannon never explicitly compares open access model to the subscription model (in which the researcher submitting the article doesn't pay but those reading it do), but his hypothesis seems to be that open access journals driven by publication charges will be inherently biased towards acceptance.
On the surface this looks like a potentially deadly blow to open access journals that levy Article Processing Charges (APCs). But I found some glaring problems with the article and its premises.
In short, Bohannon's article isn't really about open access. It's about a flawed system of trusting journals and the inherent problems in peer review, but he targets only open access here.
Problems of this nature have been explored before. For instance, in a 1982 paper, researchers submitted articles that a journal had already published under different author names. Nearly all the submissions were rejected. Many reviewers described the manuscript as having "serious methodological flaw".
Does Science do science?
Bohannon's methodology in the sting operation is questionable. He goes to great lengths to concoct a bogus methodology for submission and to ensure the scientific flaws in his paper were credible. The key problem, however, lies in two sentences, tucked away in Bohannon's coda. He writes:
Some say that the open-access model itself is not to blame for the poor quality control revealed by Science's investigation. If I had targeted the bottom tier of traditional, subscription-based journals, [David] Roos told me, "I strongly suspect you would get the same result."
Sadly, these two sentences appear at the very end of the article. All along it seems to be an attack on open access journals. While it is not directly mentioned, the implication is "it would never happen in the subscription model". But, given this wasn't tested, how do we know?
Value addition in the publication process happens at the peer review stage, as most journals claim. The journals exposed were clearly not adding that value. But this value addition is the same whether the journal is open access or not.
So, why did Science publish such a clearly incomplete study? The harsh truth is that Bohannon's article is hostile. He submitted articles only to open access journals. This omission then wrongly links the failure of deeper problems in academia to a single business model.
While he acknowledges that the top players (including the journal PLOS ONE) provided rigorous review, Bohannon submitted his bogus paper mostly to poor journals. They do not represent open access as a whole. Although Bohannon argues that "open access has multiplied that underclass of journals", I would like to counter that it is only through a history of masking editorial processes amid claims of "value added" that we have arrived at this mess.
Peer review is a function of academic labour. Editorial decisions should be made by qualified and respected academics who run journals. If we used this model, not even the most gullible of authors would attempt submission to this underclass of journals and their predatory behaviour wouldn't exist.
Explore further: Research paper publishing sting reveals lax standards of many open-access journals
More information: Research paper publishing sting reveals lax standards of many open-access journals: phys.org/news/2013-10-paper-publishing-reveals-lax-standards.html
This story is published courtesy of The Conversation (under Creative Commons-Attribution/No derivatives).
Medical Xpress on facebook
Related Stories
Research paper publishing sting reveals lax standards of many open-access journals
1 minute ago
(Phys.org) —John Bohannon, contributing news correspondent for Science, the highly respected peer-reviewed journal has conducted what he calls a "sting operation" that reveals problems with open-access publis ...
Open access journals reaching the same scientific impact as subscription journals
Jul 16, 2012
BioMed Central's open access journal BMC Medicine adds scientific rigour to the debate about open access research, by publishing an article which compares the scientific impact of open access with traditional subscription publis ...
University of California adopts open-access policy for research papers
Aug 05, 2013
The University of California (UC)—the biggest public research university in the world, has decided to adopt a university wide open-access policy for research papers produced by its faculty. The move marks a major victory ...
Ten-fold increase in Open Access publishing during the last decade
Jun 13, 2011
Since the World Wide Web emerged in the mid 1990s scientists have dreamed of having the whole body of scientific peer reviewed literature freely available on the web, openly available without any hindrance. In the "Open Access" ...
Huge transition costs will mean a bumpy ride to reach UK's Open Access, says RSC Chief Executive
Jul 18, 2012
The Chief Executive of the Royal Society of Chemistry has welcomed the government's Open Access proposals announced yesterday, but said the estimated £50 million annual transition costs would mean a bumpy ride ahead ...
Recommended for you
Alcoholism treatment before, after liver transplantation reduces relapse
21 hours ago
New research reports that liver transplant recipients who receive substance abuse treatment before and after transplantation have much lower alcohol relapse rates than those untreated or only treated prior to transplantation. ...
Liquorice alleviates troublesome symptoms following intubation
21 hours ago
In Traditional Chinese Medicine (TCM), liquorice is regarded as a "panacea". A recent study by the University Department of Anaesthetics, General Intensive Care Medicine and Pain Therapy at the MedUni Vienna ...
New bio bank to resolve legal and ethical issues
21 hours ago
When researchers collect human tissue in a so-called bio bank, the purpose is usually to learn about various diseases and improve curing of them. But at the University of Copenhagen a group of researchers ...
Scientist researches parasite that he removed from his own body
Oct 02, 2013
Early one morning in December, Jon Allen had decided that enough was enough. He was up anyway, having taken his young son back to bed after a trip to the bathroom. Allen returned to the bathroom with a pair ...
NIH official says spending cuts pose unprecedented threat to biomedical research
Oct 02, 2013
Scientific progress and innovation are speeding along, faster than ever before, but arbitrary spending cuts are posing an unprecedented threat.
China's e-cigarette inventor fights for financial rewards
Oct 02, 2013
The Chinese inventor who dreamed up the electronic cigarette in a nicotine-induced vision says that despite its global popularity, copycat versions and legal disputes mean he has battled to cash in on his creation.
User comments
© Medical Xpress 2011-2013, Phys.org network
0 comments:
Post a Comment