Scientists can now post preliminary, non-peer-reviewed findings on a new Nature Web site, but will doing so help -- or hurt -- their odds of getting published and promoted?
Alma Swan, co-founder of Key Perspectives, a scholarly communication consulting firm, said it's still unclear how other scientists will view data published on the new site, called Nature Precedings. If a candidate is being evaluated by a tenure review board and has a high number of citations on Precedings, Swan asked, how much do those citations reflect on the candidate's merit, in comparison to citations in other publications?
It's also too soon to tell how other journals will treat data that appeared on Precedings -- for instance, if they will consider Precedings data as published, and consequently hesitate to publish any later iterations of the findings, Diane Lang, Vice President of the Council of Science Editors, told The Scientist. "I'm sure there will be a variety of responses [to the site] because there are a lot of different models of how publications handle submissions," she said.
An additional statement from CSE to The Scientist said: "This informal communication mechanism's success will depend on its value to the research community, and time will tell if Nature Precedings will be a worthwhile source for some types of information."
Precedings will post preliminary findings by credited researchers, and submissions are now monitored by a part-time staff of seven editors. All data and findings on Precedings are considered "pre-print" and can be cited by other scientists. Any findings that have appeared in another journal, or have a digital object identifier (DOI), will not be posted, Brenda Riley, one of the curators for the new site, told The Scientist.
Other criteria for posting include relevance -- ensuring the subject matter is relevant and will be of interest to readers, Riley added. Editors also check the material for copyright violations and verify authors, making sure they're who they say they are and at valid institutions. Clinical trial data are not eligible for posting.
Nature Publishing Group considers material appearing in Precedings completely acceptable for later peer-review publication, and Nature has always been open to publishing material that has appeared somewhere else in pre-print, Timo Hannay, director of Web publishing at NPG, told The Scientist. By making the material on Precedings citable, scientists can maintain the intellectual property of their work and get early results out sooner, bypassing the sometimes long process of the peer-review system, he added.
Precedings is meant to be complementary to the formal peer-reviewed process of publishing, Hanny said. "We don't pretend that publishing in Precedings is the same as publishing in peer-reviewed journals," he said. "Scientists do have informal documents that they share with one another, at meetings and such. We want to give them an opportunity so that those documents -- the informal literature -- can be archived, made citable, and readily available."
Findings posted on Precedings are "certainly not 'published,'" Riley said. "I obviously couldn't speak for other publishing companies but the main thing to remember is that Precedings isn't a journal as such," Riley said. "Submissions don't undergo peer review -- it is purely an archival system so that it shouldn't affect publication afterward." At issue is the Ingelfinger Rule, which states that, as a policy, journals will not consider a manuscript for publication if its findings have been submitted or reported elsewhere.
Don Kennedy, editor-in-chief at Science, said in an Email that it's "too early to make any judgment on" whether Science would consider publishing data posted on Nature Precedings. "We've looked at the new Nature Precedings site with interest, and we'll continue to watch it."
For now, Hannay and NPG are waiting to see what the response to Precedings will be. As of now, they have just over 60 posted submissions on the site.
Last year, NPG conducted a Web experiment that gave authors the chance to post their articles undergoing peer review on a Web site for public review. The four-month trial concluded and, because of low participation by authors, NPG decided not to pursue the project further, Hannay said. The Precedings site is also somewhat of an experiment, he added, both of how much work is submitted, and whether other journals will be open to the idea of publishing data already available on Precedings.
"Nature has shown itself to be extremely innovative," Swan said. But the first thing most researchers will say is "'we'll share our data, but for doing that we need some kind of accreditation system, some measurable return.' There isn't a system for that at the moment."
Would you consider posting your data on Nature Precedings? Tell us why or why not here.
Andrea Gawrylewski
mail@the-scientist.com
Links within this article:
Nature Publishing Group
http://www.nature.com/index.html
Alma Swan
http://www.keyperspectives.co.uk/aboutus/aswan.html
Nature Precedings
http://precedings.nature.com/
Council of Science Editors
http://www.councilscienceeditors.org
A. McCook, "Is peer review broken?" The Scientist, February, 2006.
http://www.the-scientist.com/article/display/23061
J. Toy, "The Ingelfinger Rule: Franz Ingelfinger at the New England Journal of Medicine, 1967-1977," Science Editor, November-December 2002
http://www.councilscienceeditors.org/members/securedDocuments/v25n6p195-198.pdf

[Comment posted 2007-06-25 17:50:12]
[Comment posted 2007-06-21 19:48:43]
With open preprint systems, being able to find useful and reliable ideas and data in articles is perhaps more important than being able to submit one. This becomes apparent as the number of articles increase, when searching can return hundreds and thousands of articles. One canᅡメt go through all of them, and a few ᅡムbadᅡメ articles can easily cause frustration and distrust in the quality of the submissions.
But if search criteria can include objective measures of article quality, then one can indeed easily find valuable material. Nature Precedings should therefore opt for a point-based rating system where different aspects of articles can be appraised.
Thus, instead of just letting one vote for an article, one should be allowed to rate its different aspects on, say, a 1-5 scale. Such aspects can include:
1. clarity
2. originality
3. novelty
4. presence and quality of experimental data
5. logical procession
6. depth
7. proper referencing
In effect, this would be a proper peer-review system.
The ratings, both their average and their spread, should be displayed alongside articles.
A good review/rating system will discourage submission of bad articles, build trust in the usability and reliability of content in Nature Precedings, and encourage quality submissions.
(similar comments posted elsewhere on the web by me)
[Comment posted 2007-06-21 02:57:42]
Patent applications submitted to USPTO (unless you check the box "do not publish") get freely and widely disseminated without any "peer review" at all.
Of course, there is a difference; if the patent application is examined successfully and a patent is granted, inventors have privileges for their pioneering. (If no claims are granted, there may still be significant residual credit - up for history to decide).
If "peer review system" would work as intended (it does not), "posted" outlet would be not be a tremendous idea. However, the very fact that the "posted" outlet is emerging is proof that "peer review" all too often inhibits or prohibits true innovation ("thinking outside the box") - and for the sake of progress of science innovative outlets must be created.
"Posted" publication is criticism of the "peer review system"; "checks and balances at work".
I wish Barbara McClintock did not stop publishing because she was just too far ahead. With "posted" outlets available to her, science would be much further ahead.
pellionisz_at_junkdna.com
[Comment posted 2007-06-20 21:52:36]
[Comment posted 2007-06-20 17:47:28]
Furthermore, in my opinion the news items appeared to be on the sensational side -- in the least -- and biased -- for the most part. I emailed Nature's email site to which I responded in their requesting that I review Nature expressing my negative view of the News section and told Nature that I would no longer participate in the review process -- Never got a response from Nature -- but I am still getting Nature weekly?
I can't believe that an un-referred Nature publication -- would be-- from a scientists use -- "Worth the paper it was published on!" -- to coin a phrase!