同行評議:單盲還是雙盲,這是一個問題 | BMC Journal |
論文標題:Uptake and outcome of manuscripts in Nature journals by review model and author characteristics
期刊:Research Integrity and Peer Review
作者:Barbara McGillivray and Elisa De Ranieri
發表時間:2018/08/17
數字識別碼:10.1186/s41073-018-0049-z
原文連結:https://researchintegrityjournal.biomedcentral.com/articles/10.1186/s41073-018-0049-z?utm_source=WeChat&utm_medium=Website_linksSocial_media_organic&utm_content=CelZha-MixedBrand-multijournal-Multidisciplinary-China&utm_campaign=ORG_AWA_CZH_BMCWechat_dailyposts_blogs
微信連結:https://mp.weixin.qq.com/s/jNTPNTGcz3bIF-brWcenpg
原文作者:Barbara McGillivray,Elisa De Ranieri
本周是同行評審周,我們邀您一起回顧最近發表在Research Integrity and Peer Review上的文章Update and outcome of manuscripts in Nature journals by review model and author characteristics對Nature旗下25本期刊的審稿模式進行的數據分析。有多少作者選擇了雙盲同行評議(double-blind peer review)?什麼樣的作者更青睞雙盲同行評議?文章試圖為這些問題找到答案。
圖片來源:flickr.com/Gideon Burton
較為傳統的審稿模式通常是單盲同行評議(single-blind peer review),在這種模式中審稿人知道作者的身份和所屬機構。但是在雙盲同行評議(double-blind peer review)中,審稿人看不到作者的身份和所屬機構,作者也不知道審稿人的信息。
雙盲同行評議是為避免學術出版中可能存在的審稿人偏差而提出的一種可能的解決方案。這個研究的目標就是找出選擇雙盲同行評議的通訊作者們都具備什麼特點,以及選擇不同的審稿模式對發表結果是否存在影響。
方法
作者使用的數據包括25本自然旗下期刊在2015年3月到2017年2月間收到的128,454份投稿。他們調查了雙盲同行評議與期刊等級、性別、國家和通訊作者所在機構的國際地位之間的關係,以及稿件接收情況和審稿模式、作者特徵之間的聯繫。
通訊作者的性別(分為男性、女性和不確定三類)是用一個第三方服務通過作者的名(first name)來確定的。通訊作者所在機構的國際地位則是按2016-2017年度泰晤士高等教育(Times Higher Education, THE)的排名情況將所有機構分為3個類別:類別1為THE排名中1到10名的學校,投稿數佔總數的6%;類別2為THE排名11到100的學校,投稿數佔總數的20%;類別3為THE排名100之後的學校,投稿數佔總數的30%。其他因本身不是大學而不在THE排名中的所有機構都列為類別4,投稿數佔總數的45%。
數據分析結果
研究者發現,在所有投稿中有12%選擇了雙盲同行評議。期刊級別和審稿模式間存在明顯的關聯,所投期刊級別越高,選擇雙盲同行評議的比例越高。(表2)
表2 依據期刊等級的同行評議模型
在分析了50,533名通訊作者的性別信息之後,研究者發現審稿模式的選擇和性別之間沒有明顯關聯。
從通訊作者的從屬機構來看,所在機構的國際地位越低,作者越可能選擇雙盲同行評議(表4)。
表4 依據機構組的同行評議模型
在投稿量最多的10個國家裡,研究者發現國家和審稿模式之間高度相關。中國作者最喜歡使用雙盲同行評議,而美國作者最喜歡單盲同行評議。亞洲國家更傾向於使用雙盲同行評議。
表5 依據國家的同行評議模型
從投稿結果來看,選擇雙盲同行評議的文章無論是初審結果還是審稿人評議後的結果都比單盲同行評議的文章更差。
結論
該研究是第一個根據作者選擇的審稿模式(雙盲vs.單盲同行評議)來分析、比較涵蓋廣泛學科的科學期刊對投稿接收情況的研究。他們按審稿模式和通訊作者的特徵,對2年內向25本自然旗下期刊投稿的資料庫進行了分析。他們的目的是了解作者的特徵,並推斷出與通訊作者的性別、國家或所屬機構國際地位相關的任何潛在的隱性偏見。
該研究為作者在向高影響力期刊投稿時的行為提供了新的見解。研究者們發現,作者們向自然旗下期刊投稿時,期刊影響力越大作者們越傾向於選擇雙盲同行評議;某些特定國家(在投稿率較高的國家中印度和中國尤其如此)的作者特別青睞雙盲同行評議;作者所在機構國際排名越靠後,越容易選擇雙盲同行評議。沒有觀察到作者的性別對投稿模式有任何影響。
研究者還發現,選擇雙盲同行評議的投稿被送審和被接收的可能性比選擇單盲同行評議的投稿更小;來自女性作者和來自國際排名較靠後的機構的作者,其投稿的接收率分別低於男性作者和機構國際排名較靠前的作者。
不過由於成功被接收的論文數量較少,投稿質量也缺乏獨立的評價標準,研究者表示無法就隱性偏見的存在以及雙盲同行評議在減少或消除這種偏見的有效性得到確切的結論。
摘要:
Background
Double-blind peer review has been proposed as a possible solution to avoid implicit referee bias in academic publishing. The aims of this study are to analyse the demographics of corresponding authors choosing double-blind peer review and to identify differences in the editorial outcome of manuscripts depending on their review model.
Methods
Data includes 128,454 manuscripts received between March 2015 and February 2017 by 25 Nature-branded journals. We investigated the uptake of double-blind review in relation to journal tier, as well as gender, country, and institutional prestige of the corresponding author. We then studied the manuscripts』 editorial outcome in relation to review model and author’s characteristics. The gender (male, female, or NA) of the corresponding authors was determined from their first name using a third-party service (Gender API). The prestige of the corresponding author’s institutions was measured from the data of the Global Research Identifier Database (GRID) by dividing institutions in three prestige groups with reference to the 2016 Times Higher Education (THE) ranking. We employed descriptive statistics for data exploration, and we tested our hypotheses using Pearson’s chi-square and binomial tests. We also performed logistic regression modelling with author update, out-to-review, and acceptance as response, and journal tier, author gender, author country, and institution as predictors.
Results
Author uptake for double-blind submissions was 12% (12,631 out of 106,373). We found a small but significant association between journal tier and review type (p value < 0.001, Cramer’s V = 0.054, df = 2). We had gender information for 50,533 corresponding authors and found no statistically significant difference in the distribution of peer review model between males and females (p value = 0.6179). We had 58,920 records with normalised institutions and a THE rank, and we found that corresponding authors from the less prestigious institutions are more likely to choose double-blind review (p value < 0.001, df = 2, Cramer’s V = 0.106). In the ten countries with the highest number of submissions, we found a large significant association between country and review type (p value < 0.001, df = 10, Cramer’s V = 0.189). The outcome both at first decision and post review is significantly more negative (i.e. a higher likelihood for rejection) for double-blind than single-blind papers (p value < 0.001, df = 1, Cramer’s V = 0.112 for first decision; p value < 0.001; df = 1, Cramer’s V = 0.082 for post-review decision).
Conclusions
The proportion of authors that choose double-blind review is higher when they submit to more prestigious journals, they are affiliated with less prestigious institutions, or they are from specific countries; the double-blind option is also linked to less successful editorial outcomes.
閱讀原文請訪問:
https://researchintegrityjournal.biomedcentral.com/articles/10.1186/s41073-018-0049-z?utm_source=WeChat&utm_medium=Website_linksSocial_media_organic&utm_content=CelZha-MixedBrand-multijournal-Multidisciplinary-China&utm_campaign=ORG_AWA_CZH_BMCWechat_dailyposts_blogs
期刊介紹:
Research Integrity and Peer Review (https://researchintegrityjournal.biomedcentral.com/)is an international, open access, peer reviewed journal that encompasses all aspects of integrity in research publication, including peer review, study reporting, and research and publication ethics. Particular consideration is given to submissions that address current controversies and limitations in the field and offer potential solutions. We welcome research into peer review and editorial decision making, however reports of individual journal or publisher decisions or actions will not be considered.
(來源:科學網)
特別聲明:本文轉載僅僅是出於傳播信息的需要,並不意味著代表本網站觀點或證實其內容的真實性;如其他媒體、網站或個人從本網站轉載使用,須保留本網站註明的「來源」,並自負版權等法律責任;作者如果不希望被轉載或者聯繫轉載稿費等事宜,請與我們接洽。