IsisCB Explore

Article ID: CBB181098680

Peer Review or Lottery? A Critical Analysis of Two Different Forms of Decision-making Mechanisms for Allocation of Research Grants (2019)

Roumbanis, Lambros (Author)

Science, Technology and Human Values
Volume: 44
Issue: 6
Pages: 994-1019

URI: https://doi.org/10.1177/0162243918822744

DOI: 10.1177/0162243918822744

Outside Links

WorldCat

Google Scholar

JSTOR

Academia.edu

Decision making Government sponsored science Technoscience; science and technology studies Research support Funding and finance Peer review 21st century

At present, peer review is the most common method used by funding agencies to make decisions about resource allocation. But how reliable, efficient, and fair is it in practice? The ex ante evaluation of scientific novelty is a fundamentally uncertain endeavor; bias and chance are embedded in the final outcome. In the current study, I will examine some of the most central problems of peer review and highlight the possible benefits of using a lottery as an alternative decision-making mechanism. Lotteries are driven by chance, not reason. The argument made in the study is that the epistemic landscape could benefit in several respects by using a lottery, thus avoiding all types of bias, disagreement, and other limitations associated with the peer review process. Funding agencies could form a pool of funding applicants who have minimal qualification levels and then select randomly within that pool. The benefits of a lottery would not only be that it saves time and resources, but also that it contributes to a more dynamic selection process and increases the epistemic diversity, fairness, and impartiality within academia.

...More

Citation URI

https://data.isiscb.org/isis/citation/CBB181098680/

Citations Indexes

Similar Citations

Book Charrow, Robert P.; (2010)
Law in the Laboratory: A Guide to the Ethics of Federally Funded Science Research (/isis/citation/CBB001022405/)

Article Shahar Avin; (2019)
Mavericks and lotteries (/isis/citation/CBB954357351/)

Article Shul'gina, I. V.; (2010)
People, Money, Real Estate: Evolution of Resources for Russian Science, 1990--2007 (/isis/citation/CBB001211371/)

Article Duckhee Jang; Doh Soogwan; Gil-Mo Kang; Dong-Seong Han; (January 2017)
Impact of Alumni Connections on Peer Review Ratings and Selection Success Rate in National Research (/isis/citation/CBB477207269/)

Article Lambros Roumbanis; (2022)
Disagreement and Agonistic Chance in Peer Review (/isis/citation/CBB437513195/)

Thesis Coryn, Chris L. S.; (2007)
Evaluation of Researchers and Their Research: Toward Making the ImplicitExplict (/isis/citation/CBB001560518/)

Article Frank N. Laird; (2020)
Sticky Policies, Dysfunctional Systems: Path Dependency and the Problems of Government Funding for Science in the United States (/isis/citation/CBB444679505/)

Article Crosland, Maurice; (2010)
Pensions for “Cultivators of Science” (/isis/citation/CBB001031489/)

Article Fengler, Silke; Luxbacher, Günther; (2011)
“Aufrechterhaltung der gemeinsamen Kultur.” Die Deutsche Forschungsgemeinschaft und die Österreichisch-Deutsche Wissenschaftshilfe in der Zwischenkriegszeit (/isis/citation/CBB001220463/)

Book Orth, Karin; Oberkrome, Willi; (2010)
Die Deutsche Forschungsgemeinschaft 1920--1970: Forschungsförderung im Spannungsfeld von Wissenschaft und Politik (/isis/citation/CBB001023723/)

Article Audrey Harnagel; (2019)
A mid-level approach to modeling scientific communities (/isis/citation/CBB951020797/)

Article Sergio Sismondo; (December 2019)
Academic Lives and Cultures (/isis/citation/CBB500921335/)

Article Lambros Roumbanis; (February 2017)
Academic judgments under uncertainty: A study of collective anchoring effects in Swedish Research Council panel groups (/isis/citation/CBB341757393/)

Book Lamont, Michèle; (2009)
How Professors Think: Inside the Curious World of Academic Judgment (/isis/citation/CBB001021289/)

Article Rachel J. Wilde; David Guile; (2021)
Client-facing Interprofessional Project Teams: The Role of Engineers’ ‘Situated Judgment’ (/isis/citation/CBB589787344/)

Article Alexandra Coso Strong; Tehya Stockman; Tom Heale; Steven Meyer; Elena Meyerson; (2022)
Persuasive Communication Practices of Engineers in Cross-Boundary Decision-Making (/isis/citation/CBB458121138/)

Article Dilshani Sarathchandra; (2017)
Risky Science? Perception and Negotiation of Risk in University Bioscience (/isis/citation/CBB691241938/)

Book Louise Amoore; (2020)
Cloud ethics : Algorithms and the attributes of ourselves and others (/isis/citation/CBB491357774/)

Article Alcañiz, Isabella; (2010)
Bureaucratic Networks and Government Spending: A Network Analysis of Nuclear Cooperation in Latin America (/isis/citation/CBB001020860/)

Article Dow Schüll, Natusha; Zaloom, Caitlin; (August 2011)
The shortsighted brain: Neuroeconomics and the governance of choice in time (/isis/citation/CBB240640662/)

Comments

{{ comment.created_by.username }} on {{ comment.created_on | date:'medium' }}