» Articles » PMID: 36200060

Conservatism Gets Funded? A Field Experiment on the Role of Negative Information in Novel Project Evaluation

Overview
Journal Manage Sci
Date 2022 Oct 6
PMID 36200060
Authors
Affiliations
Soon will be listed here.
Abstract

The evaluation and selection of novel projects lies at the heart of scientific and technological innovation, and yet there are persistent concerns about bias, such as conservatism. This paper investigates the role that the format of evaluation, specifically information sharing among expert evaluators, plays in generating conservative decisions. We executed two field experiments in two separate grant-funding opportunities at a leading research university, mobilizing 369 evaluators from seven universities to evaluate 97 projects, resulting in 761 proposal-evaluation pairs and more than $250,000 in awards. We exogenously varied the relative valence (positive and negative) of others' scores and measured how exposures to higher and lower scores affect the focal evaluator's propensity to change their initial score. We found causal evidence of a negativity bias, where evaluators their scores by more points after seeing scores more than their own rather than them after seeing more scores. Qualitative coding of the evaluators' justifications for score changes reveals that exposures to lower scores were associated with greater attention to uncovering weaknesses, whereas exposures to neutral or higher scores were associated with increased emphasis on nonevaluation criteria, such as confidence in one's judgment. The greater power of negative information suggests that information sharing among expert evaluators can lead to more conservative allocation decisions that favor protecting against failure rather than maximizing success.

Citing Articles

Promotional language and the adoption of innovative ideas in science.

Peng H, Qiu H, Fosse H, Uzzi B Proc Natl Acad Sci U S A. 2024; 121(25):e2320066121.

PMID: 38861605 PMC: 11194578. DOI: 10.1073/pnas.2320066121.


Does familiarity with an idea bias its evaluation?.

Greul A, Schweisfurth T, Raasch C PLoS One. 2023; 18(7):e0286968.

PMID: 37405981 PMC: 10321622. DOI: 10.1371/journal.pone.0286968.


Is novel research worth doing? Evidence from peer review at 49 journals.

Teplitskiy M, Peng H, Blasco A, Lakhani K Proc Natl Acad Sci U S A. 2022; 119(47):e2118046119.

PMID: 36395142 PMC: 9704701. DOI: 10.1073/pnas.2118046119.

References
1.
Lane J, Ganguli I, Gaule P, Guinan E, Lakhani K . Engineering serendipity: When does knowledge sharing lead to knowledge production?. Strateg Manag J. 2021; 42(6):1215-1244. PMC: 8297436. DOI: 10.1002/smj.3256. View

2.
Boudreau K, Guinan E, Lakhani K, Riedl C . Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science. Manage Sci. 2016; 62(10):2765-2783. PMC: 5062254. DOI: 10.1287/mnsc.2015.2285. View

3.
Gewin V . Risky research: The sky's the limit. Nature. 2012; 487(7407):395-7. DOI: 10.1038/nj7407-395a. View

4.
Dovidio J, Gaertner S, Validzic A . Intergroup bias: status, differentiation, and a common in-group identity. J Pers Soc Psychol. 1998; 75(1):109-20. DOI: 10.1037//0022-3514.75.1.109. View

5.
Thursby J, Haeussler C, Thursby M, Jiang L . Prepublication disclosure of scientific results: Norms, competition, and commercial orientation. Sci Adv. 2018; 4(5):eaar2133. PMC: 5955623. DOI: 10.1126/sciadv.aar2133. View