Measuring Discursive Influence Across Scholarship

Gerow, Aaron; Hu, Yuening; Boyd-Graber, Jordan; Blei, David and Evans, James. 2018. Measuring Discursive Influence Across Scholarship. Proceedings of the National Academy of Sciences, 115(13), pp. 3308-3313. ISSN 0027-8424 [Article]
Copy

Assessing scholarly influence is critical for researchers surveying literature, institutions seeking to credit and support scholarly work, and understanding the history of academic inquiry. Influence is multi-faceted and citations reveal only part of it. Citation counts exhibit preferential attachment and follow a rigid ``news cycle’’ that can miss sustained and indirect forms of influence. Building on dynamic topic models that track distributional shifts in discourse over time, we introduce a novel variant that incorporates features such as authorship, affiliation, and publication venue to assess how these contexts interact with content to shape future scholarship. We perform in-depth analyses on collections of physics research (500K abstracts; 102 years) and scholarship generally (JSTOR: 2M full-text articles; 130 years). Our measure of document influence helps predict citations, and shows how outcomes such as winning a Nobel Prize or affiliation with a highly ranked institution boost influence. Analysis of citations alongside discursive influence reveals that citations tend to credit authors who persist in their fields over time, and discount credit for works that are influential over many topics or are ``ahead of their time’’. In this way, our measures provide a way to acknowledge diverse contributions that take longer and travel further to achieve scholarly appreciation, enabling us to correct citation biases and enhance sensitivity to the full spectrum of scholarly impact.


picture_as_pdf
1719792115.full.pdf
subject
Published Version
Available under Creative Commons: Attribution-NonCommercial-No Derivative Works 3.0

View Download

Supplemental Material


Atom BibTeX OpenURL ContextObject in Span OpenURL ContextObject Dublin Core Dublin Core MPEG-21 DIDL Data Cite XML EndNote HTML Citation METS MODS RIOXX2 XML Reference Manager Refer ASCII Citation
Export

Downloads