Climate impacts to inland fishes: Topic modeling of literature trends analysis script

Originator: Andrew DiSanto

Dates

Publication Date: 2023-08-07
Start Date: 1985
End Date: 2021

Citation

DiSanto, A., 2023, Climate impacts to inland fishes: Topic modeling of literature trends analysis script: National and Regional Climate Adaptation Science Centers data release, https://doi.org/10.21429/n7z0-b813.

Summary

This script applies topic modeling to analyze literature trends of climate impacts to inland fish based on the papers within the Fish and Climate Change Database (FiCli, DOI: 10.5066/P9973SMC). Sections 1-8 loaded the .bib file with all of the papers in the database and cleaned the text. This included combining the title/abstract/keywords, removing non-informative words, stemming words, removing punctuation, and forming phrases (ie. climate change to climate_change). Sections 9-10 divided the papers into discrete topics by identifying the ideal number of topics and then using Latent Dirichlet Allocation (LDA) modeling and Gibbs sampling to assign topics to each paper. Sections 11-17 analyzed the topic modeling results and generated [...]

Summary

This script applies topic modeling to analyze literature trends of climate impacts to inland fish based on the papers within the Fish and Climate Change Database (FiCli, DOI: 10.5066/P9973SMC). Sections 1-8 loaded the .bib file with all of the papers in the database and cleaned the text. This included combining the title/abstract/keywords, removing non-informative words, stemming words, removing punctuation, and forming phrases (ie. climate change to climate_change). Sections 9-10 divided the papers into discrete topics by identifying the ideal number of topics and then using Latent Dirichlet Allocation (LDA) modeling and Gibbs sampling to assign topics to each paper. Sections 11-17 analyzed the topic modeling results and generated figures for the paper. Section 11 produced a graph of paper counts by year along with information about whether the paper described documented or projected climate change impacts. This included loading projected/documented data from FiCli, calculating the ratio of documented papers over time, and graphing the results. The graph also featured lines representing major climate change policy milestones. Section 12 plotted topic count over time as percent stacked bar plot with lines representing policy milestones. This plot was used in combination with Section 11 to see how policy changes corresponded to changes in the literature. Section 13 calculated the word weight matrix (weight of each word in each topic), article weight matrix (weight of each topic in each paper), and distance matrices (distance between words/articles of each topic pair). Section 14 identified topic similarity based on word distributions by plotting the word weight distance matrix using non-metric multidimensional scaling (NMDS). Closer points had more similar word distributions, points were sized by paper count, and points were colored by documented/projected. Section 15 identified topics as general or specific based on the article weight matrix, with specific papers having a greater weight for one topic. Points were colored and sized similarly. Section 16 identified research gaps between topics by using the word weight and article weight distance matrices to plot the results as a heatmap. Topic gaps had high word and article distances. Section 17 determined how topic weights varied over time by calculating the mean change in topic weight between successive years and plotting the results as a bar plot.

Contacts

Originator :: Andrew DiSanto
Point of Contact :: Abigail J Lynch, U.S. Geological Survey, ECOSYSTEMS
Metadata Contact :: Andrew DiSanto
Distributor :: GS ScienceBase, U.S. Geological Survey

Attached Files

Click on title to download individual files attached to this item.

CumulativeDocProj.csv “Count and ratio of projected and documented papers by year in the FiCli database”		1.47 KB	text/csv
FiCli_Papers_2021_bib.bib “Papers comprising the FiCli database from 1985-2021 (.bib)”		726.72 KB	application/x-bibtex-text-file
FiCli_Papers_2021_bib.csv “Papers comprising the FiCli database from 1985-2021 (.csv)”		654.46 KB	text/csv
PaperVariables.csv “Paper details extracted from the FiCli database from 1985-2021, including title ”		605.83 KB	text/csv
Published_USGS_README.Rmd “Script ReadMe ”		5.37 KB	text/plain
Published_USGS_Topic_Modeling_Script.Rmd “R script for conducting topic modeling analysis of papers in the FiCli database ”		31.96 KB	text/plain
TopicModelingXML.xml “R script for conducting topic modeling analysis of papers in the FiCli database ” Original FGDC Metadata	View	24.14 KB	application/fgdc+xml

Related External Resources

Type: Web Link

Digital Data	https://doi.org/10.21429/n7z0-b813

Type: Related Primary Publication

Lynch AJ, DiSanto A, Olden JD, Chu C, Paukert CP, Gundermann D, et al. 2023; PLOS Climate	https://doi.org/10.1371/journal.pclm.0000326

Purpose

This code was made for a paper conducting topic modeling of the FiCli database, but it can also be applied to more general topic modeling analysis. Users can upload their own papers, common phrases, and paper variables to perform topic modeling on papers related to any theme, not just climate impacts on inland fish.

Climate impacts to inland fishes: Topic modeling of literature trends analysis script

Dates

Citation

Summary

Summary

Contacts

Attached Files

Purpose

Map

Communities

Associated Items

Tags

Provenance

Additional Information

Identifiers

Citation Extension

Item Actions

View Item as ...

Save Item as ...

View Item...