Files and links (1)
CC BY V4.0, Open Access
Journal article
A practical method for searching scholarly papers in the General Index without a high-performance computer
The code4lib journal, (58)
12/04/2023
DOI:
https://doi.org/10.7273/000005544
Abstract
The General Index is a free database that offers unprecedented access to keywords and ngrams derived from the full text of over 107 million scholarly articles. Its simplest use is looking up articles that contain a term of interest, but the data set is large enough for text mining and corpus linguistics. Despite being positioned as a public utility, there is no user interface; one must download, query, and extract results from raw data tables. Not only is computing skill a barrier to use, but the file sizes are too large for most desktop computers to handle. This article will show a practical way to use the GI for researchers with moderate skills and resources. It will walk though building a bibliography of articles and a visualizing yearly prevalence of a topic in the General Index, using simple R programming commands and a modestly equipped desktop computer (code is available at https://osf.io/s39n7/). It will briefly discuss what else can be done (and how) with more powerful computational resources.
Metrics
5 File views/ downloads
25 Record Views
Details
- Title
- A practical method for searching scholarly papers in the General Index without a high-performance computer
- Creators
- Emily S. Cukier (Author) - Washington State University, Libraries
- Publication Details
- The code4lib journal, (58)
- Academic Unit
- Libraries
- Publisher
- Washington State University
- Identifiers
- 99901053038001842
- Language
- English
- Resource Type
- Journal article