Location filtered citation counting: How much of a difference does it make in research evaluation?

Leiden Repository

Location filtered citation counting: How much of a difference does it make in research evaluation?

Type: Article in monograph or in proceedings
Title: Location filtered citation counting: How much of a difference does it make in research evaluation?
Author: Zhao D.Strotmann A.
Journal Title: STI 2018 Conference Proceedings
Start Page: 825
End Page: 833
Publisher: Centre for Science and Technology Studies (CWTS)
Issue Date: 2018-09-11
Keywords: Scientometrics
Abstract: Previous studies stressed the importance to filter out nonessential in-text citations before assigning weight in order to improve the accuracy and effectiveness of frequency-weighted citation analysis, and proposed and tested filtering nonessential citations by their in-text frequency. The present study explores an alternative filtering method with a likely better accuracy rate, i.e., removing introductory and background sections, to see what a difference it makes in ranking authors by citations. We examined the correlations and rank changes of individual authors between rankings by traditional citation counting and those by in-text frequency-weighted citation counting before and after the filtration. We found that removing introductory and background sections alone doesn’t make much of a difference in author rankings, but it makes a huge difference when combined with frequency-weighted counting. This combination appears to make essential citations stand out, as shown by it ranking biomedicine-focused authors higher and bibliometrics-focused ones lower, except those who represent methods/tools/indicators/guidelines that were directly useful for studies of biomedical fields that apply bibliometrics. Interestingly, the present study also finds that the filtering and the weighing appear to have different effects as indicated by medium correlations between rankings by each separately. This difference warrants future detailed studies to identify the separate factors involved. 
Handle: http://hdl.handle.net/1887/65206
 

Files in this item

Description Size View
application/pdf STI2018_paper_142.pdf 1.191Mb View/Open

This item appears in the following Collection(s)