Exploration of reproducibility issues in scientometric research

Theresa Velden; Sybille Hinze; A.M. Scharnhorst; Jesper Wiborg Schneider; Ludo Waltman

Exploration of reproducibility issues in scientometric research

Theresa Velden, Sybille Hinze, A.M. Scharnhorst, Jesper Wiborg Schneider, Ludo Waltman

DANS-KNAW

Research output: Chapter in book/volume › Contribution to conference proceedings › Scientific › peer-review

74 Downloads (Pure)

Abstract

The (lack of) reproducibility of published research results has recently come under close scrutiny in some fields of science (see e.g. Flier 2017 for a discussion of bio-sciences, and e.g. Open Science Collaboration 2015 and Pashler & Harris 2012 for an assessment of the situation in psychology). Aside from genuine error or fraud as sources for the irreproducibility of published research, theoretical investigations (e.g. Ioannidis 2005) and empirical investigations (e.g. John et al. 2012) identify the use of questionable research methods, the overselling of results by overstating claims, and publication bias - the tendency to select positive results over negative results for publication - as further sources for the irreproducibility of results.

Original language	English
Title of host publication	STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators
Editors	Rodrigo Costas, Thomas Franssen, Alfredo Yegros-Yegros
Publisher	Centre for Science and Technology Studies (CWTS)
Pages	612-624
Publication status	Published - 2018

Access to Document

STI2018_paper_113Accepted author manuscript, 1.38 MBLicence: CC0

2 Preprint

Exploration of reproducibility issues in scientometric research Part 1: Direct reproducibility
Waltman, L., Hinze, S., Scharnhorst, A., Schneider, J. W. & Velden, T., 13 Apr 2018.
Research output: Working paper/discussion paper › Preprint

Open Access
File
Exploration of Reproducibility Issues in Scientometric Research Part 2: Conceptual Reproducibility
Velden, T., Hinze, S., Scharnhorst, A., Schneider, J. W. & Waltman, L., 13 Apr 2018.
Research output: Working paper/discussion paper › Preprint

Open Access
File

Cite this

Velden, T., Hinze, S., Scharnhorst, A. M., Schneider, J. W., & Waltman, L. (2018). Exploration of reproducibility issues in scientometric research. In R. Costas, T. Franssen, & A. Yegros-Yegros (Eds.), STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators (pp. 612-624). Centre for Science and Technology Studies (CWTS).

Velden, Theresa ; Hinze, Sybille ; Scharnhorst, A.M. et al. / Exploration of reproducibility issues in scientometric research. STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators. editor / Rodrigo Costas ; Thomas Franssen ; Alfredo Yegros-Yegros. Centre for Science and Technology Studies (CWTS), 2018. pp. 612-624

@inbook{9beccf538ebc4610b0bc7b266b2c83b5,

title = "Exploration of reproducibility issues in scientometric research",

abstract = "The (lack of) reproducibility of published research results has recently come under close scrutiny in some fields of science (see e.g. Flier 2017 for a discussion of bio-sciences, and e.g. Open Science Collaboration 2015 and Pashler & Harris 2012 for an assessment of the situation in psychology). Aside from genuine error or fraud as sources for the irreproducibility of published research, theoretical investigations (e.g. Ioannidis 2005) and empirical investigations (e.g. John et al. 2012) identify the use of questionable research methods, the overselling of results by overstating claims, and publication bias - the tendency to select positive results over negative results for publication - as further sources for the irreproducibility of results.",

author = "Theresa Velden and Sybille Hinze and A.M. Scharnhorst and Schneider, {Jesper Wiborg} and Ludo Waltman",

year = "2018",

language = "English",

pages = "612--624",

editor = "Rodrigo Costas and Thomas Franssen and Alfredo Yegros-Yegros",

booktitle = "STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators",

publisher = "Centre for Science and Technology Studies (CWTS)",

}

Exploration of reproducibility issues in scientometric research. / Velden, Theresa; Hinze, Sybille; Scharnhorst, A.M. et al.
STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators. ed. / Rodrigo Costas; Thomas Franssen; Alfredo Yegros-Yegros. Centre for Science and Technology Studies (CWTS), 2018. p. 612-624.

Research output: Chapter in book/volume › Contribution to conference proceedings › Scientific › peer-review

TY - CHAP

T1 - Exploration of reproducibility issues in scientometric research

AU - Velden, Theresa

AU - Hinze, Sybille

AU - Scharnhorst, A.M.

AU - Schneider, Jesper Wiborg

AU - Waltman, Ludo

PY - 2018

Y1 - 2018

N2 - The (lack of) reproducibility of published research results has recently come under close scrutiny in some fields of science (see e.g. Flier 2017 for a discussion of bio-sciences, and e.g. Open Science Collaboration 2015 and Pashler & Harris 2012 for an assessment of the situation in psychology). Aside from genuine error or fraud as sources for the irreproducibility of published research, theoretical investigations (e.g. Ioannidis 2005) and empirical investigations (e.g. John et al. 2012) identify the use of questionable research methods, the overselling of results by overstating claims, and publication bias - the tendency to select positive results over negative results for publication - as further sources for the irreproducibility of results.

AB - The (lack of) reproducibility of published research results has recently come under close scrutiny in some fields of science (see e.g. Flier 2017 for a discussion of bio-sciences, and e.g. Open Science Collaboration 2015 and Pashler & Harris 2012 for an assessment of the situation in psychology). Aside from genuine error or fraud as sources for the irreproducibility of published research, theoretical investigations (e.g. Ioannidis 2005) and empirical investigations (e.g. John et al. 2012) identify the use of questionable research methods, the overselling of results by overstating claims, and publication bias - the tendency to select positive results over negative results for publication - as further sources for the irreproducibility of results.

M3 - Contribution to conference proceedings

SP - 612

EP - 624

BT - STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators

A2 - Costas, Rodrigo

A2 - Franssen, Thomas

A2 - Yegros-Yegros, Alfredo

PB - Centre for Science and Technology Studies (CWTS)

ER -

Exploration of reproducibility issues in scientometric research

Abstract

Access to Document

Fingerprint

Research output

Exploration of reproducibility issues in scientometric research Part 1: Direct reproducibility

Exploration of Reproducibility Issues in Scientometric Research Part 2: Conceptual Reproducibility

Cite this