The impact of data source selection
Point of Contact: Prof. Dr. Matthias Meyer
We investigate the impact of choosing between four data sources on the relative performance measurement of scholars’ research output. Our results show that rankings can differ considerably and that the observed correlations are often even lower than those reported in previous studies. We show that data source selection generally has a higher effect than measure selection and that performance measures based on Google Scholar might provide information that complements the more traditional data sources. We find greater differences for accounting, which suggests that decision makers must pay more careful attention when using rankings in this field.
Meyer, Matthias and Waldkirch, Rüdiger and Zaggl, Michael (2012). Relative Performance Measurement of Researchers - The Impact of Data Source Selection. Schmalenbach Business Review. 3 (64), 308-330.