Skip navigation
Skip navigation

On the effects of institutional size in university classifications: the case of the Shanghai ranking

Docampo, Domingo; Cram, Lawrence

Description

University rankings frequently struggle to delineate the separate contributions of institutional size and excellence. This presents a problem for public policy and university leadership, for example by blurring the pursuit of excellence with the quest for growth. This paper provides some insight into the size/excellence debate by exploring the explicit contribution of institutional size to the results of the Shanghai ranking indicators. Principal components analysis of data from the Shanghai...[Show more]

dc.contributor.authorDocampo, Domingo
dc.contributor.authorCram, Lawrence
dc.date.accessioned2015-12-08T22:23:18Z
dc.identifier.issn0138-9130
dc.identifier.urihttp://hdl.handle.net/1885/32808
dc.description.abstractUniversity rankings frequently struggle to delineate the separate contributions of institutional size and excellence. This presents a problem for public policy and university leadership, for example by blurring the pursuit of excellence with the quest for growth. This paper provides some insight into the size/excellence debate by exploring the explicit contribution of institutional size to the results of the Shanghai ranking indicators. Principal components analysis of data from the Shanghai ranking (2013 edition) is used to explore factors that contribute to the variation of the total score. The analysis includes the five non-derived ARWU indicators (Alumni, Award, HiCi, S&N and PUB) and uses the number of equivalent full-time academic staff (FTE) as a measure of size. Two significant but unequal factors are found, together explaining almost 85 % of the variance in the sample. A factor clearly associated with the size of the institution explains around 30 % of the variance. To sharpen the interpretation of the smaller factor as a measure of the effect of size, we extend the analysis to a larger set of institutions to eliminate size-dependent selection effects. We also show that eliminating outlying universities makes little difference to the factors. Our inferences are insensitive to the use of raw data, compared with the compressed and scaled indicators used by ARWU. We conclude that around 30 % of the variation in the ARWU indicators can be attributed to variation in size. Clearly, size-related factors cannot be overlooked when using the ranking results. Around 55 % of the variation arises from a component which is uncorrelated with size and which measures the quality of research conducted at the highest levels. The presence of this factor encourages further work to explore its nature and origins.
dc.publisherKluwer Academic Publishers
dc.sourceScientometrics
dc.subjectKeywords: ARWU; Dependence; Ranking; Shanghai; Size; University
dc.titleOn the effects of institutional size in university classifications: the case of the Shanghai ranking
dc.typeJournal article
local.description.notesImported from ARIES
local.identifier.citationvolume102
dc.date.issued2015
local.identifier.absfor139900 - OTHER EDUCATION
local.identifier.absfor130300 - SPECIALIST STUDIES IN EDUCATION
local.identifier.absfor130100 - EDUCATION SYSTEMS
local.identifier.ariespublicationu8606713xPUB95
local.type.statusPublished Version
local.contributor.affiliationDocampo, Domingo, Universidad de Vigo
local.contributor.affiliationCram, Lawrence, College of Physical and Mathematical Sciences, ANU
local.description.embargo2037-12-31
local.bibliographicCitation.issue2
local.bibliographicCitation.startpage1325
local.bibliographicCitation.lastpage1346
local.identifier.doi10.1007/s11192-014-1488-z
dc.date.updated2019-12-19T07:55:00Z
local.identifier.scopusID2-s2.0-84922106245
local.identifier.thomsonID000348324000012
CollectionsANU Research Publications

Download

File Description SizeFormat Image
01_Docampo_On_the_effects_of_2015.pdf998.01 kBAdobe PDF    Request a copy


Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  19 May 2020/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator