Performance-based Research Assessment in Higher Education
- LAST REVIEWED: 03 May 2021
- LAST MODIFIED: 21 January 2016
- DOI: 10.1093/obo/9780199756810-0133
- LAST REVIEWED: 03 May 2021
- LAST MODIFIED: 21 January 2016
- DOI: 10.1093/obo/9780199756810-0133
Introduction
The phenomenon of Performance-Based Research Assessment (PBRA) in higher education is a national, regional, and global one. It is a broad-ranging area of research and commentary and not a field that is easy to capture or summarize. In attempting to do so, this article will predominantly draw upon the wide range of research that has been conducted on national systems of PBRA in higher education as well as the comparisons made of these different national systems. It will also address, however, the continued significance of “global league tables,” most notably the Academic Ranking of World Universities produced by Shanghai Jiao Tong University in China and the Times Higher Education Supplement University World Rankings in the United Kingdom. It is important to note that these PBRA systems are constantly in flux, so anything that is written can quickly become outdated. This article is organized in terms of themes, which capture the historical and political significance of predominantly national PBRA systems and the significance they have in challenging our ideas of universities, how they should be governed and funded and ultimately in potentially re-shaping the mission of higher education institutions and changing the work done by academics and the production of disciplinary knowledge. It is a diverse research field with a wide range of disciplinary perspectives that have been taken to investigate this topic and the span of disciplinary theories and methodologies, including disciplines such as statistics, policy analysis, and sociology. Those authors writing on PBRA in higher education are academics across all disciplines within the broad areas of the sciences, social sciences, and humanities as well as non-academic managers and leaders within higher education. It is an issue that is debated by individuals across the whole system of higher education. The literature can be broadly based within two areas, a perspective that views PBRA systems as a means to improve accountability and efficiency of research in higher education, which attempts to compare and contrast the PBRA systems and argue for the best and most efficient way of organizing them while recognizing that improvements must be made to ensure fairness and equity. The other is a critique of the whole project of PBRA systems, which are seen to be allied to neo-liberal and new public management ideological agendas and employs critical theoretical perspectives to show the deleterious impacts of such systems on knowledge production within universities and academic work and identity.
Global, Regional, and National League Tables and the “World Class University”
The significance of Global League Tables of universities has been emphasized in an extensive amount of literature and is often discussed in relation to the broader literature on globalization and its potential impacts on higher education. The idea of the interconnectedness of the global space is theorized and debated in terms of its impacts on different world regions and nations. In terms of higher education institutions it means that they are compelled to compete in this global space and their work and particularly research outputs are judged within the global as well as national arena. The methodologies underpinning these Global League Tables are debated and critiqued leaving many commentators such as Cheng 2011; Chou, et al. 2013 (cited under Increasing Diversity of National Systems of Performance-Based Research Assessment); and Ishikawa 2009 to conclude that they are unfair and biased and work to serve the global elite. Marginson 2007 and Hazelkorn 2011 provide a wide-ranging analysis and critique of these global ranking systems and their impact on systems of higher education and university leaders and managers. In parallel with these global league tables, the notion of the “World Class” University has also emerged and the creation of these has been discussed as an aim of many policymakers and university leaders. The confusion over what the term actually means and how it should be defined is found in Altbach and Salmi 2011, which has been influential in extending discussion and thinking around this concept. Much of the literature that discusses global league tables of universities provides a comparison of some of the methodologies employed and many are highly critical of the potential bias entailed by the emphasis on research excellence (measured in a variety of ways) and in particular, according to Lo 2011, the Western Anglophone countries. It is intended that the major arguments expounded in this literature are represented below, but it is a diverse and ever increasing area of study. European Journal of Education 2014 brings together a range of commentators on Global University Rankings.
Altbach, P., and J. Salmi. 2011. The road to academic excellence: The making of world-class research universities. Washington, DC: World Bank.
DOI: 10.1596/978-0-8213-8805-1
Both authors have published on the topic of the “world class” university, and this edited book brings together some of the key arguments and critiques through an extensive case study of different national systems of higher education. It evaluates the methodologies of the international ranking bodies.
Cheng, Soh Kay. 2011. Mirror, mirror on the wall: A closer look at the top ten in university rankings. European Journal of Higher Education 1.1: 77–83.
DOI: 10.1080/21568235.2011.577179
Provides a critique of the methodologies employed to rank universities on a global scale. The data is perceived as fallible and prone to measurement error. The “spurious precision” of such exercises is critiqued.
Hazelkorn, E. 2011. Rankings and the reshaping of higher education: The battle for world-class excellence. Houndmills, UK: Palgrave Macmillan.
This is a comprehensive book that serves to both explain as well as critique the methodologies employed to produce global rankings of universities. Through detailed empirical studies, this book also outlines the ways in which these ranking exercises serve to produce key organizational changes in universities employed by senior management in order to achieve high rankings.
Ishikawa, M. 2009. University rankings, global models, and emerging hegemony: Critical analysis from Japan. Journal of Studies in International Education 13.2: 159–173.
This is an interesting critical perspective from Japan that provides an empirical case study of one research university and the struggles over identity and the quest for “world-class” status.
Kehm, B., and T. Erkkila. 2014. Special issue: Global university rankings: A critical assessment. European Journal of Education 49.1: 1–158.
Brings together a range of commentators across a number of different countries to give their perspective on the significance and potential impact of global rankings of universities. An important special issue containing new insights into the changing methodologies and changing landscape of global higher education.
Lo, William Yat Wai. 2011. Soft power, university rankings and knowledge production: Distinctions between hegemony and self‐determination in higher education. Comparative Education 47.2: 209–222.
DOI: 10.1080/03050068.2011.554092
Extends the arguments given by others on the hegemonic nature of the global rankings system. It provides a discussion of neocolonial critique of the rankings system and proposes an argument of a “soft power” perspective.
Marginson, S. 2007. Global university rankings: Implications in general and for Australia. Journal of Higher Education Policy and Management 29.2: 131–142.
DOI: 10.1080/13600800701351660
Provides a critique of the two main global university ranking exercises, AWRU and THESWUR, and proposes that the German CHE system has more to recommend it in terms of fairness and equity.
Marginson, S., and M. van der Wende. 2007. To rank or to be ranked: The impact of global rankings in higher education. Journal of Studies in International Education 11:306–329.
Highlights the intrinsic bias of the methodologies employed by the agencies that produce the global rankings of universities. The main argument is that these rankings are predominantly based on the research standing of institutions even though they often reputedly are based on the whole university and the multitude of activities.
Robinson, D. 2013. The mismeasure of higher education? The corrosive effect of university ranking. Ethics in Science and Environmental Politics 13:11–17.
The potentially detrimental effect of global ranking systems is highlighted in this article. It is argued that such league tables do not necessarily enhance quality and can instead encourage a re-allocation of scarce resources within institutions that can be detrimental.
Users without a subscription are not able to see the full content on this page. Please subscribe or login.
How to Subscribe
Oxford Bibliographies Online is available by subscription and perpetual access to institutions. For more information or to contact an Oxford Sales Representative click here.
Article
- Academic Achievement
- Academic Audit for Universities
- Academic Freedom and Tenure in the United States
- Action Research in Education
- Adjuncts in Higher Education in the United States
- Administrator Preparation
- Adolescence
- Advanced Placement and International Baccalaureate Courses
- Advocacy and Activism in Early Childhood
- African American Racial Identity and Learning
- Alaska Native Education
- Alternative Certification Programs for Educators
- Alternative Schools
- American Indian Education
- Art Education
- Artificial Intelligence and Learning
- Assessing School Leader Effectiveness
- Assessment, Behavioral
- Assessment, Educational
- Assessment in Early Childhood Education
- Assistive Technology
- Augmented Reality in Education
- Beginning-Teacher Induction
- Bilingual Education and Bilingualism
- Blended Learning
- Bullying
- Case Study in Education Research
- Changing Professional and Academic Identities
- Character Education
- Children’s and Young Adult Literature
- Children's Beliefs about Intelligence
- Children's Rights in Early Childhood Education
- Citizenship Education
- Civic and Social Engagement of Higher Education
- Classroom Learning Environments: Assessing and Investigati...
- Classroom Management
- Coherent Instructional Systems at the School and School Sy...
- College Admissions in the United States
- College Athletics in the United States
- Community Relations
- Comparative Education
- Computer-Assisted Language Learning
- Computer-Based Testing
- Conceptualizing, Measuring, and Evaluating Improvement Net...
- Continuous Improvement and "High Leverage" Educational Pro...
- Counseling in Schools
- Creativity
- Critical Approaches to Gender in Higher Education
- Critical Perspectives on Educational Innovation and Improv...
- Critical Race Theory
- Crossborder and Transnational Higher Education
- Cross-National Research on Continuous Improvement
- Cross-Sector Research on Continuous Learning and Improveme...
- Cultural Diversity in Early Childhood Education
- Culturally Responsive Leadership
- Culturally Responsive Pedagogies
- Culturally Responsive Teacher Education in the United Stat...
- Curriculum Design
- Data Collection in Educational Research
- Data-driven Decision Making in the United States
- Deaf Education
- Desegregation and Integration
- Design Thinking and the Learning Sciences: Theoretical, Pr...
- Development, Moral
- Dialogic Pedagogy
- Digital Age Teacher, The
- Digital Citizenship
- Digital Divides
- Disabilities
- Distance Learning
- Distributed Leadership
- Doctoral Education and Training
- Early Childhood Education and Care (ECEC) in Denmark
- Early Childhood Education and Development in Mexico
- Early Childhood Education in Aotearoa New Zealand
- Early Childhood Education in Australia
- Early Childhood Education in China
- Early Childhood Education in Europe
- Early Childhood Education in Sub-Saharan Africa
- Early Childhood Education in Sweden
- Early Childhood Education Pedagogy
- Early Childhood Education Policy
- Early Childhood Education, The Arts in
- Early Childhood Mathematics
- Early Childhood Science
- Early Childhood Teacher Education
- Early Childhood Teachers in Aotearoa New Zealand
- Early Years Professionalism and Professionalization Polici...
- Economics of Education
- Education For Children with Autism
- Education for Sustainable Development
- Education Leadership, Empirical Perspectives in
- Education of Native Hawaiian Students
- Education Reform and School Change
- Educational Statistics for Longitudinal Research
- Educator Partnerships with Parents and Families with a Foc...
- Emotional and Behavioral Disorders
- Environmental and Science Education: Overlaps and Issues
- Epistemic Beliefs
- Equity and Improvement: Engaging Communities in Educationa...
- Equity, Ethnicity, Diversity, and Excellence in Education
- Ethical Research with Young Children
- Ethics and Education
- Ethics of Teaching
- Ethnic Studies
- Evidence-Based Communication Assessment and Intervention
- Family and Community Partnerships in Education
- Family Day Care
- Federal Government Programs and Issues
- Feminization of Labor in Academia
- Finance, Education
- Financial Aid
- Formative Assessment
- Future-Focused Education
- Gender and Achievement
- Gender and Alternative Education
- Gifted Education
- Global Mindedness and Global Citizenship Education
- Global University Rankings
- Governance, Education
- Grounded Theory
- Growth of Effective Mental Health Services in Schools in t...
- Higher Education and Globalization
- Higher Education and the Developing World
- Higher Education Faculty Characteristics and Trends in the...
- Higher Education Finance
- Higher Education Governance
- Higher Education Graduate Outcomes and Destinations
- Higher Education in Africa
- Higher Education in China
- Higher Education in Latin America
- Higher Education in the United States, Historical Evolutio...
- Higher Education, International Issues in
- Higher Education Management
- Higher Education Policy
- Higher Education Research
- Higher Education Student Assessment
- High-stakes Testing
- History of Early Childhood Education in the United States
- History of Education in the United States
- History of Technology Integration in Education
- Homeschooling
- Inclusion in Early Childhood: Difference, Disability, and ...
- Inclusive Education
- Indigenous Education in a Global Context
- Indigenous Learning Environments
- Indigenous Students in Higher Education in the United Stat...
- Infant and Toddler Pedagogy
- Inservice Teacher Education
- Integrating Art across the Curriculum
- Intelligence
- Intensive Interventions for Children and Adolescents with ...
- International Perspectives on Academic Freedom
- Intersectionality and Education
- Knowledge Development in Early Childhood
- Leadership Development, Coaching and Feedback for
- Leadership in Early Childhood Education
- Leadership Training with an Emphasis on the United States
- Learning Analytics in Higher Education
- Learning Difficulties
- Learning, Lifelong
- Learning, Multimedia
- Learning Strategies
- Legal Matters and Education Law
- LGBT Youth in Schools
- Linguistic Diversity
- Linguistically Inclusive Pedagogy
- Literacy
- Literacy Development and Language Acquisition
- Literature Reviews
- Mathematics Identity
- Mathematics Instruction and Interventions for Students wit...
- Mathematics Teacher Education
- Measurement for Improvement in Education
- Measurement in Education in the United States
- Meta-Analysis and Research Synthesis in Education
- Methodological Approaches for Impact Evaluation in Educati...
- Methodologies for Conducting Education Research
- Mindfulness, Learning, and Education
- Mixed Methods Research
- Motivation
- Multiliteracies in Early Childhood Education
- Multiple Documents Literacy: Theory, Research, and Applica...
- Multivariate Research Methodology
- Museums, Education, and Curriculum
- Music Education
- Narrative Research in Education
- Native American Studies
- Note-Taking
- Numeracy Education
- One-to-One Technology in the K-12 Classroom
- Online Education
- Open Education
- Organizing for Continuous Improvement in Education
- Organizing Schools for the Inclusion of Students with Disa...
- Outdoor Play and Learning
- Outdoor Play and Learning in Early Childhood Education
- Pedagogical Leadership
- Pedagogy of Teacher Education, A
- Performance Objectives and Measurement
- Performance-based Research Assessment in Higher Education
- Performance-based Research Funding
- Phenomenology in Educational Research
- Philosophy of Education
- Physical Education
- Play
- Podcasts in Education
- Policy
- Policy Context of United States Educational Innovation and...
- Politics of Education
- Portable Technology Use in Special Education Programs and ...
- Pre-Service Teacher Education
- Problem Solving
- Productivity and Higher Education
- Professional Development
- Professional Learning Communities
- Program Evaluation
- Programs and Services for Students with Emotional or Behav...
- Psychology Learning and Teaching
- Psychometric Issues in the Assessment of English Language ...
- Qualitative Data Analysis Techniques
- Qualitative, Quantitative, and Mixed Methods Research Samp...
- Qualitative Research Design
- Quantitative Research Designs in Educational Research
- Race and Affirmative Action in Higher Education
- Reading Education
- Refugee and New Immigrant Learners
- Relational and Developmental Trauma and Schools
- Relational Pedagogies in Early Childhood Education
- Reliability in Educational Assessments
- Religion in Elementary and Secondary Education in the Unit...
- Researcher Development and Skills Training within the Cont...
- Research-Practice Partnerships in Education within the Uni...
- Response to Intervention
- Restorative Practices
- Scale and Sustainability of Education Innovation and Impro...
- Scaling Up Research-based Educational Practices
- School Accreditation
- School Choice
- School Culture
- School District Budgeting and Financial Management in the ...
- School Improvement through Inclusive Education
- School Reform
- Schools, Private and Independent
- School-Wide Positive Behavior Support
- Science Education
- Secondary to Postsecondary Transition Issues
- Self-Regulated Learning
- Self-Study of Teacher Education Practices
- Service-Learning
- Severe Disabilities
- Single Salary Schedule
- Single-sex Education
- Single-Subject Research Design
- Social Context of Education
- Social Justice
- Social Network Analysis
- Social Pedagogy
- Social Science and Education Research
- Social Studies Education
- Sociology of Education
- Standards-Based Education
- Statistical Assumptions
- Student Access, Equity, and Diversity in Higher Education
- Student Assignment Policy
- Student Engagement in Tertiary Education
- Student Learning, Development, Engagement, and Motivation ...
- Student Participation
- Student Voice in Teacher Development
- Sustainability Education in Early Childhood Education
- Sustainability in Early Childhood Education
- Sustainability in Higher Education
- Teacher Beliefs and Epistemologies
- Teacher Collaboration in School Improvement
- Teacher Evaluation and Teacher Effectiveness
- Teacher Preparation
- Teacher Training and Development
- Teacher Unions and Associations
- Teacher-Student Relationships
- Teaching Critical Thinking
- Technologies, Teaching, and Learning in Higher Education
- Technology Education in Early Childhood
- Technology, Educational
- Technology-based Assessment
- The Bologna Process
- The Regulation of Standards in Higher Education
- Theories of Educational Leadership
- Three Conceptions of Literacy: Media, Narrative, and Gamin...
- Tracking and Detracking
- Traditions of Quality Improvement in Education
- Transformative Learning
- Transitions in Early Childhood Education
- Tribally Controlled Colleges and Universities in the Unite...
- Understanding the Psycho-Social Dimensions of Schools and ...
- University Faculty Roles and Responsibilities in the Unite...
- Using Ethnography in Educational Research
- Value of Higher Education for Students and Other Stakehold...
- Virtual Learning Environments
- Vocational and Technical Education
- Wellness and Well-Being in Education
- Women's and Gender Studies
- Young Children and Spirituality
- Young Children's Learning Dispositions
- Young Children's Working Theories