New report: Rankings are useless

17/06-11 kl. 11:00 Education
Cambridge Photo: Photos.com University of Cambridge, a university that constantly ranks among the top three universities in the world. But the rankings system is misleading, says new report

Ice cold shower to those who follow university rankings: The first review of major international university rankings published Friday is a damning review of their lack of transparency and unintended consequences

by Elisabeth Ginsberg and Mike Young

Times Higher Education, the QS, World University Ranking, Shanghai…

It is easy to get lost in the abundance of university rankings. But don't worry about them – they are all equally bad.

This is according to the European University Association (EUA) which has just released the first review of major international university rankings. The report is a cold shower to ranking institutions, ranking-obsessed administrators, policy-makers and those who are just interested.

Rankings detract from teaching and learning

As they stand now, rankings are pretty much a waste of time and effort.

And this for readers, students, administrators and policy-makers, the EUA argues.

»There is a danger that time invested by universities in collecting and using data and statistics in order to improve their performance in the rankings may detract from efforts to progress in other areas such as teaching and learning or community involvement,« the EUA concludes.

Universities work on rank, not teaching

The rankings provide an »oversimplified picture« of institutional mission, quality and performance, as they focus on indicators related to the research function of universities, the report argues.

The benefits that the rankings offer policy-makers, staff and students, be it through fostering accountability or encouraging the collection of more reliable data, are outweighed by the lack of transparency and by the unwanted consequences, the report says.

One of these consequences is that universities invest in activities that will improve their position in the rankings rather than in core areas such as teaching and learning.

Ignores 97-99 per cent

The rankings methodologies themselves are all deeply flawed, the EUA report argues (see list of faults in fact box to the right):

For example, attempts to measure the quality of teaching and learning that involve the use of proxies, often with a very indirect link to teaching quality, are »rarely effective«, while the importance of links to the outside world, communities and businesses are ignored.

International rankings in their present form only cover a small percentage of the world’s estimated 17,000 universities, somewhere between one and three per cent (200-500 universities), completely ignoring the rest, the report points out.

Needs to be more democratic

Looking to the future, rankings should be 'democratised' to allow more institutions to find their place, the report says.

Including more universities would recognise »the important contribution of those well-functioning institutions that suffer from the ‘unwanted consequences’ of rankings«, the EUA writes.

Read more about the EUA and find the report here

ginsberg@adm.ku.dk, miy@adm.ku.dk

Stay in the know about news and events happening in Copenhagen by signing up for the University Post’s weekly newsletter here.

1 comment

Write a comment

05/09-11 kl. 21:38 Being realistic:

Yeah, the 'losers' can always complain (although KU at ranking #43 has much to be proud about). The not-so-strange thing is that the universities that end up on the top of the list (Oxford, Cambridge, Harvard, etc.) are commonly accepted by academics as being among the best. So, if we accept that these places are at the top, as also shown by the rankings, then how can we dispute the relative rankings of other universities? Maybe there is not so much difference between being #43 and #44, but certainly #43 is not anywhere near #1.

Join the debate read rules for debate here.
The content of this field is kept private and will not be shown publicly.
By submitting this form, you accept the Mollom privacy policy.
SpringTipGuysguide1
17/05-12 kl. 08:30 Culture

Top 10: Spring tips for guys

Guys: Springtime isn't just for the ladies. The University Post has put some things together to keep you occupied for the next couple of months

See also:
Top 10: Spring tips for guys, part 2
Top 10: Spring tips for girls
Top 10: Spring tips for girls, part 2
lostgraphicteaser
16/05-12 kl. 10:11 Education

Lost generation may find their way yet

A generation of university graduates wonders how they are ever going to get a job that matches their qualifications. But according to new European statistics, there is hope

See also:
Graphic: Where are the jobs in Europe?
soupeaters
15/05-12 kl. 13:00 Culture

This Sunday: Piano virtuoso to play John Cage

Artistic event to feature mushrooms, silence, and music. Special guest is virtuoso pianist Rolf Hind who will play avant garde master John Cage. Free entrance for everyone

UCPHsecondworldwar
15/05-12 kl. 07:55 Research / Humanities

Historians debate Copenhagen links to Nazis

University of Copenhagen scientists kept co-operating with Nazified German scientists during the 1930's, and the official University upheld a co-operation policy with the Nazis from 1940. Recent conference sheds light on a murky period in Danish history

Orhan Pamuk
15/05-12 kl. 06:17 Culture

Turkish writer Orhan Pamuk gets Sonning prize

Prestigious cultural award goes to a man who has 'challenged cultural boundaries', says jury

Liferevy_1
14/05-12 kl. 12:34 Campus / Life Science

See photos from the Life Sciences revue

The revue spirit is spreading throughout the university. Our photographer visited the former Faculty of Life Sciences over the weekend as the students got on stage to mock university life

See also:
Gallery: Life revue '12
Gallery: Physics Revue '12

Facts

Problems with rankings

Selection of rankings problems according to new European University Association (EUA) report:

• Policy makers think rankings make universities ‘transparent’, but there is no proof of this

• Rankings and global league tables only cover 1-3 pct. of the world’s 17,000 universities.

• Rankings often surreptitiously combine multi-dimensional indicators mathematically to new indicators

• Composite scores contain ranking providers’ subjective judgements

• Rankings reflect research performances more accurately than teaching performances

• Teaching scores are based on proxies, such as staff/student ratios

• Bibliometric indicators measuring research performance favour natural sciences and medicine

• Claimed ‘peer reviews’ are often reputation surveys

• Language bias in favour of English-language universities

• Universities attempt to improve their performance specifically in areas that affect their ranking

• Universities manipulate data to improve performance

• Few rankings actually help students make choices

• Rankings are undemocratic, boosting the elite

• Country rankings are meaningless

Keywords


Subscribe to newsletter

Guide to Denmark's summer festivals 2012

Summer is right around the corner and so are the many festivals that sweeten this time of year. The University Post brings you 10 festivals worth looking forward to while you finish off the semester’s last exams

Photo Competition: Show us your room

Send us a photo of your room and win tickets to the NorthSide Festival


Kontakt redaktionen

Write us an e-mail: uni-avis@adm.ku.dk

University of Copenhagen
Nørregade 10
1165 Copenhagen K
Denmark
Tel. +45 35 32 28 98

Copyright 2009 © Universitetsavisen.ku.dk