the global ranking regime and the reconfiguration of ...€¦ · data excluding those that were...

13
The Global Ranking Regime and the Reconfiguration of Higher Education: Comparative Case Studies on Research Assessment Exercises in Mainland China, Hong Kong, Japan and the U.S. Dr. Li Jun

Upload: others

Post on 22-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the

Reconfiguration of Higher Education:

Comparative Case Studies on Research

Assessment Exercises in Mainland China,

Hong Kong, Japan and the U.S.

Dr. Li Jun

Page 2: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 2

Core Criteria

Indicators: 22

Weight: 600

Teaching

6

150

Employability

4

150

Research

5

150

Internationalization

7

150

Learning

environment

Indicators: 12

Weight: 200

Facilities

6

100

Online or

Distance

6

100

Specialist

Criteria

Indicators: 4

Weight: 200

Discipline

ranking

2

150

Accreditation

2

50

Advanced

criteria

Indicators: 14

Weight: 200

Arts &

culture

3

50

Innovation

3

50

Social

responsibility

4

50

Inclusiveness

4

50

Source: QS Stars Methodology.

The Global Ranking Regime

Page 3: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 3

Source: https://www.timeshighereducation.com/news/ranking-methodology-2016

Compared – Times Higher Education World University Rankings

Criteria 13 Indicators Weight

Teaching Reputation survey (15%); Staff-to-student ratio

(4.5%); Doctorate-to-bachelor’s ratio (2.25%);

Doctorates awarded-t0-academic staff ratio

(6%); Institutional income (2.25%)

30%

Research Reputation survey (18%); Research income

(6%); Research productivity (6%)

30%

Citations 30%

International

outlook

International-to-domestic-student ratio (2.5%);

International-to-domestic-staff ratio (2.5%);

International collaboration (2.5%)

7.5%

Industry income 2.5%

The Global Ranking Regime

Page 4: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 4

Source: http://www.usnews.com/education/best-global-universities/articles/methodology

Compared – The U.S. N & R Best Global Universities Rankings

12 Indicators Weight

Global research reputation 12.5%

Regional research reputation 12.5%

Publications 10%

Books 2.5%

Conferences 2.5%

Normalized citation impact 10%

Total citations 7.5%

Number of publications among the 10 percent most cited 12.5%

Percentage of total publications that are among the 10

percent most cited

10%

International collaboration 10%

Number of Ph.D.s awarded 5%

Number of Ph.D.s awarded per academic staff member 5%

The Global Ranking Regime

Page 5: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 5

Source: http://publications.asahi.com/ecs/detail/?item_id=15843

Compared – The Asahi Shimbun Daigaku Ranking since 1994

The Global Ranking Regime

Criteria 64 Indicators

Admission 13 (i.e., admittance ranking; geo-origin ranking; ranking of

recruitment power, etc.)

Overall 5 (i.e., ranking from university presidents; ranking from

principals; ranking from office directors; global university

rankings, etc.)

Education 26 (i.e., rates of graduate student admission; ranking of

learning environment; university library ranking; ranking of

international students, etc.)

Research 6 (i.e., Hi-ci ranking; national funding ranking; citation

ranking of Thomson Reuter papers, etc.)

Financing 2 (i.e., salary ranking of faculty, etc.)

Contribution

to society

12 (i.e., media reporting ranking (institution/faculty);

leadership ranking of graduates; athletics ranking of

graduates, etc.)

Page 6: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 6

Source: http://www.shanghairanking.com/ARWU-Methodology-2015.html

Compared – The SHJT Academic Ranking of World Universities

Criteria 6 Indicators Code Weight

Quality of

Education

Alumni of an institution winning Nobel Prizes

and Fields Medals

Alumni 10%

Quality of

Faculty

Staff of an institution winning Nobel Prizes

and Fields Medals

Highly cited researchers in 21 broad subject

categories

Award

HiCi

20%

20%

Research

Output

Papers published in Nature and Science

Papers indexed in SCIe and SSCI

N&S

PUB

20%

20%

Per Capita

Performance

Per capita academic performance of an

institution

PCP 10%

The Global Ranking Regime

Page 7: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 7

Comparative Findings on Research Assessments

Fig. 1 Statistical Trends of Journal Articles Published per

Faculty Member (1993-2013)

1.38

5.05

1.50 1.082.08

15.96

2.251.31

2.30

9.54

2.191.17

0

5

10

15

TCU THKU TJU TUSU

1993

2013

Total

Page 8: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 8

Comparative Findings on Research Assessments

Research assessments highly affected TCU, THKU and

TJU, except for TUSU, and differs in the following

aspects:

• Juniors: I have to be focused on research so that I can

publish more papers in the coming years, or I will otherwise

risk losing my position from my university.... The job

competitiveness is fierce and my university has a high

expectation for everybody. If I lag behind I will surely lose

my job... Therefore, I have led my personal life simply like

this: coming to my office every day from my rented

apartment at 6:30am in the early morning and going home

from my office in the late evening – sometimes very late

until mid-night. I was lucky that my commute time is not that

long every trip – it’s just less than one hour.

Interview data from TJU

Page 9: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 9

Comparative Findings on Research Assessments

Research assessments highly affected TCU, THKU and

TJU, except for TUSU, and differs in the following

aspects:

Q: Was there in any explicit contract, when you were working

for the management analysis center, that you had to publish

research articles?

A (Education): No, nothing at all, because it was the faculty-

staff joint venture. [Publishing] was looked on favorably…. I

am not sure, I am assuming it factored into the overall

evaluation which would lead to year-end bonus… I have no

idea how much that played into that or not, and that's not why

I did it. Why I did do it? It was something that I think was

encouraged. No, “encouraged” is the wrong word…. It was

modeled by the faculty and so I took [publishing] as a good

thing to do.Interview data by Post (2016) from TUSU

Page 10: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 10

Comparative Findings on Research Assessments of English Publications

Fig. 2 Ratio Trends of Journal Articles Published in

English/International Languages and Native Languages

(1993-2013)

Note. Data excluding those that were published in bilingual journals or other local languages.

0.06

0.91

0.00 0.000.06

1.73

0.060.00

0.06

1.48

0.04 0.000.00

0.25

0.50

0.75

1.00

1.25

1.50

1.75

TCU THKU TJU TUSU

1993

2013

Total

Page 11: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 11

Findings from THKU

0

5

10

15

20

25

30

19

73

19

74

19

75

19

76

19

77

19

78

19

79

19

80

19

81

19

82

19

83

19

84

19

85

19

86

19

87

19

88

19

89

19

90

19

91

19

92

19

93

19

94

19

95

19

96

19

97

19

98

19

99

20

00

20

01

20

02

20

03

20

04

20

05

20

06

20

07

20

08

20

09

20

10

20

11

20

12

20

13

In Chinese

In Chinese and English

In English and other languages

Language of Journal Articles by Year

Page 12: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 12

Geographical Distributions of Journals by Year

0

5

10

15

20

25

30

35

19

69

19

70

19

71

19

72

19

73

19

74

19

75

19

76

19

77

19

78

19

79

19

80

19

81

19

82

19

83

19

84

19

85

19

86

19

87

19

88

19

89

19

90

19

91

19

92

19

93

19

94

19

95

19

96

19

97

19

98

19

99

20

00

20

01

20

02

20

03

20

04

20

05

20

06

20

07

20

08

20

09

20

10

20

11

20

12

20

13

International

National

Findings from THKU

Page 13: The Global Ranking Regime and the Reconfiguration of ...€¦ · Data excluding those that were published in bilingual journals or other local languages. 0.06 0.91 0.00 0.00 0.06

The Global Ranking Regime and the Reconfiguration of Higher Education by Jun LI ([email protected]) 13

Storylines:

• A quite female senior colleague, in terms of service.

• A handful journal publications in local journals (with some

of them are on the top).

• Not short of English publications.

• Still struggling for full professorship.

• The situation can be totally different, probably up-side

down, if the publication list is the opposite in terms of

language (i.e., mainly in English rather than in Chinese).

Consequence: Reallocated to teaching track.

A Real Story from THKU