beijingjohannesburglondonrotterdamshanghaisydneytokyowashington benchmarking the student experience...

Beijing Johannesburg London Rotterdam Shanghai Sydney Tokyo Washington

Benchmarking

the student experience

Kevin Brett

International Graduate Insight Group (i-graduate)www.i-graduate.org

Skills Innovation 2020

Beijing Johannesburg London Rotterdam Shanghai Sydney Tokyo WashingtonOur Experience

Introduction to i-graduate

i-graduate’s primary mission is to assist international educators to plan, understand, adapt and to accurately measure the opinions, expectations and experience of those students who will determine the future success of institutions.

We achieve this by conducting large scale studies examining the student experience throughout the student life cycle and gathering feedback from all stakeholders in education.




Issues, Risks, Themes

for the Emerging Global Model

Establishing and maintaining diverse student population with high English language skills

1. Manage and maintain reputation and brand.

What is Australian TAFE known for?

2. How many international students does an Institute want and in which fields/ levels of study?

3. Maintain competitive prices (Oil price - air travel, carbon tax)

4. Demographics - Competition for the best and brightest talent and systems: student recruitment or adaptation of systems?

5. Transnational profile: (VTE) partnerships; offshore presence; pipelines. JVs; public –private partnerships.



Issues, Risks, Themes

for the Emerging Global Model

6. Establishing alumni relationships. Close out processes for students. Pathways to universities, other agencies.

7. Immigration planning for local professional skill shortages

8. Regional collaboration in services, branding and reputation management

9. Careers support; local and international industry placements and internships

10. Wireless internet on campus, mobile technologies, social media to support word of mouth marketing. Also green campus authenticity.

What is the students’ perception and experience?

Beijing Johannesburg London Rotterdam Shanghai Sydney Tokyo WashingtonWhat is the ISB?

The International Student Barometer

•A student satisfaction survey

•The largest study on the international student experience (9 countries, 350,000+ international students, 150 education providers)

• Confidential for both respondents and providers

• A valuable tool in managing the international student experience and the international reputation of education providers

• A unique tool for benchmarking the performance of your institution against key rivalsThe ISB is NOT

• Used in global league/ranking tables

• An opportunity for your competitors or government to monitor your performance



Introduction to i-graduate

Since 2005 i-graduate has

• undertaken research for over 150 education providers • worked with education providers in 9 countries

The countries in which providers have adopted the ISB are:

• United Kingdom

• USA

• Netherlands

• New Zealand

• South Africa

Context

• Australia

• Ireland

• Belgium

• Germany



• International Language Barometer has run in 12 languages

• Languages:


Overview of the first International Language Barometer


•ConSkills Innovation 2020•tents

•Response

•Choice of destination

•Application

•Plans for the future

•Recommendation

•Conclusion

•Copyright © IGI Services 2008

•Arrival

•Learning

•Living

•Support

• University Experience

• Pre- Arrival

•ISB Australia 2008



What the International Student Barometer covers

Background/demographics• Nationality

•Level of English prior to commencing course

• Course type

• Visa type

• Accommodation type

• Length of course

• Source of funding

• Location prior to commencing course






• Course type

• Visa type





27%

22%

9%

7%

7%

4%

4%

2%

2% 2% 1%

1%

12%

Nationality

Korea, South

Japan

China

Thailand

Saudi Arabia

Brazil

Switzerland

Taiwan

Colombia

Chile

Russian Federation

French Polynesia

Other



What the International Language Barometer covers



• Course type

• Visa type





60%20%

17%

3%

0%

Student Visa

Tourist Visa

Working holiday Visa

Other

Business Visa






• Course type

• Visa type





49%

27%

8%

5%

5%4% 2%

Staying with a host family

Private rented house/flat/room

Living with friends or relatives

Other

Student house or flat controlled by the college/school/university

College/school/university halls of residence

Private halls or a student hostel



Decision making• First choice country

• Other countries considered / applied to

• Why this country over others considered

• What is important when choosing a school

• What influenced the choice of school

• First choice school

• Why this school over others considered

Application• Application method

• Satisfaction with agent

What the International Barometer covers













53%

47%

37%

36%

9%

5%

5%

4%

3%

3%

3%

3%

3%

2%

2%

2%

0%

0% 10% 20% 30% 40% 50% 60%

Australia

Canada

United States of America

United Kingdom

Ireland

Japan

Other

Singapore

Malta

Other EU

China

Germany

South Africa

France

Malaysia

South Korea

UAE (incl. Dubai)

ILB (699)













1%

2%

2%

2%

3%

4%

4%

4%

5%

6%

6%

7%

7%

9%

10%

12%

12%

15%

17%

27%

27%

27%

39%

0% 5% 10% 15% 20% 25% 30% 35% 40% 45%

Article in a newspaper or magazine

An employer

Advertisement in a newspaper or magazine

Sponsor

League or ranking tables

Staff of this school at an education exhibition

Home country government advisory services

Staff of this school at a presentation

Teacher at a school where I've studied previously

Careers advisor

Study abroad staff at sending institution

Printed directory or guide

Other

New Zealand Education website

A visit to this school/college

Independent website

School/college prospectus

School/college website

Someone currently studying here

Parents

Someone who had previously studied here

Friends

Education agent/consultant

ILB (747)



Student Experience

• Arrival• meeting people, getting administration sorted, understanding

• Learning• Teachers, courses, activities, resources, facilities

• Living• cost, meeting people, accommodation, safety

• Support• advice and guidance

• Recommendation• Would your students recommend your school to others

Plans After Course


0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

E

G

J

A

B

D

C

F

I

K

M

H

L

Very Poor Poor Good Very Good



Student Experience






Plans After Course


2.6 2.7 2.8 2.9 3.0 3.1 3.2 3.3 3.4

Technology Enhancing study chances

Learning spaces Academics' English

Flexibility The quality of the classrooms

Extra English activitiesAssessment

The learning resourcesPerformance feedback

Learning support Multicultural

Employability Friendly staff/teachers

Course content Practicing language skills

Good teachers



Student Experience






Plans After Course



Learning Tribes:

An alternative analysis of

the international cohort




Data from the International Student Barometer indicates that we need to think and work beyond the comfortable intellectual confines of nations and nationalities; not all Indian students think in the same way!

25,000 responses from Asian students to ISB Autumn Wave 2006

Two-step cluster analysis to characterise subgroups within the Asian international student population by motivation, behaviour, influence and ambition

Five clearly defined clusters emerged; identifiable as Asia’s Learning Tribes™:

•‘Surfers’ •‘Seekers’ •‘Gekkos’ •‘Bonos’ •‘Kids’

•Introducing the Tribes



•Introducing Asia’s Learning Tribes™

•‘Surfers’

•Tend to be focused on life experiences, having fun and developing themselves as a person with less of an interest in making money

•‘Seekers’ Study to get a good job and earn money, and are less keen on making a difference or being noticed

•‘Gekkos’

•Focus on money, status and recognition; personal life is seen as less important

•‘Bonos’ Want to change the world and be recognised as making a difference, with less interest in job security or making money

•‘Kids’

•Unfocused enthusiasm with indiscriminate ambition - recognition, money, personal development all seen as important




DECISION FACTORS - difference from Total Surfers Seekers Gekkos Bonos KidsPersonal safety -0.21 -0.04 0.10 -0.09 0.05Teaching quality -0.17 -0.09 -0.02 0.05 0.09Research quality -0.11 -0.15 -0.05 0.10 0.11Course length -0.11 -0.08 0.03 0.00 0.06Cost of study -0.22 -0.09 0.11 -0.04 0.05University scholarship/ bursary -0.21 -0.08 0.03 0.03 0.06Social life -0.17 -0.08 0.06 -0.03 0.06Work opportunities -0.23 0.01 0.04 -0.29 0.18Reputation -0.24 -0.09 0.01 0.03 0.09Recommendation -0.36 0.00 0.04 -0.05 0.08Location -0.21 0.01 0.02 -0.01 0.03Friends here -0.16 0.04 0.03 -0.12 0.05Social atmosphere -0.30 -0.03 0.03 -0.11 0.12

DECISION FACTORS – mean scores Surfers Seekers Gekkos Bonos Kids TotalPersonal safety 2.98 3.15 3.28 3.09 3.23 3.18Teaching quality 3.55 3.64 3.71 3.78 3.81 3.73Research quality 3.40 3.36 3.46 3.61 3.62 3.51Course length 2.99 3.02 3.12 3.10 3.16 3.10Cost of study 3.07 3.20 3.40 3.25 3.34 3.29University scholarship/ bursary 2.87 3.00 3.10 3.11 3.13 3.08Social life 2.63 2.72 2.86 2.76 2.86 2.80Work opportunities 2.98 3.22 3.25 2.92 3.38 3.21Reputation 3.46 3.60 3.70 3.72 3.79 3.69Recommendation 2.54 2.90 2.94 2.85 2.98 2.90Location 2.58 2.80 2.80 2.78 2.82 2.79Friends here 1.91 2.11 2.10 1.95 2.12 2.07Social atmosphere 2.43 2.71 2.76 2.62 2.86 2.73average mean score 2.87 3.03 3.11 3.04 3.16 3.08

•The ‘Kid

•effect?’

•Methodology


•SHU Learning Tribe composition

8%

29%

28%

13%

22%

11%

24%

23%

22%

20%

SHU (400) inner circle, Total ISB (25,290) outer circle

Surfers Seekers Gekkos Bonos Kids




•Recommendation

•India

4.12

4.21

4.304.32

4.39

3.95

4.00

4.05

4.10

4.15

4.20

4.25

4.30

4.35

4.40

4.45

Surfers Seekers Gekkos Bonos Kids

•Base ISB India n=1703

• 1 =

acti

vely

dis

cour

age,

5 =

acti

vely

enc

oura

ge


Benchmarking the student experience

National snapshots




2.66-2.862.86-2.92.9-2.92

2.92-2.942.94-2.982.98-3.033.03-3.053.05-3.123.12-3.26

•LearningOverall learning satisfaction: mean score – by country

•Countries with 20 responses or more included


2.54-2.712.71-2.82.8-2.82

2.82-2.842.84-2.882.88-2.92.9-2.94

2.94-2.952.95-3.06

•Living Overall living satisfaction: mean score – by country



2.82-2.842.84-2.882.88-2.922.92-2.932.93-2.942.94-2.952.95-2.972.97-3.023.02-3.05

•Support servicesOverall support services satisfaction: mean score – by country



Benchmarking the student experience:

the process




Semi-standardised online questionnaire format, adapted and customised for each partner institutionEmail alert sent to students who click a hyperlink to access the questionnaire

i-graduate Research Team manage and monitor all data collection and analysisConfidential reportingBenchmarked data

•How does the ISB work?



4+3+4+2+3 = 3.2

5

Very unimportant unimportant important

Very important

Personal safety and security


Very important



Very important



Very important



Very important


Personal safety

Student A 4Student B 3Student C 4Student D 2Student E 3

•A

•B

•C

•D

•E

•Students Answer the Question

•Data Collection

•Calculations

•The Results

•The Four Point Scale•Many of the Questions in the ISB survey are asked on a four point scale. The Answers to each question are averaged to obtain one value that you will see in our presentation. Here is an example of the process:

•Number who answered the question

Beijing Johannesburg London Rotterdam Shanghai Sydney Tokyo Washington•How does the ISB work?

•Survey developed

•Review survey

•Online survey built

•Translation

•Survey launched (email sent to students)

•Response monitored/Reminders sent

•Data cleaned & collated

•Report prepared

•Week 1

•Week 15



Deliverables

PDF Slide presentation of national results, results compared for your country against a global benchmark

Institutes with sufficient results (generally 30 unique respondents) will also receive individual results compared against a national and international benchmark

Additional reporting and analysis on request

i-graduate will work with institutes to identify areas for improvements and develop action plans to assist individual institutes and membership groups to ensure a minimum level of service for students

What the International Student Barometer for TAFE would include



Getting your Institute involved

Suggested option for the Australian TAFE sector

• TAFE Directors Australia and related bodies take the lead

• Centralised funding (government, match funding with institutes)

• Standardised survey instrument for the sector

• Standardised deliverables (national / state report benchmarked against global index and institution summary results where response base allows

• Centralised communications (i-graduate liaison with institutes facilitated through peak body/ies)



For further information about i-graduate

T + 02 61624393F + 02 61624393 E [email protected] W www.i-graduate.org

Thank you

Kevin BrettDirector, Client Services

[email protected]

beijingjohannesburglondonrotterdamshanghaisydneytokyowashington benchmarking the student experience...

Documents

international students

student recruitment

student satisfaction

international educators

experience introduction

performance skills innovation

diverse student population

student life cycle