are international students “at risk”? - uk naric · pdf fileare international...

46
Are International Students “At RisK”? Diane Schmitt Chair of BALEAP/Nottingham Trent University John Slaght BALEAP Testing Officer/University of Reading 1

Upload: nguyenhanh

Post on 25-Mar-2018

217 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Are International Students “At RisK”?

Diane SchmittChair of BALEAP/Nottingham Trent UniversityJohn SlaghtBALEAP Testing Officer/University of Reading

1

Page 2: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

When you hear the term “at risk” student used in a higher education

context what comes to mind?

2

Page 3: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Reasons for Being Considered “At Risk” in HE• Students' 'skills, knowledge, motivation, and/or academic ability are significantly below those of the 'typical' student in the college or curriculum in which they are enrolled.'  

• Students are likely to display any number of other characteristics such as 'low academic self-concept, unrealistic grade and career expectations, unfocused career objectives, extrinsic motivation, external locus of control, low self-efficacy, inadequate study skills for college success, a belief that learning is memorizing, and a history of passive learning.'

• They may be those who have made poor choices or decisions that impacted negatively on their academics.

• They may be an adult student who returns to higher education after an extended absence.  

3

Page 4: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Understanding the complex nature of student risk

Risk is not an inherent quality of individual students, as in the term “at-risk student”

Risk is a function of the interaction between a student and their university

Honesty in Conception

A fuller understanding of “student risk” requires us to consider how the design and conduct of our learning environments and assessment practices may inadvertently increase students’ risk of non-engagement or academic failure

4

Page 5: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Understanding the complex nature of student risk

Risk is not an inherent quality of individual students, as in the term “at-risk student”

Risk is a function of the interaction between a student and their university

Honesty in Conception

A fuller understanding of “student risk” requires us to consider how the design and conduct of our learning environments and assessment practices may inadvertently increase students’ risk of non-engagement or academic failure

5

Page 6: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Understanding the complex nature of student risk

Risk is not an inherent quality of individual students, as in the term “at-risk student”

Risk is a function of the interaction between a student and their university

Honesty in Conception

A fuller understanding of “student risk” requires us to consider how the design and conduct of our recruitment and admissions practices may inadvertently increase international students’ risk of non-engagement or academic failure

6

Page 7: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

A story…

• A cohort of 19 students studying for a Master’s Degree in Human Resource Management

• External accrediting body requires that core modules are assessed by exams

• Two of these are based on case studies• 13 students fail the first exam• 11 students fail all three exams• The students only read the case studies and lecture

notes. They did not read texts from the reading list.

7

Page 8: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

A lecturer’s voice

Don’t students know they are supposed to read for a degree?

Derek Watling, Programme Leader MSc HRM, Nottingham Trent University

8

Page 9: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Sample undergraduate performance 2014-15STUDENT NUMBERS RESULTS AVERAGE RAW

PERCENTAGE

159 PASSED78%

59%

44 FAILED 22%

26%

Henley Business School, University of Reading Finance and Accountancy Module

9

Page 10: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

The ‘at risk’ factor…

…needs to be considered in light of the performance of the ‘HBS 44’ who, after at least 10 weeks of intensive Pre-sessional English and Study Skills work and one year of undergraduate study, have achieved an average score of only 26% in one module of their academic course.

10

Page 11: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

One more case

Kingston UniversityInternational (non-EU) student attainment

May, S. Van der Sluis, H. and Forland, H. (2013).

22% of students did not achieve the goal of completion of an MA.

11

Page 12: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Assessing Readiness to Study at a UK University

What are key elements of readiness that you look for in the recruitment and admissions processes for international students in your university?

What evidence do you collect for each element?

12

Page 13: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Academic transcript/certificate

13

Page 14: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Evidence of English language proficiency

14

Page 15: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Assessing Readiness to Study at a UK University

Anything else?

15

Page 16: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Assessing Readiness to Study at a UK University

Soft criteria

Hardcriterion

Rea-Dickins, P., Kiely, RN., Yu, G. (2011).

16

Page 17: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Assessing Readiness to Study at a UK University

If a student has met the minimum criteria for each of these elements do you consider them to be

“good to go”?

Is a student who has met your minimum entry criteria for English considered to be ‘on par’ with

domestic students?

17

Page 18: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Lecturer and student views of international students

Group A:Read the examples of lecturer views – Examples 1- 5Can you identify any themes among the examples?

Group B:Read the examples of student views – Examples 6 - 10 Can you identify any themes among the examples?

18

Page 19: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Lecturers’ views of international students

§ An identity of a struggling learner§ A glass ceiling identity for the ‘international student’§ A three-deficit identity

Inadequate language proficiency

Lack of analytical ability

Mismatch in culture

Struggling with language

19

Page 20: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

International student views of studying in a UK university

§ Some students struggled because of a weakness in language

§ Many of the challenges faced by international students are the same as those experienced by any new postgraduate student

§ Both students designated as ‘high risk’ and those as ‘low risk’ on the basis of their IELTS scored reported struggling – the struggles were less likely to be overcome by the ‘high risk students’.

High risk – 6.5 overall, but lower than that in one or more sub-skillsLow risk – 7.0 overall with all sub-skills 7.0 or above

20

Page 21: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Achievement of the minimum entry score on an English language

proficiency test does not imply optimal readiness for study at an

English-medium university

21

Page 22: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

One more Element Needed To consider When Recruiting and At Admissions?

22

Page 23: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

What can language tests tell us?

The IELTS is designed: “to test the readiness to enter the world of university-level study in the English language and the ability to cope with the demands of that context immediately after entry.” (IELTS FAQs)

The TOEFL iBT test measures your ability to use and understand English at the university level. And it evaluates how well you combine your listening, reading, speaking and writing skills to perform academic tasks. (https://www.ets.org/toefl/ibt/about)

PTE Academic assesses the real-life English skills you will need at university and living abroad. Not only do we assess speaking, listening, reading and writing, but we test in an integrated way that reflects real-life settings, as well as testing academic skills.

A Cambridge English: Advanced qualification shows that you can:§ follow an academic course at university level§ communicate effectively at a managerial and professional level§ participate with confidence in workplace meetings or academic

tutorials and seminars§ express yourself with a high level of fluency.

23

Page 24: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

A complex target language use domain

(Gardner, 2010) 24

Page 25: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Language tests have 3-4 hours to sample the target language use domain

Disciplinary WritingIELTS Writing

25

Page 26: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Pre-sessional EAP Courses

Language

Tests

Teaching

Assessment

Disciplinary Writing

26

Page 27: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Teaching to & learning for the test!

Teaching

Assessment

27

Page 28: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Learning needs extend beyond the test!

TLU domain

Assessment

Teaching

28

Page 29: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Mind the gap!

Previous educational culture

UK/local (HE)educationalculture

English language exams

Wishful thinking?

29

Page 30: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Academic Support

§ What kind of support is offered to students in your university?

§ How is it positioned?

30

Page 31: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Academic Support

§ What kind of support is offered to students in your university?§ Do you know if it is effective?

§ How is it positioned?§ Is it compulsory? Is it credit-bearing?§ Is it remedial? Or developmental?§ Is generic? Or is it embedded in disciplines or

programmes?§ Is it just for international students or is it available to

everyone?

31

Page 32: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Academic Support

§ Do students engage with the support on offer?§ Academic support staff have to “prove” to students

that we are not wasting their time.

32

Page 33: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Engagement With On-Going Development

• Language Development • Academic Literacy• Disciplinary Literacy

33

Page 34: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Recruitment and Admission

How do entry requirements position international students within the wider context? • Many issues go beyond the scores on IELTS & other tests• It is essential to acknowledgement of the ‘impact’ of HE

internationalisation strategies on international students, the student body in general and the quality of course content

• For the UK higher education system to thrive under a global umbrella we need to re-evaluate the traditional approaches to: a) which students to recruit, b) how to recruit them and c) how to assess their capabilities and needs

34

Page 35: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

References

May, S. Van der Sluis, H. and Forland, H. (2013). The impact of pre-entry English test results on postgraduate success. In: The Impact of Higher Education: Addressing the challenges of the 21st century; 27 - 31 Aug 2013, Rotterdam, Netherlands. (Unpublished)

Rea-Dickins, P., Kiely, R., & Yu, G. (2007). Student identity, learning and progression: The affective and academic impact of IELTS on ‘successful’ candidates. In P. McGovern & S. Walsh (Eds.), IELTS Research Reports Volume 7 (pp. 59-136). Canberra: IELTS Australia and British Council.

Rea-Dickins, P., Kiely, RN., Yu, G. (2011). Uses and impact of test scores in university admissions processes: The language test as the ‘hard’ criterion. In B. O’Sullivan, ed. Language Testing: Theories and Practices. p. 262 - 281. London: Palgrave Macmillan.

35

Page 36: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Thank you!www.baleap.org

Diane SchmittChair of BALEAP/Nottingham Trent UniversityJohn SlaghtBALEAP Testing Officer/University of Reading

36

Page 37: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Aims of Undergraduate Study

Bachelor's degrees with honours are awarded to students who have demonstrated:

• a systematic understanding of key aspects of their field of study, including acquisition of coherent and detailed knowledge, at least some of which is at, or informed by, the forefront of defined aspects of a discipline

• an ability to deploy accurately established techniques of analysis and enquiry within a discipline

• conceptual understanding that enables the student to…

(QAA, 2008)

37

Page 38: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Aims of Undergraduate Study

Conceptual understanding that enables the student to:• to describe and comment upon particular aspects of current research, or

equivalent advanced scholarship, in the discipline • an appreciation of the uncertainty, ambiguity and limits of knowledge • the ability to manage their own learning, and to make use of scholarly

reviews and primary sources (for example, refereed research articles and/or original materials appropriate to the discipline).

Typically, holders of the qualification will be able to:• apply the methods and techniques that they have learned to review,

consolidate, extend and apply their knowledge and understanding, and to initiate and carry out projects

• critically evaluate arguments, assumptions, abstract concepts and data (that may be incomplete), to make judgements, and to frame appropriate questions to achieve a solution - or identify a range of solutions - to a problem

(QAA, 2008) 38

Page 39: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Lecturers’ views of international students

An identity of a struggling learner

39

Page 40: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Lecturers’ views of international students

A glass ceiling identity for the ‘international student’

40

Page 41: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

Lecturers’ views of international students

A three deficit identity

Inadequate language proficiency

Lack of analytical ability

Mismatch in culture

Struggling with language

41

Page 42: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

International students’ views on subject learningIELTS 8.0 – L 8.5, W 9.0, R 6.5, S 8.0

42

Page 43: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

International students’ views on subject learningIELTS Listening 8.5

43

Page 44: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

International students’ views on subject learningIELTS 8.0 – L 8.5, W 9.0, R 6.5, S 8.0

Extract 6.12 What I did think was slightly intimidating for me, much more than my English or American friends could imagine was the study of past distinction level essays. It really took a lot of self-convincing for me to believe I could compete with that level of language, I must clarify, it was not the concepts or theory but the language used in such works. In the end, I reconciled myself to the fact that I would put in my best and then leave the rest to the examiner. Perhaps, this is where non-native speakers of the language are at a distinct disadvantage - at a psychological level more than at an actual one.

44

Page 45: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

45

Page 46: Are International Students “At RisK”? - UK NARIC · PDF fileAre International Students “At RisK”? ... English language and the ability to cope with the ... university and living

RemindER oF ABSTRact – to Be Deleted

The government’s focus on secure language testing in recent years has diverted attention away from the purpose of assessing students’ English language proficiency in the university admissions process. As student mobility increases, it is important to review how pre-entry English language assessment fits into the wider mix of admissions criteria and individual universities’ goals for internationalisation. Language assessment plays an important role in the quality assurance of the courses that these students pursue and in the nature and scale of the university’s investment in support programmes to ensure that international students achieve their full potential. Participants in this workshop will consider how decisions about entry level language proficiency position international students within the wider student body. The majority of international students enter having just achieved their university’s minimum English requirement. Are these international students considered to be starting at level pegging with home applicants or does their language proficiency de facto put them into an “at risk” category? We will discuss how important it is for universities to explicitly take account of how language proficiency requirements impact on all students and staff in the university with specific attention given to recruitment, admissions, induction and on-going support.

46