graduate attributes and the internationalized curriculum: embedding a global outlook in disciplinary...

20
http://jsi.sagepub.com/ Education Journal of Studies in International http://jsi.sagepub.com/content/17/2/165 The online version of this article can be found at: DOI: 10.1177/1028315312473655 February 2013 2013 17: 165 originally published online 4 Journal of Studies in International Education Elspeth Jones and David Killick Global Outlook in Disciplinary Learning Outcomes Graduate Attributes and the Internationalized Curriculum: Embedding a Published by: http://www.sagepublications.com On behalf of: Association for Studies in International Education at: can be found Journal of Studies in International Education Additional services and information for http://jsi.sagepub.com/cgi/alerts Email Alerts: http://jsi.sagepub.com/subscriptions Subscriptions: http://www.sagepub.com/journalsReprints.nav Reprints: http://www.sagepub.com/journalsPermissions.nav Permissions: http://jsi.sagepub.com/content/17/2/165.refs.html Citations: at University of Texas at El Paso on November 8, 2014 jsi.sagepub.com Downloaded from at University of Texas at El Paso on November 8, 2014 jsi.sagepub.com Downloaded from

Upload: d

Post on 13-Mar-2017

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

http://jsi.sagepub.com/Education

Journal of Studies in International

http://jsi.sagepub.com/content/17/2/165The online version of this article can be found at:

 DOI: 10.1177/1028315312473655

February 2013 2013 17: 165 originally published online 4Journal of Studies in International Education

Elspeth Jones and David KillickGlobal Outlook in Disciplinary Learning Outcomes

Graduate Attributes and the Internationalized Curriculum: Embedding a  

Published by:

http://www.sagepublications.com

On behalf of: 

Association for Studies in International Education

at: can be foundJournal of Studies in International EducationAdditional services and information for

   

  http://jsi.sagepub.com/cgi/alertsEmail Alerts:

 

http://jsi.sagepub.com/subscriptionsSubscriptions:  

http://www.sagepub.com/journalsReprints.navReprints:  

http://www.sagepub.com/journalsPermissions.navPermissions:  

http://jsi.sagepub.com/content/17/2/165.refs.htmlCitations:  

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 2: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

What is This? 

- Feb 4, 2013OnlineFirst Version of Record  

- Apr 22, 2013Version of Record >>

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 3: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Journal of Studies in International Education17(2) 165 –182© 2013 Nuffic

Reprints and permissions: sagepub.com/journalsPermissions.nav

DOI: 10.1177/1028315312473655jsi.sagepub.com

473655 JSI17210.1177/1028315312473655Journal of Studies in International EducationJones and Killick

1Emerita Professor, Leeds Metropolitan University, Leeds, UK2Leeds Metroplitan University, Leeds, UK

Corresponding Author:Elspeth Jones. Email: [email protected]

Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Elspeth Jones1 and David Killick2

Abstract

Internationalization of the curriculum attracts considerable interest, yet often remains in the hands of enthusiasts or is relegated to the periphery of personal skills modules. While academics may be “happy to ‘tinker around the edges’ of their course content and classroom pedagogy” they still frequently ask, “What does it really mean for me and my classroom?” This article outlines the experience of one U.K. university, which has been seeking to internationalize the curriculum through two phases. The overarching development framework of the first phase (Jones & Killick, 2007) is now being embedded through the university’s adoption of a global outlook as a graduate attribute. This attribute interlinks inclusivity and global relevance and connects equality and diversity with internationalization to form a cohesive construct for graduate development. The authors describe the process of working with academics across the institution to design and implement learning outcomes at modular and program levels within disciplines, to support student achievement of this attribute through the process of constructive alignment.

Keywords

internationalization of the curriculum, internationalization of teaching, learning and research, internationalization of higher education, strategic institutional management of internationalization, globalization and international higher education

Article

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 4: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

166 Journal of Studies in International Education 17(2)

Introduction

Internationalization has become increasingly the norm for universities around the world, albeit with varying interpretations of the term (Jones & De Wit, 2012). In 1998, Mestenhauser described international education as “an important educational mega-goal that should permeate the entire educational system” (Mestenhauser, 1998, p. 4), and Brandenburg and de Wit (2010) now claim that internationalization has “moved from the fringe of institutional interest to the very core” (p. 31). Hudzik (2011) sees comprehensive internationalization as an “institutional imperative, not just a desirable possibility” (p. 7). Yet in spite of these grand statements, many universities continue to relate internationalization to institutional performance, largely in economic or reputational terms, and pay less attention to the benefits that can result for students. Notwithstanding much recent debate on drivers for internationalization (Green, 2012) and rethinking its purpose and nature (IAU, 2012), as yet there are relatively few examples in the literature of successful curriculum internationalization initiatives. Where these exist (see Leask, 2012, for examples), they tend to be “bottom up” in nature, instigated by academics within their own discipline rather than ‘top down’ with an institution-wide focus. This article presents an example of an ongoing inter-nationalization of the curriculum (IOC) process at one U.K. university that seeks to combine an institution-wide initiative delivered within the disciplines.

The current phase of the process has been prompted by the adoption of three gradu-ate attributes within the university, one of which is “a global outlook” (the others being employability and digital literacy). Australian universities have engaged with graduate attributes for some time, many incorporating international/intercultural ele-ments. They have been defined as

the qualities, skills and understandings a university community agrees its stu-dents should develop during their time with the institution. These attributes include, but go beyond, the disciplinary expertise or technical knowledge that has traditionally formed the core of most university courses. (Bowden, Hart, King, Trigwell, & Watts, 2000, p. 1)

Graduate attributes and the potential they offer for IOC are relatively new to the United Kingdom, where IOC efforts have been driven typically by small numbers of academics working on individual courses or modules.1 Presented here is a case study from one of the few U.K. institutions to have taken an institution-wide approach to curriculum review and development for internationalization, dating from 2003. The initial, ground-breaking, 5-year IOC project involved course teams using an institu-tional framework to internationalize their programs and has been reported elsewhere (Jones & Killick, 2007). This article considers Phase 2 of the process, focusing on module and course learning outcomes designed to enable students to achieve the grad-uate attribute of a global outlook. The article offers a description of the process to date and may suggest ideas for those interested in taking a similar path. However, we

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 5: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 167

suggest that direct replication may be inappropriate, as a truly transformative approach to IOC must be firmly grounded in the local institutional and disciplinary contexts.

Context of Curriculum InternationalizationMuch of the literature on IOC comes from Australia and the United Kingdom, both countries having diverse, multicultural urban populations alongside significant numbers of international students. IOC is located at the intersection between the inter-national and the intercultural and is thus equally relevant for domestic and interna-tional student populations. The authors have argued that “responding to the diversity of international students and responding to the diversity of home students are in fact not two agendas but one” (Jones & Killick, 2007, p. 110). The intercultural element is also crucial for Webb (2005), who sees IOC as incorporating “a range of values, including openness, tolerance and culturally inclusive behavior, which are necessary to ensure that cultural differences are heard and explored” (p. 110). However, Marginson and Sawir (2011) suggest there is still much to do, with international edu-cation failing to meet its potential for intercultural development and “the ethnocentrism traditional to English-speaking nations has hardly been dinted” (p. 6).

Across Europe, the recognition that much is to be gained from international/intercultural experiences gave rise to the Internationalization at Home movement (Crowther et al., 2000; Nilsson, 1999). This focuses on the local context, embracing the international as well as the intercultural dimension (Beelen, 2007) in the knowledge that not all stu-dents have the means or the inclination to study abroad. Aligning internationalization within the wider multicultural environment of equity and diversity helps to place inter-national students “at the heart of the university as a source of cultural capital and intentional diversity, enriching the learning experience both for home students and for one another, expanding staff horizons, building a more powerful learning community and thus deepening the HE experience as a whole” (Brown & Jones, 2007, p. 2).

The link between internationalization and intercultural competence development also appears in studies from North America (e.g., Deardorff, 2006), which consider the transformational potential of international experiences (Savicki, 2008), including through “disorienting dilemmas” that can lead to perspective transformation (Mezirow, 1991). Yet this literature relates largely to students who have studied or volunteered abroad or who interact with international students on the domestic campus. To date, there has been limited consideration of the local, multicultural context in the United States as an enabling factor for IOC, although a recent survey by the American Council for Education (American Council of Education [ACE], 2012) found that 55% of American higher education institutions report initiatives underway to internationalize the undergraduate curriculum, including at home, and Green (2012) offers a number of case studies that support this.

Scholars have argued variously that IOC “needs to be connected to a pedagogical discussion to be transformative” (Vainio-Mattila, 2009, p. 95), to enable students to “challenge familiar and typical practices, norms, values and beliefs” (Caruana, 2011,

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 6: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

168 Journal of Studies in International Education 17(2)

p. 245) and “requires changes in pedagogy to encourage students to develop critical skills to understand forces shaping their discipline and challenge accepted viewpoints” (Zimitat, 2008, p. 143). None of this is dependent on an international context, thus affording equally valid approaches to internationalizing the curriculum at home or abroad and indeed across multicultural as well as international boundaries. Done well, IOC “can offer creative assessment, learning and teaching approaches for staff willing to engage seriously with the multicultural dimensions of their classrooms” (Jones, 2013) and facilitate the extension of comfort zones in a controlled manner by chal-lenging cultural assumptions and extending knowledge and experience through the responses of fellow students (Jones & Caruana, 2010).

Van Gyn and colleagues (Van Gyn, Schuerholz-Lehr, Caws, & Preece, 2009) note that the challenge for academics is to

extend our actions far beyond concerns of course content to include pedagogies that promote cross-cultural understanding and facilitate the development of the knowledge, skills, and values that will enable students, both domestic and inter-national, to successfully engage with others in an increasingly interconnected and interdependent world. (p. 26)

Haigh (2009) takes a more extreme position altogether, suggesting we make a non–Western curriculum framework our starting point, whereas Aulakh et al. (1997) emphasize the breadth of the challenge, which involves

teachers and students learning from each other, meeting the needs of overseas, offshore [i.e. those studying on programs overseas] and local students, creating interdependence between students, viewing our professional practice from diverse perspectives, using culturally inclusive teaching practices, accessing teaching and learning resources which reflect diversity, and offering high qual-ity courses which are internationally relevant. (p. 15)

A range of studies with pedagogic approaches in line with this view have resulted in valuable practical resources as well as academic research (see, for example, Harrison & Peacock, 2010; Higher Education Academy, n.d.; Montgomery, 2010; Thom, 2010).

The work cited here supports Leask’s definition of IOC, incorporating, as it does, the intercultural alongside the international, and curriculum content in addition to classroom pedagogy and assessment. IOC is defined as

the incorporation of an international and intercultural dimension into the prepa-ration, delivery and outcomes of a program of study. (Leask, 2009)

During both phases of IOC we have found it beneficial, therefore, to locate interna-tionalization alongside multiculturalism and inclusivity as we seek to develop the cross-cultural capability and global perspectives of our students.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 7: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 169

Context of the Case Study

Leeds Metropolitan University is a large university with a teaching and learning focus and a wide portfolio of courses, many of which are vocationally oriented. In the early 2000s a values-driven, holistic approach to internationalization was adopted. By 2006 this was embedded in the university’s strategic plan, with the intention that an “inter-national, multicultural ethos be pervasive throughout scholarship, curriculum, volun-teering and community engagement at home and overseas” (Leeds Met, 2006).

Phase 1 of the institutional focus on IOC was through a guidelines document on cross-cultural capability. This provided a strategic framework of developmental ques-tions, to be used by undergraduate course teams across the institution with a view to introducing or enhancing cross-cultural capability in programs within their discipline over a 5-year period. An internal review at midpoint led to modification of the guide-lines, with global perspectives being explicitly added as an ethical underpinning (Killick, 2006). These were seen to contribute to the development of graduates as global citizens and drew on synergies between international and intercultural contexts and between local and global responses to issues of equality and diversity. The univer-sity was cited in several reports and academic publications for this strategic approach to IOC (Bourn, McKenzie, & Shiel, 2006; Caruana & Spurling, 2007; Fielden, 2007; Shiel & McKenzie, 2008). Examples of the reviews produced by course teams can be found on the website (Leeds Met, n.d.), and the project was evaluated by Jones and Killick (2007).

Much was achieved by way of advancing the institutional discourse around inter-nationalization and bringing cross-cultural capability and global perspectives into a range of programs. However, IOC had often been embedded in personal development modules or key skills work rather than closely aligned to the subject area, as had been intended. How, then, to embed IOC further, and in particular, to make links with equality and diversity more explicit, contextualizing IOC very clearly within the dis-cipline and associated professional practice?

The opportunity came with a strategic project to introduce graduate attributes into the undergraduate curriculum. Graduate attributes are only now becoming a feature of U.K. higher education, in part as universities seek to make themselves distinctive in a more market-oriented environment. Barrie (Barrie, 2004, 2006, 2007) has looked at how Australian academics construe and seek to embed graduate attributes in their own institutions. In general, he found a confused picture and limited evidence that the attri-butes were being embedded into student learning. Barrie’s (2007) publication proposed they could be developed either through the course (“engagement” model) or through participation in broader university life (“participatory” model). These might be seen as either the formal or the extended/informal curriculum. The latter profoundly mediates the messages of the formal curriculum but is not the focus of this article, which looks instead at embedding graduate attribute development through the formal curriculum, such that student engagement is driven by module and course experiences.

Mindful of limitations identified by Barrie in the Australian experience, we note

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 8: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

170 Journal of Studies in International Education 17(2)

The extent to which the rhetoric of such statements [of graduate attributes] actu-ally represents a shared understanding of the outcomes of a university education is a matter of conjecture. The extent to which present day university teaching and learning processes actually develop such outcomes in graduates is even more contestable. (Barrie, 2006, p. 215)

Thus, we saw it necessary to pay attention both to process and to outcomes as we con-tinued the IOC work already begun. The curriculum review process requires all under-graduate course teams to undertake a number of structural modifications and to embed three graduate attributes into all disciplines. Reviewing the embedding of a global outlook across the whole undergraduate provision is a key responsibility of one of the authors of this article. We now consider efforts to devise, advise on, and implement the embedding of the global outlook attribute in continuation of the strong history of IOC within the institution.

Developing, Defining, and Embedding a Global OutlookIt was noted in Phase 1 that learning outcomes for IOC were not always embedded and assessed within the mainstream curriculum or linked directly and explicitly to the core knowledge and skills of the subject area. Drawing upon Biggs’ (Biggs, 2003; Biggs & Tang, 2007) work on constructive curriculum alignment, it was apparent that being explicit in this way would be key for success at Phase 2. Constructive alignment is not without its critics (e.g., Hussey & Smith, 2008; Jervis & Jervis, 2005) in that it seeks to “prescribe” the student learning journey, from intended outcomes, through “aligned” learning experiences through to final assessment. Notwithstanding the inherent tension between defining outcomes and predicting what is actually learned, we consider that embedded learning outcomes for such a broad attribute as a global outlook could lead to the kind of assessment as preparation for future learning for which Boud and Falchikov (Boud, 2000; Boud & Falchikov, 2006) have argued.

In the United Kingdom at least, significant emphasis is given to constructing out-comes that reflect cognitive taxonomies of learning, notably drawn from Bloom’s (1956) seminal work, or the SOLO taxonomy developed by Biggs and Collins (1982). Thus, each learning outcome is a statement of a measurable outcome of the learning process, utilizing an explicit “action” verb, which students are able to “perform” and which is bound to the level of study. The constructive alignment process ensures that content, delivery, and assessment build outwards from these.

What is also clear from much of the literature on global citizenship (and related) learning is the need for learning outcomes themselves to reflect a more holistic learner development than is often the case and for at least some consideration to be given to their affective and behavioral capabilities (see Krathwohl, Bloom, & Masia, 1964). This was in line with our use of graduate attributes, and the challenge was to ensure that learning outcomes were observable and measurable, in order to drive curriculum and assessment effectively.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 9: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 171

It was clear that guidance would be needed on (re)framing subject learning out-comes. It would also be necessary to ensure that the global outlook attribute itself was given shape, informed by a range of subject specialists. To achieve these ends, the authors coordinated a cross-faculty working group chosen from those with a particular interest in internationalization. It was felt that their experience would contribute to deliberations and they could provide valuable support as we rolled out the initiative across faculties. The result was to be a guidance document and other resources for course teams on embedding a global outlook into curricular and assessment practices.

We were concerned to ensure that this work should continue and build from the rationale and experience of the Phase 1 curriculum work on cross-cultural capability and global perspectives. It would also be crucial to start from existing learning out-comes, helping colleagues to “internationalize” these rather than creating alternatives. Fundamental features to be considered included global issues, social justice, commu-nicating and working effectively across cultures (broadly defined), seeing subject and related professional activities in a global perspective, and linking global/international and local/multicultural contexts.

The first outcome of the group was a working definition of the graduate attribute of a global outlook as “effective and responsible engagement with a multicultural and globalizing world.” The attribute was described as incorporating two interlinked dimensions: inclusivity and global relevance:

inclusive—non-discriminatory, appropriate, transparent, etc. for the wide range of students we recruit. While in internationalization of the curriculum this work has tended to be directed towards “international” students, the issues raised and responses required are no different in principle from those involved in working with any student. Each student is part of the diversity of the institution, and as such they benefit when we interrogate and improve our practice to best meet individual student needs and value individual student perspectives and contributions what-ever their nationality, ethnicity, gender, etc. A similarly inclusive attitude towards “others” locally is encompassed in the graduate attribute of a global outlook.

globally relevant—for all students graduating, seeking employment and going on to shape their personal lives in a multicultural, globalising world, with its increased connectivities, unpredictabilities and mobilities. In internationalization of the curriculum, the concern is to ensure the students see how their disci-pline and the professions to which it relates fit into this rapidly evolving global context, and to equip them with attributes such as cross-cultural capa-bility and global perspectives which will enable them to “make their way” responsibly in this world, professionally and personally. (authors’ emphasis; Killick, 2011, pp. 18-19)

Working from such expanded definitions, the group devised guidance in the form of generic learning outcomes, which might allow course teams to substitute [bracketed] items with topics and activities from their own modules. Examples include

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 10: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

172 Journal of Studies in International Education 17(2)

Students will be able to

• explain how [specific aspects of practice] impact upon the lives of people locally and in diverse global contexts;

• critically review [current U.K. practice] through reference to practice in [two] other countries;

• present an analysis of [the subject] appropriately for an audience of diverse cultures and first languages;

• make a significant positive contribution as a member of a multicultural/international team work project;

• effectively conduct primary research involving participants from a range of cultural backgrounds;

• synthesize a range of international data sources as the basis for an analysis of potential problems and benefits associated with [the expansion of this practice];

• critique the themes presented in [this area] from [two] alternative interna-tional perspectives;

• find commonly acceptable ethical solutions to complex global problems relating to [this area];

• present a critically reasoned and respectful argument in favour of one specific socio-cultural response to [this area];

• detect bias, stereotypical thinking and prejudicial opinion in published mate-rial relating to [this issue];

• advance creative solutions for [this problem] which demonstrate appropriate consideration of at least one global (non-U.K.) context in which they will be applied. (Leeds Met, 2011, pp. 7-8)

We then did more specific work on actual learning outcomes from existing pro-grams with which working group participants were familiar, in order to ensure our expectations were realistic. Figure 1 gives some resulting examples.

As can be seen from the examples, the revised wording performs a number of func-tions. First, quite small changes can have a significant impact on how the learning outcome is to be interpreted. Second, with the revised wording, appropriate pedagogy and assessment must follow in order that students can demonstrate achievement of the outcomes. It is here that support and development of staff will be crucial in achieving effective IOC. Third, by using existing examples of learning outcomes we stress that it is not about adding a learning outcome for IOC but about embedding it, or making existing practice explicit, and we also emphasize the primacy of the disciplinary con-text. Finally, it was clear that this would be possible across all disciplines we consid-ered, including in science and technology or courses with professional accreditation. It has been known for resistance to IOC to be ascribed to demands of the professional body or the “universality” of concepts within some disciplines. It was satisfying to have examples to counter such arguments.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 11: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 173

Figure 1. Sample of existing and modified learning outcomes.

Original Learning OutcomeStudents will be able to…

Modified Learning OutcomeStudents will be able to…

Comment

analyse market opportunities in the international business environment.

Analyse market opportunities in two contrasting international business environments.

The original outcome could lead to assumptions of homogeneity across international business environments.

Explain financial conduct and regulation issues, such as conflicts of interest and the Financial Services and Marketing Act, as they arise in the context of relevant transactions

explain financial conduct and regulation issues, such as conflicts of interest and the Financial Services and Marketing Act, as they arise in the context of relevant transactions to a client accustomed to operating in a different national context

In addition to considering transparency and accessibility of their own communication skills, students will have to identify, and think through the issues more critically by putting themselves in the shoes of someone from outside the UK.

Debate the ethical responsibilities of Science in Society with reference to current issues

debate the ethical responsibilities of Science with reference to current issues in a multicultural society

Making the multicultural element explicit means it will not be overlooked when devising content/ assessment.

List the different components of fitness and evaluate their contribution to functional capacity.

List the different components of fitness and evaluate their contribution to functional capacity with appropriate reference to issues of race, gender and cultural contexts.

Here, learning outcomes address issues equally relevant to multicultural as to international contexts.

Review the role of the organisation within the changing context of the wider sector.

Review the role of the organisation within the changing local and global contexts of the wider sector

The revised outcome makes specific the context of the wider sector.

Demonstrate an awareness of the range of professional, ethical and legal issues relevant to the professional environment of their discipline

demonstrate an awareness of the range of professional, ethical and legal issues relevant to the global professional environment of their discipline

Addition of the single word ‘global’ can make a real difference to interpretation

In devising the generic learning outcomes and in modifying those in current use, we noted several issues, including the need to

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 12: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

174 Journal of Studies in International Education 17(2)

• make the attribute explicit even though it might be “understood” to permeate the subject;

• clarify terminology such as “international” to include “intercultural,” for example, in the use of case studies;

• ensure that issues identified as globally relevant are not limited to an outward-looking perspective but also include awareness of how U.K. or Anglo-centric disciplinary practice/culture might appear from other perspectives;

• go beyond conceptions of internationalization being addressed by interna-tional industry standards or processes;

• make explicit that inclusivity requires an active approach not a passive one, for example, using group work to address diversity in a positive way, not merely assuming that multicultural/mixed nationality groups will be effective;

• recognize that IOC might not be relevant to every single module but that it should appear progressively in some modules at each level of study.

Some highly productive professional conversations in the working group enabled us to reach these conclusions. Cross-disciplinary discussions helped all of us to chal-lenge disciplinary assumptions within learning outcomes. Our ability to identify why course development teams may be approaching their task in particular ways and to advise on how or where further modifications might be made to learning outcomes was enhanced as a result.

One further issue was whether we might be able to devise a taxonomy of progress toward a global outlook during a course. However, it was agreed that progression would be better dealt with by teams:

a. Module tutors devise learning outcomes to match disciplinary-level requirements.

b. Course leaders look across module outcomes to ensure “horizontal” coher-ence within a level as well as “vertical” development over course levels or years of full-time study.

Figure 2, taken from Jones (2013), illustrates how this model can work. In our case, the top of the pyramid is represented by the global outlook graduate attribute as an outcome for all students in the university. At the bottom are the module learning out-comes that make up each course or program. The intermediate stages of the diagram indicate how the learning outcomes are designed to ensure successful students achieve the graduate attribute within their own program/discipline, with each “phase” denoting a year of full-time study.

We recognized that academic staff might need further guidance on generic expecta-tions of students at the end of each year of study to ensure that progress is being made and articulated these as follows:

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 13: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 175

After the first year of full-time undergraduate study, students will be able to discuss

• their individual sociocultural values and practices;• the role of their discipline in diverse cultural and global contexts;• the impact of diverse cultural and global contexts on their discipline.

After the second year, students will be able to evaluate

• their individual attitudes, values, and skill set for diverse cultural and global contexts;

• the impact of diverse cultural and global contexts upon aspects of their discipline;• the impact of aspects of their discipline within diverse cultural and global contexts.

After the third year (completion of the course), students will be able to apply their subject-specific, work-based, and generic life skills

• in multicultural and global environments;• within a personal ethic that is informed by a critical awareness of diverse

cultural and global contexts.

Figure 2. The curriculum pyramid.Source: Internationalization of the curriculum within the university framework, from Jones (2013).

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 14: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

176 Journal of Studies in International Education 17(2)

The guidelines document that resulted from discussions at the working group (Killick, 2011) formed one of a range of supporting documents presented to course leaders through a series of workshops and made available on the university learning and teaching website prior to the curriculum refocus project.

Progress to DateAt the time of writing, course documentation is completed and course teams are plan-ning the implementation of their work to embed graduate attributes. To illustrate how some course teams have successfully embedded dimensions of a global outlook within core aspects of their discipline, the following are extracted from course docu-mentation.

First, two examples of course-level outcomes:From BSc Sport, Physical Activity and Health,

• Students will be able to . . . critically evaluate local, national, and interna-tional intervention strategies for the promotion of physical activity for health across a diverse range of populations.

From BA (Hons.) Landscape Architecture,

• Students will be able to . . . appreciate the significance of landscape design theories, global and ethical perspectives (including planning and sustainabil-ity contexts), and their application to landscape architecture.

And second, two examples of module-level outcomes:From BA (Hons.) Primary Education, Level 5 module: Professional studies:

Diversity and inclusion,

• Students will be able to . . . develop and evaluate inclusive approaches to teaching and learning, including strengthening global and local dimensions in the taught curriculum.

From BSc Mental Health Nursing, Level 6 module: Leadership, management, and enterprise

• Students will be able to . . . critically appraise the World Health Organiza-tion’s health priorities in both a national and international context of health care policy and practice, evaluating the role of nursing and other health care professionals within a globalized context

The next stage will be to review student achievement against these outcomes dur-ing end-of-year assessment.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 15: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 177

As a major initiative in curriculum development, affecting all undergraduate courses at a defined point in time, this offers significant opportunities for a longitudi-nal evaluation of impact. Plans for this include the use of student focus groups and questionnaires to capture comparative data for those engaging with the original cur-riculum and those undertaking curricula in which the graduate attributes have been embedded.

Summary and EvaluationTo our knowledge, this is the first university-wide project to embed a significant con-struct for the internationalized curriculum through module and course learning out-comes. The writing of these has been facilitated through individual support for course teams, workshops, drop-in sessions, and an online FAQ site to support the general guidance documentation. As revised curriculum documentation is submitted for scru-tiny, the formative review stage will provide additional guidance directly to each course team where this appears helpful. Leask (2008) noted the importance of taking a “holistic” approach to IOC, pointing out that internationalizing content alone is insufficient:

An internationalised curriculum will therefore need to utilise a wide variety of teaching and learning strategies which have been carefully selected and con-structed. It will focus on both “what is taught and learned” (that is, on both content and outcomes) and “how it is taught and learned” (that is, on what both teachers and learners do). (p. 61)

We entirely endorse that statement. Although we have addressed only outcomes in this paper, our view is that we will achieve such a holistic result through the process of constructive alignment which underpins good curriculum design, delivery and assessment. Notwithstanding the considerable resource commitment already made in developing appropriate learning outcomes, ongoing staff development and support will be essential in enabling course teams to deliver the student learning opportunities leading to these outcomes.

The process detailed above forms the latest stage of continuous engagement with internationalization at Leeds Metropolitan University, which began several years before the first IOC project in 2003. It is perhaps rare for two academic members of staff to be involved in such an extended process. It is also rare, if not unique, for any institution to have undertaken such a strategic and pervasive approach to IOC. We conclude therefore with what we hope are helpful reflections on what might have been done better in hindsight and some suggested priorities for others who may wish to take forward similar initiatives.

Learning points from Phase 1 of the project—curriculum review using the Guidelines on Cross-Cultural Capability and Global Perspectives:

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 16: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

178 Journal of Studies in International Education 17(2)

• The questions for review teams were “static” rather than developmental, encouraging an audit-type response, that is, we asked. “How does the course . . . ?” instead of, “How could the course better . . .?”

• There should have been more planning of support for course teams, offer-ing development opportunities, prior to and during the review period, par-ticularly as internationalization was only just entering U.K. higher education discourse.

• Although course team responses to the review questions were captured in course-level annual and periodic review documentation, and so captured through quality assurance processes, there was only limited overview of responses across different course teams; among other things, this limited the dissemination of good practice.

Our thoughts on critical success factors for embedding IOC

a. align IOC with relevant related agendas—in our case, the link with equality and diversity is particularly important;

b. enlist the support of subject specialists; such people are not only essential if the language of any documentation is to speak to those implementing the changes, but they also make helpful allies and effective champions within their departments;

c. demonstrate how the work benefits students and becomes embedded into the discipline; these are essential in defusing academic staff concerns over the potential for this work to detract from the core subject;

d. offer a wide range of staff development and course development support and be prepared to engage in open, constructive professional conversations; use these as opportunities to identify and disseminate good practice from within the institution.

Qualitative as well as quantitative data will help us evaluate the success of IOC Phase 2 as students progress through revised learning outcomes at each level of study. However, it will take at least 3 years for students following the refocused curriculum to graduate and only then will we know finally whether our efforts have helped them develop a global outlook.

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 17: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 179

Note

1. UK terminology is used in this article. “Module” is a unit of study that is combined with other modules to make up a “Level” of study. One level is completed in 1 year for a full-time undergraduate, with each “course” or “program” such as BA or BSc (Hons.) comprising three or four “levels.”

References

American Council for Education. (2012). Mapping internationalization on U.S. campuses. Retrieved from http://www.acenet.edu/AM/Template.cfm?Section=Programs_and_Services&Content ID=45384

Aulakh, G., Brady, P., Dunwoodie, K., Perry, J., Roff, G., & Stewart, M. (1997). Internation-alizing the curriculum across RMIT University. Melbourne, Australia: RMIT University: Commonwealth Staff Development Fund Internationalization Project Report.

Barrie, S. C. (2004). A research-based approach to generic graduate attributes policy. Higher Education Research & Development, 23, 261-275.

Barrie, S. C. (2006). Understanding what we mean by the generic attributes of graduates. Higher Education, 51, 215-241.

Barrie, S. C. (2007). A conceptual framework for the teaching and learning of generic graduate attributes. Studies in Higher Education, 34, 439-458.

Beelen, J. (Ed.). (2007). Implementing internationalisation at home (EAIE Professional Devel-opment Series for International Educators, Number 2). Amsterdam, Netherlands: EAIE.

Biggs, J. (2003). Teaching for quality learning at university: What the student does (2nd ed.). Buckingham, UK: Society for Research into Higher Education & Open University Press.

Biggs, J., & Collins, K. (1982). Evaluating the quality of learning: The SOLO taxonomy. Oxford, UK: Oxford University Press.

Biggs, J., & Tang, C. (2007). Teaching for quality learning at university. Maidenhead, UK: Open University Press.

Bloom, B. S. (1956). Taxonomy of educational objectives. Handbook I: The cognitive domain. New York, NY: David McKay.

Boud, D. (2000). Sustainable assessment: Rethinking assessment for the learning society. Stud-ies in Continuing Education, 22, 151-167.

Boud, D., & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education, 31, 399-413.

Bourn, D., McKenzie, A., & Shiel, C. (2006). The global university: The role of the curriculum. London: Development Education Association.

Bowden, J., Hart, G., King, B., Trigwell, K., & Watts, O. (2000). Generic capabilities of ATN university graduates. Retrieved from http://www.clt.uts.edu.au/ATN.grad.cap.project.index.html

Brandenburg, U., & De Wit, H. (2010). The end of internationalisation. EAIE Forum, pp. 30-33.Brown, S., & Jones, E. (2007). Values, valuing and value in an internationalised higher educa-

tion context. In E. Jones & S. Brown (Eds.), Internationalising higher education (pp. 1-6). London: Routledge.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 18: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

180 Journal of Studies in International Education 17(2)

Caruana, V. (2011). The challenge of global citizenship education in the 21st century university: A case for service learning and community volunteering? In V. Clifford & C. Montgomery (Eds.), Moving towards internationalisation of the curriculum for global citizenship in higher edu-cation (pp. 227-250). Oxford, UK: Oxford Centre for Staff and Learning Development.

Caruana, V., & Spurling, N. (2007). The internationalisation of UK higher education: A review of selected material. York, UK: Higher Education Academy. Retrieved from http://www.heacademy.ac.uk/resources/detail/the_internationalisation_of_uk_he

Crowther, P., Joris, M., Otten, M., Nilsson, B., Teekens, H., & Wächter, B. (2000). Interna-tionalisation at home (European Association for International Education Position Paper). Retrieved from http://www.eaie.org/IaH/IaHPositionPaper.pdf

Deardorff, D. K. (2006). Identification and assessment of intercultural competence as a student outcome of internationalization. Journal of Studies in International Education, 10, 241-266.

Fielden, J. (2007). Global horizons for UK universities. London, UK: Council for Industry and Higher Education.

Green, M. (2012). Measuring and assessing internationalization. Retrieved from http://www.nafsa.org/resourcelibrary/Default.aspx?id=32455

Haigh, M. (2009). The Sattvic curriculum: A three-level, non-western, superstructure for under-graduate education. In C. Kreber (Ed.), Internationalizing the curriculum in higher educa-tion (New Directions for Teaching and Learning, Number 118; pp. 61-70). San Francisco, CA: Jossey-Bass.

Harrison, N., & Peacock, N. (2010). Interactions in the international classroom—the UK per-spective. In E. Jones (Ed.), Internationalisation and the student voice: Higher education perspectives (pp. 125-142). London: Routledge.

Higher Education Academy. (n.d.). The teaching international students project. Retrieved from http://www.heacademy.ac.uk/teaching-international-students

Hudzik, J. (2011). Comprehensive internationalization: From concept to action. Retrieved from http://www.nafsa.org/resourcelibrary/Default.aspx?id=24045

Hussey, T., & Smith, P. (2008). Learning outcomes: A coneptual analysis. Teaching in Higher Education, 13(1), 107-115.

International Association of Universities. (2012). Affirming academic values in international-ization of higher education: A call for action. Retrieved from http://www.iau-aiu.net/sites/all/files/Affirming_Academic_Values_in_Internationalization_of_Higher_Education.pdf

Jervis, M., & Jervis, L. (2005). What is the constructivism in constructive alignment? Biosci-ence Education, 6. Retrieved from http://www.bioscience.heacademy.ac.uk/journal/vol6/beej-6-5.aspx

Jones, E. (2013). The global reach of universities: Leading and engaging academic and sup-port staff in the internationalisation of higher education. In R. Sugden, M. Valania, & J. R. Wilson (Eds.), Leadership and cooperation in academia: Reflecting on the roles and responsibilities of university faculty and management. Cheltenham, UK: Edward Elgar.

Jones, E., & Caruana, V. (2010). Nurturing the global graduate for the 21st century: Learning from the student voice on internationalisation. In E. Jones (Ed.), Internationalisation and the student voice: Higher education perspectives (pp. xv-xxiii). London: Routledge.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 19: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

Jones and Killick 181

Jones, E., & Killick, D. (2007). Internationalisation of the curriculum. In E. Jones & S. Brown (Eds.), Internationalising higher education (pp. 109-119). London: Routledge.

Jones, E., & De Wit, H. (2012). Globalization of internationalization: Thematic and regional reflections on a traditional concept. AUDEM: The International Journal of Higher Educa-tion and Democracy, 3, 35-54.

Killick, D. (2006). Cross-cultural capability and global perspectives. Guidelines for curriculum review. Leeds, UK: Leeds Metropolitan University.

Killick, D. (Ed.). (2011). Embedding a global outlook as a graduate attribute at Leeds Metropolitan University: Refocusing the undergraduate curriculum. Retrieved from http://www.leedsmet.ac.uk/staff/files/UG_Embedding_Global_Outlook.pdf

Krathwohl, D. R., Bloom, B. S., & Masia, B. B. (1964). Taxonomy of educational objec-tives. The classification of educational goals. Handbook II: Affective domain. London, UK: Longman.

Leask, B. (2008). A holistic approach to internationalisation—Connecting institutional policy and the curriculum with the everyday reality of student life. In C. Shiel & S. Takeda (Eds.), Education for sustainable development: Graduates as global citizens (pp. 57-66). Dorset, UK: Bournemouth University.

Leask, B. (2009). Using formal and informal curricula to improve interactions between home and international students. Journal of Studies in International Education, 13, 205-221.

Leask, B. (2012). Internationalisation of the curriculum in action. Retrieved from http://www.ioc.net.au

Leeds Met. (2006). Leeds Metropolitan University, vision and character statement (Now superseded). Leeds, UK: Leeds Metropolitan University.

Leeds Met. (n.d.). Cross-cultural capability resources. Retrieved from http://alt-resource.teams.leedsmet.ac.uk/cross-cultural-capability

Marginson, S., & Sawir, E. (2011). Ideas for intercultural education. New York, NY: Palgrave Macmillan.

Mestenhauser, J. A. (1998). Portraits of an international curriculum: An uncommon multidimen-sional perspective. In J. A. Mestenhauser & B. J. Ellingboe (Eds.), Reforming the higher education curriculum: Internationalising the campus (pp. 3-39). Phoenix, AZ: American Council on Education and Oryx Press.

Mezirow, J. (1991). Transformative dimensions of adult learning. San Francisco, CA: Jossey-Bass.Montgomery, C. (2010). Understanding the international student experience. Basingstoke, UK:

Palgrave Macmillan.Nilsson, B. (1999). Internationalisation at home: Theory and praxis. Amsterdam, Netherlands:

EAIE Forum.Savicki, V. (Ed., 2008). Developing intercultural competence and transformation: Theory,

research and application in international education. Sterling, VA: Stylus.Shiel, C., & McKenzie, A. (Eds., 2008). The global university. The role of senior managers.

London, UK: DEA.Thom, V. (2010). Mutual cultures: Engaging with interculturalism in higher education. In

E. Jones (Ed.), Internationalisation and the student voice: Higher education perspec-tives (pp. 155-165). London: Routledge.

at University of Texas at El Paso on November 8, 2014jsi.sagepub.comDownloaded from

Page 20: Graduate Attributes and the Internationalized Curriculum: Embedding a Global Outlook in Disciplinary Learning Outcomes

182 Journal of Studies in International Education 17(2)

Vainio-Mattila, A. (2009). Internationalizing curriculum: A new kind of education? In C. Kreber (Ed.), Internationalizing the curriculum in higher education (New Directions for Teaching and Learning, Number 118; pp. 95-103). San Francisco, CA: Jossey-Bass.

Van Gyn, G., Schuerholz-Lehr, S., Caws, C., & Preece, A. (2009). Education for world-mindedness: Beyond superficial notions of internationalization. In C. Kreber (Ed.), Internationalizing the curriculum in higher education (New Directions for Teaching and Learning, Number 118; pp. 25-38). San Francisco, CA: Jossey-Bass.

Webb, G. (2005). Internationalisation of curriculum: An institutional approach. In J. Carroll & J. Ryan (Eds.), Teaching international students: Improving learning for all (pp. 109-118). London, UK: Routledge.

Zimitat, C. (2008). Internationalisation of the undergraduate curriculum. In L. Dunn & M. Wallace (Eds.), Teaching in transnational higher education (pp. 135-147). London, UK: Routledge.

Author Biographies

Elspeth Jones is Emerita Professor of the Internationalisation of Higher Education at Leeds Metropolitan University and International Education consultant. She is a member of the Scientific Committee of the Centre for Higher Education Internationalisation at the Università Cattolica del Sacro Cuore, Milan. She is Visiting Professor at the University of Zagreb, and at Edge Hill University in the UK and Chair of the Board of NCUK, a consortium of eleven UK universities. She has worked in international education for over 30 years, having lived in Germany, Singapore and Japan, and has published widely in the field.

David Killick is Head of Academic Staff Development in the Centre for Learning and Teaching at Leeds Metropolitan University. He lived and taught in several countries before taking up a post at the university more than 20 years ago. His work on cross-cultural capability and curricu-lum internationalization has provided a lead in his own institution and to others in the sector. He is currently course leader for the postgraduate certificate in higher education and offers CPD workshops and consultancy activities on many aspects of internationalization.