the national foreign language exams for the state certificate of foreign language proficiency in...

The National Foreign Language Exams for the State Certificate of Foreign Language Proficiency in Greece: The KPG

examination suite

http://rcel.enl.uoa.gr/kpg

21/04/23 1

Professor Bessie Dendrinos, Professor Bessie Dendrinos, President of the KPG Examination Board President of the KPG Examination Board

Hellenic Ministry of Culture, Education and Religious AffairsHellenic Ministry of Culture, Education and Religious AffairsNational & Kapodistrian University of Athens, Aristotle University of Thessaloniki National & Kapodistrian University of Athens, Aristotle University of Thessaloniki

& Computer Technology Institute of the University of Patras & Computer Technology Institute of the University of Patras

21/04/23 2

 National Strategic Reference Framework (NSRF) – 2007-2013

The multilingual CALT platformPlatform for the e-training of oral

examiners and script raters (http://galaxy.cti.gr/e-kpg-devel23/)  

The KPG e-school (http://rcel.enl.uoa.gr/kpgeschool/)

21/04/23 3

21/04/23 4

Both the computer-based and the paper-based KPG exams contain common:

proficiency scaling (aligned to the 6 level scale of the Council of Europe)

illustrative descriptors (aligned to the CEFR)

accompanying criterial features

(constructivist) view of language-in-use21/04/23 5

The exam suite is based on a generic (portable across languages) methodological framework suitable for describing language performance across proficiency levels.

21/04/23 6

And… across languages, the exams:

test common competences and strategies

are regulated by common specifications

use a common test-task typology

21/04/23 7

Authoring tool Piloting tool Test player

21/04/23 8

21/04/23 9

Diagram showing the flow of roles, and work required to insert test tasks and give final approval

The KPG CALT is developed to test both comprehension and production:

The first part tests:reading comprehensionlistening comprehensionlanguage awareness

21/04/23 10

The CALT is not item but task based. The smallest unit of the comprehension

part is a task, not an item. Three test tasks comprise a ‘testlet’. The candidate’s performance in each

testlet determines what testlet level s/he will be served next.

21/04/23 11

Each testlet is composed of three tasks:

1)One reading comprehension task2)One language awareness task 3)One listening comprehension task There is a common (across languages)

formula as to the mix of the types of tasks that each testlet contains.

21/04/23 12

The KPG CALT contains 10 task types giving us in all 12 types of testlets.

Each task is composed of 5 items as follows: a) items testing comprehension of a

source (written or audio) text b) items testing awareness of correct and

appropriate use of language

21/04/23 13

3 tasks comprise a testlet 3 testlets comprise a testing unit 3-5 testing units comprise a

complete a complete test for each of the lower

levels (Α1-Β1) contains 3 testlets (45 items in total)

a complete test for each of the higher levels (B2-C2 level) contains 4 testlets (60 items).

21/04/23 14

The candidate chooses the level of the testlet s/he wants to start with and then if s/he is successful on 50% of the

items, the next testlet is of the same level

his/her success is below 50%, the next testlet is of lower level

If his/her success is above 50%, the next testlet is of higher level

21/04/23 15

Digital e-test typology

21/04/23 16

21/04/23 17

21/04/23 18

21/04/23 19

21/04/23 20

21/04/23 21

21/04/23 22

21/04/23 23

21/04/23 24

21/04/23 25

21/04/23 26

Production performance is also computer based

The tests on reading and listening comprehension determine the level of the speaking and writing tests in which candidates will be asked to participate

21/04/23 27

TESTING SPEAKING &ORAL MEDIATION

TESTING WRITING & WRITTEN MEDIATION

21/04/23 28

Similar test tasks across languages are aimed to assess context specific:

oral performance, stimulated by visual or multimodal texts in the target language oral mediation performance, stimulated by texts in the home language

21/04/23 29

21/04/23 30

Diese Fotos stammen aus Ihrem elektronischen Familienalbum. Welche Personen sind auf den Fotos abgebildet? Wann und warum wurde jedes einzelne Foto gemacht?

21/04/23 31

A tuo parere, prima della ripresa di queste due fotografie, che cosa può essere accaduto? E cosa hanno in comune i due avvenimenti?

21/04/23 32

Dinos cómo crees que se sienten estas personas y por qué.

21/04/23 33

Tell your friend Edward about two games he knows almost nothing about: backgammon and jenga.

Click here to speak

Similar test tasks across languages are aimed to assess context specific:

writing performance, stimulated by cues, visual or multimodal texts in the target language written mediation performance, stimulated by texts in the home language

21/04/23 34

21/04/23 35

21/04/23 36

Escribe un e-mail (60-70 palabras) a tu amiga Valentina para hablarle de un bonito lugar de tu ciudad donde estuviste ayer. Cuéntale:1. Qué tipo de lugar era2. Dónde está exactamente3. Qué hiciste allí

21/04/23 37

21/04/23 38

21/04/23 39

It’s a management system linked to the Authoring Tool.

Its purpose is to manage trial runs (or the piloting) of each test task, in real-time conditions, with a view to examining the task’s validity.

21/04/23 40

Groups of tasks are packed in groups and piloted by sample population of candidates

Depending on how well the tasks have ‘behaved’, they may be considered: good enough to be inserted in the Test

Bank partially problematic and in need of

amendments seriously problematic (warranting serious

modification or ditching)21/04/23 41

The PT has been designed to measure basic indices with an inbuilt statistics system

The functions of the PT are available to the members of the language-specific author team who have been assigned the role of ‘task evaluator’ and/or the role of ‘Administrator’.

21/04/23 42

They are managed as follows: The user ‘characterizes’ a total

number of tasks on the basis of the task. typology and creates test packages

Token are created for the sample population who will use them.

Indices of statistical interest are worked out for results and ultimately findings.

21/04/23 43

www.rcel.enl.uoa.gr

21/04/23 44