top 5 pitfalls to avoid in english cefr assessment

33
Top 5 pitfalls to avoid in English CEFR progress assessment Brano Pokrivcak

Upload: tracktest

Post on 30-Jul-2015

34 views

Category:

Education


0 download

TRANSCRIPT

Page 1: Top 5 pitfalls to avoid in English CEFR assessment

Top 5 pitfalls to avoid in English CEFR progress assessment

Brano Pokrivcak

Page 2: Top 5 pitfalls to avoid in English CEFR assessment

About TrackTest.eu

• established in 2012 in Slovakia

• users from 140 countries

• customers in 60 countries

• companies, schools, individuals

Page 3: Top 5 pitfalls to avoid in English CEFR assessment

TrackTest coverage

Page 4: Top 5 pitfalls to avoid in English CEFR assessment

Do you like maths?

Reliable language assessment

Page 5: Top 5 pitfalls to avoid in English CEFR assessment

http://en.wikipedia.org/wiki/Glicko_rating_system

Page 6: Top 5 pitfalls to avoid in English CEFR assessment

Top 5 pitfalls to avoid in English CEF progress assessment

Page 7: Top 5 pitfalls to avoid in English CEFR assessment

1. Choosing the right test format

Page 8: Top 5 pitfalls to avoid in English CEFR assessment

One test vs. level tests ?

One test: Pros:– One test = one score– Fast and comparable– Must for placement tests.

Cons:– Assumes that your knowledge is linear– Not wide enough– Problem how to match to CEFR

- Adaptive test

Page 9: Top 5 pitfalls to avoid in English CEFR assessment

Single test vs. level tests ?

Level test: Pros:– Different skills can be tested (less multi-choice grammar

questions, more reading comprehension in higher levels)– Questions adequate to the level– More detailed assessment of topics for the level

Cons:– Difficult to decide which level to start– Progress between levels

Page 11: Top 5 pitfalls to avoid in English CEFR assessment

2. How to measure progress between levels ?

Page 12: Top 5 pitfalls to avoid in English CEFR assessment

2. How to measure progress between CEF levels ?

Page 13: Top 5 pitfalls to avoid in English CEFR assessment

3. Reliability of test

Page 14: Top 5 pitfalls to avoid in English CEFR assessment

Same difficulty for everybody (with one test or generated test)

• heavily organized assessments (e.g. maturita)- one set of questions

• Diversified environments (corporations and/or multiple locations) require more flexibility

Challenge: Generated test needs to match the difficulty & topics coverage

Page 15: Top 5 pitfalls to avoid in English CEFR assessment

What is cheating ?

• Copying answers from classmates ?

• Googling for the right answer ?

• Dictionary ?

• PC spellchecker ?

Page 16: Top 5 pitfalls to avoid in English CEFR assessment

4. Stress factor

Page 17: Top 5 pitfalls to avoid in English CEFR assessment
Page 18: Top 5 pitfalls to avoid in English CEFR assessment

4. Stress factor

- Time

- Computer vs. pen&paper- Generation X vs Millenials

Page 19: Top 5 pitfalls to avoid in English CEFR assessment

5. Motivate

Page 20: Top 5 pitfalls to avoid in English CEFR assessment

Motivate

a) Feedback

During the test- preliminary score (How am I doing)

After the completion- analysis of mistakes (What should I improve)

Page 21: Top 5 pitfalls to avoid in English CEFR assessment

19 Topics

Adjectives/adv ArticlesPrepositionsComparatives ConjunctionsPronounsQuantifiersModal verbs

Infinitive/ing Past tensesPresent tenses Future tenses Conditionals Questions

Idioms VocabularyPhrasal verbs Reading Listening

Page 22: Top 5 pitfalls to avoid in English CEFR assessment

Slovakia

Adjectives/adv ArticlesPrepositionsComparatives ConjunctionsPronounsQuantifiersModal verbs

Infinitive/ing Past tensesPresent tenses Future tenses Conditionals Questions

Idioms VocabularyPhrasal verbs Reading Listening

Page 23: Top 5 pitfalls to avoid in English CEFR assessment

Slovakia

Adjectives/adv ArticlesPrepositionsComparatives ConjunctionsPronounsQuantifiersModal verbs

Infinitive/ing Past tensesPresent tenses Future tenses Conditionals Questions

Idioms VocabularyPhrasal verbs Reading Listening

Page 24: Top 5 pitfalls to avoid in English CEFR assessment

Slovakia

Adjectives/adv ArticlesPrepositionsComparatives ConjunctionsPronounsQuantifiersModal verbs

Infinitive/ing Past tensesPresent tenses Future tenses Conditionals Questions

Idioms VocabularyPhrasal verbs Reading Listening

Page 25: Top 5 pitfalls to avoid in English CEFR assessment

Slovakia

Adjectives/adv ArticlesPrepositionsComparatives ConjunctionsPronounsQuantifiersModal verbs

Infinitive/ing Past tensesPresent tenses Future tenses Conditionals Questions

Idioms VocabularyPhrasal verbs Reading Listening

Page 26: Top 5 pitfalls to avoid in English CEFR assessment

Vietnam

Adjectives/adv ArticlesPrepositionsComparatives ConjunctionsPronounsQuantifiersModal verbs

Infinitive/ing Past tensesPresent tenses Future tenses Conditionals Questions

Idioms VocabularyPhrasal verbs Reading Listening

Page 27: Top 5 pitfalls to avoid in English CEFR assessment

United Kingdom

Adjectives/adv ArticlesPrepositionsComparatives ConjunctionsPronounsQuantifiersModal verbs

Infinitive/ing Past tensesPresent tenses Future tenses Conditionals Questions

Idioms VocabularyPhrasal verbs Reading Listening

Page 28: Top 5 pitfalls to avoid in English CEFR assessment

5. Motivate

a) Feedback

b) Elements of gamification

Page 29: Top 5 pitfalls to avoid in English CEFR assessment

Gamification in assessment

Key elements of gamification (B-P-L):

1. Badges

2. Points

3. Leaderboards

Page 30: Top 5 pitfalls to avoid in English CEFR assessment

Badges

Page 31: Top 5 pitfalls to avoid in English CEFR assessment

Points

Page 32: Top 5 pitfalls to avoid in English CEFR assessment

Leaderboards ?

Page 33: Top 5 pitfalls to avoid in English CEFR assessment

1. Choose the right format2. Different test, same difficulty3. Progress between levels4. Avoid stress5. and motivate !

Top 5 pitfalls to avoidin CEF English progress assessment