assessment in active learning - didactical and technological issues

Assessment in active learning - didactical and technological issues

Daniela Tuparova, Georgi Tuparov, SOUTH-WEST UNIVERSITY“NEOFIT RILSKI”ALICT Project, Kranjska Gora, Slovenia, 31.07.2014

• Assessment – basic didactical characteristics

• 6W about educational assessment in active learning

• The “Rainbow” of assessment activities

• Place of assessment activities into classroom

• Performance based assessment of ICT skills – examples from contests in Bulgaria

Agenda

Assessment – basic characteristics • Activities such as assessment and evaluation

of student’s achievements are basic one in any educational process.

• Assessment has ‘’driving’’ role and takes an important place during the development of any educational process.

Assessment – basic characteristics• Learning goals, objectives (LOs) and

assessment– describe the level of knowledge, skills, competences

and other characteristics that any learner should achieve in the process of learning;

`Would you tell me, please, which way I ought to go from here?' `That depends a good deal on where you want to get to,' said the Cat. `I don't much care where--' said Alice. `Then it doesn't matter which way you go,' said the Cat.

Lewis Carroll, “Alice in Wonderland”

LO

LO

LO

LO

LO

LO

LO

LO

Assessment activities



Assessment activities in educational process (EP)

Case of non

achievement

of LO’s

Case of non

achievement

of LO’s

Case of non

achievement

of LO’sSetup of Learning Objectives (LO’s)Start of EP

6W about educational assessment in active learning

Who assesses?

Who will be assessed?

When do we assess?

What do we assess?

What kind of methods do we use?

What kind of ICT tools do we use?

Who assesses?

Teacher

Students

Automated assessment

Basic questions – 6W

Who assesses?

Teacher

Students



Self assessment

Peer assessment

Who assesses?

Teacher

Students



Self assessment

Peer assessment

Self assessment

Evaluation and grading


Who will be assessed?

Individual student

Group of students

Whole class

Whole population of students in the country


When do we assess?

Initial assessment

Diagnostics in the beginning of education unit – lesson,

chapter, school year


When do we assess?

Initial assessment

Formative assessment



During the educational process, obtaining feedback by the

teachers


When do we assess?Initial assessment


Summative assessment




teachers

At the end of school year, final exam, standardized tests,

sertification


When do we assess?Initial assessment


Summative assessment




teachers

At the end of school year, final exam, standardized tests,

sertification

When the cook tastes the soup, that's formative. When the guests taste the soup, that's summative.

/Scriven, M. (1991). Evaluation thesaurus. 4th ed. Newbury Park, CA: Sage Publications. ISBN 0-8039-4364-4./

http://en.wikipedia.org/wiki/Sage_Publications

http://en.wikipedia.org/wiki/Sage_Publications

http://en.wikipedia.org/wiki/Special:BookSources/0803943644


What do we assess?

Knowledge

Skills

Competences

Level’s of students’

achievements of learning objectives


What kind of methods and tools do we use?Test/Quiz

Game based

Discussion

Problem Solving

Individual/Group Project

Portfolio

Performance based assessment

Observation

Rubrics, Check lists, Rating Scales



Game based

Discussion

Problem Solving


Portfolio


Observation


Criterion referenced vs. Normative

referencedAchievement Tests

Objective testsEtc.



Game based

Discussion

Problem Solving


Portfolio


Observation




Objective testsEtc.

Story based gamesMemory gamesAttention games

Role played gamesPuzzles

CrosswordsQuiz based games

Etc.



Game based

Discussion

Problem Solving


Portfolio


Observation




Objective testsEtc.

Story based gamesMemory gamesAttention games

Role played gamesPuzzles

CrosswordsQuiz based games

Etc.

“Represents a set of strategies for the

acquisition and application of knowledge, skills, and work habits through the

performance of tasks that are meaningful and

engaging to students. (K. M Hibbard at all, Teacher's Guide to Performance-Based

Learning and Assessment, http://www.ascd.org/

Use of Observation, Rubrics, Check lists, Rating Scales Is a part from methods as Performance assessment, Problem solving, Projects,

Portfolio


What kind of ICT tools do we use ?

Computer based tests/quizzes

Computer based simulations

Computer Games

Performance assessment (CS and ICT)

Assignments in e-learning environments

Discussion forums

Wiki

Blog

Digital Story Telling

Rubrics, Surveys





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys

Authoring software for quiz

creation – HotPot, iSpring





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys


creation – HotPot, iSpringGame Engines –

eAdventure, Unity3D





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys


creation – HotPot, iSpringGame Engines –

eAdventure, Unity3D

Programming Languages





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys



Google Drive - Forms,

Spreadsheets

Game Engines – eAdventure,

Unity3DProgramming

Languages





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys



Authoring tools for multimedia

processing - Flash, Captivate,


Spreadsheets


Unity3DProgramming

Languages





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys






Spreadsheets


Unity3DProgramming

Languages

Video processing





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys






Spreadsheets

Online/ offline tools for creation of

Memory Games, Crosswords, Puzzles


Unity3DProgramming

Languages

Video processing





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys






Spreadsheets



MS Office – Word, Excel, PowerPoint


Unity3DProgramming

Languages

Video processing





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys






Spreadsheets





Unity3D


with Visual basic for Application code


Video processing





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys





E-Learning environments –

Moodle, Claroline, ILIAS, Docebo


Spreadsheets





Unity3D




Video processing Web 2.0 tools





Computer Games



Discussion forums

Wiki

Blog


Rubrics, Surveys





E-Learning environments –

Moodle, Claroline, ILIAS, Docebo


Spreadsheets





Unity3D




Video processing

3226.09.2008

The “Rainbow” of assessment activities in active learning


Collaborative assessment activities

Individual assessment activitiesServices

Discussion Forum

Live Audio Conference

File exchange

e-mail/List server

Chat

Live Video Conference

Blog

Wiki

e-note

e-journal

whiteboard

Workshop/collaborative assignment

Testing module/system

Simulation

Real-live application assessment tools

Group ware system

e-portfolio module or system

Test/Quiz

Individual assignment (problem solving, project etc., performance)

Individual Portfolio

Discussion

Collaborative assignment (problem solving, project etc.)

Collaborative Portfolio

Place of ICT based assessment into classroom • In the beginning of the lesson

– Used type of tools• Short quiz• Crosswords• Puzzles• Memory Cards• ….

– Purpose• Motivation• Feedback• Setup the topic of the lesson

Place of ICT based assessment into classroom • Formative assessment

– Used type of tools• Short quiz• Crosswords• Puzzles• Performance based assessment• Problem solving• Story Telling• …..

– Purpose• Feedback

Performance based assessment in ICT – an examples

• Contests in ICT• Tasks have to be performed onsite

– Blagoevgrad, National Contest, http://www.sastezanie.7sou-blagoevgrad.com

http://www.sastezanie.7sou-blagoevgrad.com/

http://www.sastezanie.7sou-blagoevgrad.com/

Performance based assessment in ICT• Contests in ICT – National Contest Blagoevgrad

- Organisation– Tasks have to be performed onsite;– Students work in categories:

• Multimedia Clip;• Multimedia Prezentation;• Group Project for 5-7 grade ;

– Selection of Top 10 and presentations of projects in front of Jury and other participants

– Evaluation is based on final artefacts and project defense


– Task for Group Project for 5-7 grade ;– Students obtain resource files that consist images,

audio files, text documents, spreadsheets data.– The task is to prepare for 3 hours with given

resources small project the topic set by the jury. (2013 – Trip on Danube river, 2014 – Trip in Bulgaria).


– Task for Group Project for 5-7 grade ;– The task consists of 6 elements:

• To process data in spreadsheet file;• To create presentation with use of processed spreadsheet

data, given resource material or developed own artefacts during the contest.

• Prepare short document in MS Word with description of project activities and used tools

• Prepare short presentation for performance of project in front of jury and other teams

• Save all artefacts in proper way on DVD or CD• Perform project

Performance based assessment in ICT• Contests in ICT

• Tasks have to be performed onsite– “I can here and now”, Devin

http://contest.az-moga.bg/reglament




– Tasks have to be performed onsite• “I can here and now”, Devin

http://contest.az-moga.bg/reglament • Tasks – In different categories - presentations, video clip,

web site redesign, photography, programing - students have to perform task with givenresource materials or create own graphical elements.

• Task for presentations is to createtwo minutes advertisement. Evaluationis based on the technical graphicaland communication characteristics of the created artefacts.




– Projects developed for a 3-5 months and presented on the contest

• National Olympiad – Project+ test with questions mainly at highest levels of Bloom’s

Taxonomy - http://edusoft.fmi.uni-sofia.bg/reglament

http://edusoft.fmi.uni-sofia.bg/reglament




– National contests – Sofia, Blagoevgrad etc.– Regional contests – Blagoevgrad

• Primary schoolhttp://8sou-blg.com/sastezanie/arhiv.html

• Secondary Schools:– http://www.sastezanie.petosoubl.com/ – http://www.sastezanie-sandanski.com/

http://8sou-blg.com/sastezanie/arhiv.html



http://www.sastezanie.petosoubl.com/

http://www.sastezanie.petosoubl.com/

http://www.sastezanie-sandanski.com/

http://www.sastezanie-sandanski.com/


– National contests – Blagoevgrad• Pupils develop and present ICT project in categories

similar to National Olympiad• Topics of the projects are under specific topics and

motto:– Computers in the classrooms – all categories– The school of the 21 age – all categories– Bulgaria known and unknown – web design– Computer networks– Multilanguage Europe– The Art and my World– The greatest events in the world– ……

Performance based assessment in ICT – Primary School, Blagoevgrad

• Started in 2009, http://8sou-blg.com/sastezanie/arhiv.html – The idea was extended and implemented by national competition “IT

znajko”, – Pupils develop pictures, word processing documents integrated with

drawings, multimedia presentations– Play in different non-computer games– Working time is 1 hour– Topics

• Bulgarian traditions and celebrations• In the world of the tales• Novels for kids• Fables

– Tasks integrate knowledge from ICT, Bulgarian Language and literature, Fine Arts


Regional Contest – Blagoevgrad, Artifacts (1)

• 1 grade, MS Paint

• 1 grade, MS PaintRegional Contest – Blagoevgrad, Artifacts (2)

• 3 grade, MS Word• Task – Student has to open

file with name of selected tale, correct grammatical errors in the text, format text and draw the picture relevant to the text.


• 3 grade, MS Word Regional Contest – Blagoevgrad,

Artifacts (10)

• 3 grade, MS WordRegional Contest – Blagoevgrad, Artifacts (11)

• 4 grade, MS Power Point

• Task – Students have to develop presentation for selected tale. They can use images installed on the computer, comment their opinion about story heroes, make animations and own images, relevant to the story.


• 4 grade, MS Power PointRegional Contest – Blagoevgrad, Artifacts (13)

Regional Contest – Blagoevgrad 2010 - • Criteria for assessment:

– Composition;– Creativity– Difficulties and complexity (number of graphical

objects)– Expression of own opinion about lessons learned

by the story (4th grades)– Errors corrections (3rd and 4th grades)

Thank you for attention!

• Contacts:– ddureva(at)swu.bg– georgett(at)swu.bg

assessment in active learning - didactical and technological issues

Education

performance assessment

educational assessment

initial assessment diagnostics

performancebased learning

process of learning

use of observation

kind of methods

check lists