adaptive testing for classification of learners and quiz ... · question bank: provide the facility...

30
Adaptive Testing For Classification Of Learners And Quiz Questions Using Clicker Anoop Dobhal IIT Bombay [email protected] June 22, 2014 Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 1 / 30

Upload: others

Post on 19-Mar-2020

12 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Adaptive Testing For Classification Of Learners AndQuiz Questions Using Clicker

Anoop Dobhal

IIT Bombay

[email protected]

June 22, 2014

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 1 / 30

Page 2: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Overview

1 Clicker OverviewClicker In UseWeb Based Clicker System for Aakash Tablet

2 MotivationAim and ObjectivesScope of the ProjectConstraints of the Project

3 Proposed SystemAlgorithm For Modifying The ParametersServer ModuleClient Module

4 Test Results

5 Limitations

6 Conclusion and Future Work

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 2 / 30

Page 3: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

What is Clicker

Clickers, known with many names like ARS (Audience Response System),CRS (Classroom Response System), SRS (Student Response System),PRS (Personal Response System), etc. .

Clickers are act as medium of communication between instructor andstudents

It can be any portable handheld device like smart phones, tablet,laptops or any hardware are given to all students in the class

The instructor can ask question or post quizzes during class

Students can respond using whatever device they own

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 3 / 30

Page 4: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Clicker In Use

Provide instructors, a new way of teaching and improvingmethodologies of learning

Students participation increased

Instructor gets a good hand on students understanding about asubject

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 4 / 30

Page 5: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Web Based Clicker System for Aakash Tablet

Admin: It provides facilities to admin for adding, editing, fetching anddeleting the information

Raise Hand: It provides the facility to ask questions or doubt

Polling: Used to conduct questionnaire

Question Bank: Provide the facility of adding and searching questionsfor conducting exams or quizzes

Create Quiz: This module provides the facility of creating quiz byfetching questions from Question Bank

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 5 / 30

Page 6: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Problem Statement

In a large or even small classroom, there is different kind of students.They have different scale of learning depend upon their nature and pastexperience. So dividing students into category of learning power is difficulttask for a instructor.

Idea

One solution to the problem is to provide System, which will recommendquestion to students according to their intelligence level.

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 6 / 30

Page 7: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Aim and Objectives

Focus on improving learning by understanding student capabilities likeIQ level, problem understading etc..

To Increase students participation in class

Develop an efficient and improved solution, which will projectquestions to users according to user intelligence

Develop a system, which will change questions difficulty level accrdingto users reponse

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 7 / 30

Page 8: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Scope of the Project

To provide better learning environment in classroom

To provide means to change current clicker system learningenvironment beyond only tabulating students responses and displayingresults

To provide users to give Reponses according to their intelligence level

To provide system to change questions difficulty level according tousers response

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 8 / 30

Page 9: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Constraints of the Project

Bandwidth management problem as numbers of user increases

What types of question formats will help student in greater extent?

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 9 / 30

Page 10: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Proposed System

Rasch model

Our system is based on Rasch model (is a psychometric model foranalyzing categorical data, such as answers to questions on a readingassessment or questionnaire responses.

Our Appraoch

Maintaining two variables Qj and Ui

Qj is question difficulty value

Ui is user intelligence value

The values of these variables will be change according to userresponses

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 10 / 30

Page 11: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Algorithm For Modifying The Parameters

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 11 / 30

Page 12: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Server Module

Login: Using LDAP userid and Password

Create Quiz: Provide the functionality of creating a new quiz

Add Question: Provides the functionality of adding question into thedatabase

Save Response: Provides the functionality of saving response at serverside

Database: Used for storing questions added by instructor

Web Interface: Dashboard used by instructor for login, addingquestions and creating quizzes

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 12 / 30

Page 13: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Server Interaction Diagram

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 13 / 30

Page 14: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Database Relation Diagram

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 14 / 30

Page 15: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Web Interface For Login

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 15 / 30

Page 16: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Web Interface For Create Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 16 / 30

Page 17: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Web Interface For Adding Question Into Database

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 17 / 30

Page 18: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Client Module

Java Wrapper is used to communicate to Server using apache http client.Each Operation is done using http post request. The operations are

1 Login

2 Next Question

3 Save Response

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 18 / 30

Page 19: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Flow Diagram Of Quiz Application

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 19 / 30

Page 20: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Initialisation Of Variables

1 user_level is set to 0.05

2 question_level is set to 0.95, whenever a question is selected forQuiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 20 / 30

Page 21: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Test Results When One User Attempt The Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 21 / 30

Page 22: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

question_level

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 22 / 30

Page 23: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Test Results When One User Attempt The Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 23 / 30

Page 24: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

question_level

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 24 / 30

Page 25: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Test Results When Five Users Attempt The Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 25 / 30

Page 26: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

question_level

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 26 / 30

Page 27: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Limitations

When an user attempt all questions correct, then intelligence valuereach at maximum value of 0.95

When an user attempt all questions incorrect, then intelligence valuefor that user will not decrease beyond 0.05

Fairness is not achieved that good

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 27 / 30

Page 28: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Conclusion

Our system provide recommendation system that can recommendquestion to students according to their intelligence or IQ level

At the end of the quiz, we are able to characterize questionsaccording to their difficulties and user according to their intelligence

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 28 / 30

Page 29: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

Future Work

Find the correlation between users intelligence, so that question canbe recommended based on correlation

Maintain the history of each user responses, so that question can berecommended based on that history

Provide some explanation of each answer to client/user, wheneverthey give their responses

Use other kinds of recommendation system or approaches that can beintegrated with current system

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 29 / 30

Page 30: Adaptive Testing For Classification Of Learners And Quiz ... · Question Bank: Provide the facility of adding and searching questions for conducting exams or quizzes Create Quiz:

The End

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 30 / 30