adaptive testing for classification of learners and quiz ... · question bank: provide the facility...

Adaptive Testing For Classification Of Learners AndQuiz Questions Using Clicker

Anoop Dobhal

IIT Bombay

anoop.dcrust@gmail.com

June 22, 2014

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 1 / 30

Overview

1 Clicker OverviewClicker In UseWeb Based Clicker System for Aakash Tablet

2 MotivationAim and ObjectivesScope of the ProjectConstraints of the Project

3 Proposed SystemAlgorithm For Modifying The ParametersServer ModuleClient Module

4 Test Results

5 Limitations

6 Conclusion and Future Work

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 2 / 30

What is Clicker

Clickers, known with many names like ARS (Audience Response System),CRS (Classroom Response System), SRS (Student Response System),PRS (Personal Response System), etc. .

Clickers are act as medium of communication between instructor andstudents

It can be any portable handheld device like smart phones, tablet,laptops or any hardware are given to all students in the class

The instructor can ask question or post quizzes during class

Students can respond using whatever device they own

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 3 / 30

Clicker In Use

Provide instructors, a new way of teaching and improvingmethodologies of learning

Students participation increased

Instructor gets a good hand on students understanding about asubject

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 4 / 30

Web Based Clicker System for Aakash Tablet

Admin: It provides facilities to admin for adding, editing, fetching anddeleting the information

Raise Hand: It provides the facility to ask questions or doubt

Polling: Used to conduct questionnaire

Question Bank: Provide the facility of adding and searching questionsfor conducting exams or quizzes

Create Quiz: This module provides the facility of creating quiz byfetching questions from Question Bank

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 5 / 30

Problem Statement

In a large or even small classroom, there is different kind of students.They have different scale of learning depend upon their nature and pastexperience. So dividing students into category of learning power is difficulttask for a instructor.

Idea

One solution to the problem is to provide System, which will recommendquestion to students according to their intelligence level.

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 6 / 30

Aim and Objectives

Focus on improving learning by understanding student capabilities likeIQ level, problem understading etc..

To Increase students participation in class

Develop an efficient and improved solution, which will projectquestions to users according to user intelligence

Develop a system, which will change questions difficulty level accrdingto users reponse

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 7 / 30

Scope of the Project

To provide better learning environment in classroom

To provide means to change current clicker system learningenvironment beyond only tabulating students responses and displayingresults

To provide users to give Reponses according to their intelligence level

To provide system to change questions difficulty level according tousers response

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 8 / 30

Constraints of the Project

Bandwidth management problem as numbers of user increases

What types of question formats will help student in greater extent?

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 9 / 30

Proposed System

Rasch model

Our system is based on Rasch model (is a psychometric model foranalyzing categorical data, such as answers to questions on a readingassessment or questionnaire responses.

Our Appraoch

Maintaining two variables Qj and Ui

Qj is question difficulty value

Ui is user intelligence value

The values of these variables will be change according to userresponses

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 10 / 30

Algorithm For Modifying The Parameters

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 11 / 30

Server Module

Login: Using LDAP userid and Password

Create Quiz: Provide the functionality of creating a new quiz

Add Question: Provides the functionality of adding question into thedatabase

Save Response: Provides the functionality of saving response at serverside

Database: Used for storing questions added by instructor

Web Interface: Dashboard used by instructor for login, addingquestions and creating quizzes

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 12 / 30

Server Interaction Diagram

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 13 / 30

Database Relation Diagram

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 14 / 30

Web Interface For Login

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 15 / 30

Web Interface For Create Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 16 / 30

Web Interface For Adding Question Into Database

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 17 / 30

Client Module

Java Wrapper is used to communicate to Server using apache http client.Each Operation is done using http post request. The operations are

1 Login

2 Next Question

3 Save Response

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 18 / 30

Flow Diagram Of Quiz Application

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 19 / 30

Initialisation Of Variables

1 user_level is set to 0.05

2 question_level is set to 0.95, whenever a question is selected forQuiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 20 / 30

Test Results When One User Attempt The Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 21 / 30

question_level

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 22 / 30

Test Results When One User Attempt The Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 23 / 30

question_level

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 24 / 30

Test Results When Five Users Attempt The Quiz

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 25 / 30

question_level

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 26 / 30

Limitations

When an user attempt all questions correct, then intelligence valuereach at maximum value of 0.95

When an user attempt all questions incorrect, then intelligence valuefor that user will not decrease beyond 0.05

Fairness is not achieved that good

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 27 / 30

Conclusion

Our system provide recommendation system that can recommendquestion to students according to their intelligence or IQ level

At the end of the quiz, we are able to characterize questionsaccording to their difficulties and user according to their intelligence

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 28 / 30

Future Work

Find the correlation between users intelligence, so that question canbe recommended based on correlation

Maintain the history of each user responses, so that question can berecommended based on that history

Provide some explanation of each answer to client/user, wheneverthey give their responses

Use other kinds of recommendation system or approaches that can beintegrated with current system

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 29 / 30

The End

Anoop Dobhal (IIT Bombay) Quiz Application June 22, 2014 30 / 30