Proposed Framework for Gamifying Research ActivitiesShigeki Ohira Saya Sugiura Katashi Nagao

Information Technology Center, Nagoya University Graduate School of Information Science, Nagoya UniversityE-mail: ohira@nagoya-u.jp10/7/2015TEEM2015Technological Ecosystems for Enhancing Multiculturality (TEEM15)Track 4. Gamification Ecosystems

1

In the TEEM2014We proposed Gamified Discussion SystemAs future work, we raised the following tasks10/7/2015TEEM2015

Todays theme

IntroductionResearch activitiesSurvey, seminar, experiment, writing paper, etc.Steady worksSometimes going well and other times not so wellOften continue without immediate visible results

For students in research laboratoryDesirable to increase motivation naturallyBest way is to enjoy research itselfDifficult to maintain a high level of motivationUntil research is on track and everyday tasks become more interesting10/7/2015TEEM2015

Purpose and ApproachEstablish comprehensive gamification frameworkfor general research activities

Provide a research activity platformCarefully recording, organizing and visualizing activities by attaching reciprocal relationsOrganizing issues and tasks arising in discussionVisualizing results when issues & tasks transition to real actionsIntroduce a gamification framework for activitiesBreak down research into detailed activitiesHelp maintain the cycle of research activity

10/7/2015TEEM2015

Study AssumptionsGamification is not a panacea for motivation

What is important for primary research activitiesDiscussion within research groupSetting appropriate issues and tasks on students own

Focus on discussionClarify what must be done in everyday research activityOrganize issues and tasks based on opinions and advice10/7/2015TEEM2015

Gamification Framework for Research ActivityClassify various actions in research activityApply gamification to give appropriate feedback for each actionDefine gamification frameworkEight game design elements: Goals: Step-by-step goal settingVisualization: Show students changing status and progressRules: Enable users in research laboratory to evaluate one anotherDesign: Provide rewards for using systemSocial: Promote competition and cooperation among users Tutorial: Familiarize novices with how to use systemDifficulty adjustment: Adjust degree of difficulty and complexity of goalsPlay cycle: Perpetuate cycle from goal setting, to action, to accomplishment

Research Activities and ActionsClassify research activities into 11 main activitiesGaining expertise (22)Deciding research themes (4) Implementation (6) Deciding evaluation methods (3) Experimentation (9) Project meetings (8)Seminar presentation (8)Discussion (6)Conference participation (8)Conference presentation (18)Writing papers (8)Subdivide activities into about 500 actionsSimple and practicableStudents gain a range of experiencePrepare about 240 performance resultsAutomatically-measured with existing systems

Divide each main activity into several sub-activities (numbers in parentheses)

7

Research Activity Map: Activity Tree and Action-Result Graphs

Gaining expertiseConference presentationDecidingResearchthemesImplementationDecidingEvaluationmethodsExperimentationProject meetingsSeminar presentationDiscussionConference participationWriting papers

e.g.) Discussion (main activity)

Main activitySub-activities

ActionsResults[Discussion][Ask question at seminar]Actions: Ask questionsResults: Asked questions, Cumulative question number has topped times

Discussion

e.g.) ProgrammingActionsResultsImplementation

Main activitySub-activities

Programming

[Gaining expertise],[Implementation][Programming]Actions: Write server/client program, Write I/O process of DBResults: Committed times, Wrote lines of code, Cumulative total of code has topped lines, Gaining expertise(sub-activity of Gaining expertise and Implementation)

Research Activity Concierge (prototype)Three basic toolsResearch Activity Organizer/Visualizer/WatchdogRAOOrganizing issues and tasksbased onseminar content

RAVVisualizing researchactivity based on performance ofissues and tasks

RAWMonitoringinformation I/Ofrom RAO and RAVGive information feedback

Research Activity ConciergeRAOResearch Activity MapSetting actions

UsersRAVRAWExternal tools and systems(proprietary and commercial software)Research ActivitiesContentsserverSelectingstatementsOrganizing statements

Seminarcontents

Storing data

Changing statusand visualization

Notifying stats andrecommendationCollecting ofactivity logRunning actions

MutualevaluationUsers processSystem process

Checkprogress

11

RAO: Research Activity OrganizerStep 1) Select statements in Discussion BrowserStep 2) Organize statements using RAOCreate notes for various research activitiesRecord detailed information in memosQuote statements and linking to memosAttach status attribute and tags to created memosTask, In-progress, Completed

Discussion BrowserRAO

RAV: Research Activity VisualizerUse external tools and systemsQuantitatively handling results of putting issues and tasks into practiceProvide API/plug-inCollect outlines ofactions based onissues and tasksVisualize issues, tasks, and relationships to resultsfrom related activitiesProvide overall view of the state of each activityJump from currently in-progress issues and tasks to RAOs notes and memosRecommend next actions and guide users (unimplemented)

TDAnnotatorTDEditorEclipse, Visual Studio,VCS ToolsDiscussion Recorder/Browser Research Activity Visualizer

PaperWriting

SurveyExcel, Numerical Analysis& CAE Tools

PowerPoint,PresentationPractice

DevelopmentPresentationDiscussionExperiment&Analysis

RAW: Research Activity WatchdogSend notification to usersRun on PC, tablet, smartphone, smartwatchPresent issue and task progress and results of monitoring research activity statisticsRecommend actions to do nextGive gamification feedbackAwarding badges, evaluating activitiesEnable easy communicationwithin research group

10/7/2015TEEM2015

RAC MyPage

Use Case and Ongoing Data Collection

You should create API for paper writing.

[Note]Development tasks[Memo]Editor hookRAV

Run actionCreate script

Summarize work,describe memo, make self-assessment

RAWSend notificationEvaluate results of activityFeedback

Organize statementsCreate note/memoDiscussionUserOthers

Commit to server Seminar content Notes, memos Source code Logs- Action - Evaluation- UI operation

Select actionWrite server program

Check stats/badges,use items

Check progressand feedbackRAORAO

You should create API for paper writing.On RAO, create note Future necessary development and memo editor hookOn RAV, select action Write server programRun action. Create script for editor hook and commit to server.On RAO, summarize work, describe memo, and make self-assessment.RAW send notification to other person.Other person evaluate results of activity.On RAV, check progress and evaluation.On RAC mypage, check stats and badges, and use items.15

Summary and Future WorkSummaryIntroduction of comprehensive gamification framework for general research activityDevelopment of prototype system Research Activity Concierge

Future taskVerify effectiveness of proposed gamification framework through practical useCompare the amount of activity with/without system useVerify the cost and effectiveness of mutual evaluation Now under test operation. Plan to start operation in Oct. 2015 (2nd semester beginning in Japan)10/7/2015TEEM2015

Obrigado pela sua atenoTHANK YOU FOR YOUR ATTENTION

17

Preliminary Slides Slides

10/7/2015TEEM2015

Evaluation of Action as Goal SettingThree typesSelf-assessmentFive pointsSweet tendencyMutual evaluationNot required (in good faith)Quantitatively and QualitativelyAutomatic evaluationUsing external tools and systems Quantitatively

10/7/2015TEEM2014

DRIP CycleA cycle of four phases representing knowledge activities focused on discussion10/7/2015TEEM2015

InvestigationRecording new knowledgebased on past discussion

PreparationCreating of presentationmaterials using records

ReflectionArranging ofdiscussion content

DiscussionCreating of reusablediscussion content

20