Brian M. SlatorBrian M. Slator11, Donald P. Schwert, Donald P. Schwert22, and , and Bernhardt Saini-EidukatBernhardt Saini-Eidukat22 11Computer Science,Computer Science, 2 2GeosciencesGeosciences

North Dakota State UniversityNorth Dakota State University

The Geology ExplorerThe Geology Explorer

Educational Role-playing GamesEducational Role-playing Games

“Learning-by-doing” Experiences“Learning-by-doing” Experiences

• Multi-UserMulti-User

• ExploratoryExploratory

• Spatially-oriented virtual worldsSpatially-oriented virtual worlds

• Practical planning and decision makingPractical planning and decision making

Educational Role-playing GamesEducational Role-playing Games

“Learning-by-doing” Experiences“Learning-by-doing” Experiences• Authentic problem solvingAuthentic problem solving

• ““Hands on” scientific methodHands on” scientific method

• Real-world contentReal-world content

• Promoting mature thinkingPromoting mature thinking

Advantages of Virtual WorldsAdvantages of Virtual Worlds

• Collapse virtual time and distanceCollapse virtual time and distance• Allow physical or practical Allow physical or practical

impossibilitiesimpossibilities

• Participate from anywhereParticipate from anywhere• Interact with other users, virtual Interact with other users, virtual

artifacts, and software agentsartifacts, and software agents• Multi-user collaborations and Multi-user collaborations and

competitive playcompetitive play

Technical ApproachesTechnical Approaches

• Networked, internet-based,Networked, internet-based, client-server environment client-server environment

• Multi-Player (MUD, MOO)Multi-Player (MUD, MOO)

• Simulation-basedSimulation-based

• Implemented in Java appletsImplemented in Java applets

The Virtual World of Planet OitThe Virtual World of Planet Oit

• Planet Oit: Recently discoveredPlanet Oit: Recently discovered

• Authentic geologic contextAuthentic geologic context

• Similar to Earth, same orbitSimilar to Earth, same orbit

• Opposite the SunOpposite the Sun

• Student undertakes same decision-making processes as a “real” geologist

• Can be implemented for all levels, including Grade 7 through college

• First version: basic planetary exploration for minerals and rocks

The Planet Oit GameThe Planet Oit Game

• You are a geologistYou are a geologist

• Explore this new planet!Explore this new planet!

• Encounter authentic geologyEncounter authentic geology

Assess geologic resources & processesAssess geologic resources & processes

This motivates student to learn This motivates student to learn

geologic contentgeologic content

Planet OitPlanet Oit

• 50 Places50 Places

• 90 Different Rocks 90 Different Rocks and Mineralsand Minerals

• 15 Field Instruments15 Field Instruments

• 25 Laboratory 25 Laboratory InstrumentsInstruments

• Software TutorsSoftware Tutors

Text-Based Interface

Text-Based Interface

Resources: User Card

Resources: Equipment

Item Price | Item PriceAcid Bottle (#597) $ 1.00 | Lantern (#973) $ 25.00Altimeter (#675) $ 100.00 | Light Meter (#556) $ 25.00Anemometer (#568) $ 30.00 | Magnet (#580) $ 1.00Barometer (#410) $ 50.00 | Microscope (#612) $ 25.00Black Light (#625) $ 30.00 | Rock Pick/Hammer (#370) $ 40.00Compass (#561) $ 200.00 | Sextant (#554) $ 100.00Flowmeter (#598) $ 100.00 | Sonar (#593) $ 200.00Geiger Counter (#751) $ 178.00 | Spirit Level (#335) $ 5.00Glass Plate (#583) $ 0.50 | Streak Plate (#542) $ 0.50Goniometer (#613) $ 1.00 | Tape Measure (#626) $ 10.00Gravimeter (#708) $10000.00 | Thermometer (#223) $ 5.00Hand Lens (#2178) $ 15.00 | Transit (#364) $ 100.00Jack Hammer (#368) $ 300.00 | Water Level Gage (#615) $ 5.00

Resources: The Museum

The Mineral CollectionThe Mineral Room houses the Mineral Collection. A sign on the wall says "Feel free to look around, but please do not remove the samples".Obvious exits are: WestYou see Diaspore (#333), Hornblende (#363), Chromite (#381), Gibbsite (#457), Native Silver (#251), Biotite Mica (#246), Sphalerite (#560), Chalcopyrite (#563), Boehmite (#565), Garnet (#355), Anhydrite (#582), Ilmenite (#584), Nepheline (#596), Muscovite Mica (#611), Magnetite (#627), Wollastonite (#635), Dolomite (#640), Pyroxene (#650), Native Copper (#673), Serpentine (#226), Potassic Feldspar (#324), Talc (#325), Plagioclase Feldspar (#360), Fluorite (#509), Clay (#262), Galena (#138), Pyrite (#336), Tourmaline (#530), Graphite (#571), Halite (#373), Gypsum (#552), Calcite (#463), Hematite (#608), Olivine (#617), Native Gold (#657), Quartz (#674), Rhodonite (#653), Diamond (#812), Purple Quartz (#1864), White Gypsum (#1865), Ice (#2055), Chlorite (#2056), Corundum (#3044), Topaz (#3043), Orthoclase Feldspar (#3042), Apatite (#3041), and Native Sulfur (#1159) here.

Resources: Help

Fluorite (mineral) Fluorite is a common and widely distributed mineral often found in hydrothermal veins or in association with lead and silver ores. form: usually cubic or octahedral color: blue or purple texture: smooth streak: white luster: vitreous transparency: transparent to translucent hardness: 4.0 Acid reaction: not reactive

help fluorite

Resources: Tutor

You can't streak without a streak plate.

eastA clap of thunder splits the air, and a tutor appears in your midst.TUTOR: You just left White and Black Dike containing your goal: Potassic FeldsparThe TUTOR bends at the waist and disappears in a puff of smoke.

streak #1992 with glass plate

Doing Science: A Transcript of the Text-based Interface

1. Student is Assigned a Goal

You have a general goal: to 'report' all the rocks and minerals you find. You also have a specific goal: to 'report' the identity of Fluorite

Fluorite is a purple vitreous smooth-faced mineral.Fluorite is used to make flux.To see this message again, type '@showgoal' or 'showgoal'

You are standing by a large cave entrance cut into a sheer rock face.* To the South is a Deep Valley* To the Southwest are the Young Mountains* To the West is a Steep Ledge* To the Northwest is a Steep Cliff* 'Enter' will get you into the Cave.Obvious exits are: enter South Southwest West NorthwestYou see light grey compact fine-grained outcrop (#1945), purple vitreous smooth-faced vein (#1989), and yellowish brown resinous vein (#1998) here.

Doing Science: A Transcript of the Text-based Interface

2. Student Navigates

Swoosh...the Rock Pick/Hammer (#2062) arcs towards the purple vitreous smooth-faced vein (#1989)A purple vitreous smooth-faced sample (#5969) appears in your inventory

hit #1989 with rock pick

pour acid on #5969

You hear the sound of pouring and ....Nothing happens

Doing Science: A Transcript of the Text-based Interface

3. Student Performs Experiments

taste #5969

As the magnet approaches the purple vitreous smooth-faced sample (#5969)...Nothing happens.

touch #5969 with magnet

You put your tongue onto purple vitreous smooth-faced sample (#5969) and detect no taste

Doing Science: A Transcript of the Text-based Interface

4. Student Continues Experiments

You scratch Glass Plate (#2064) with purple vitreous smooth-faced sample (#5969) ...Glass Plate (#2064) scratches purple vitreous smooth-faced sample (#5969)

scratch glass with #5969

Doing Science: A Transcript of the Text-based Interface

5. Student Continues Experiments

Checking: purple vitreous smooth-faced sample (#5969) against fluorite.You are right! purple vitreous smooth-faced sample (#5969) IS fluorite.You have satisfied your primary goal! You score 100 points.

report #5969 as fluorite

Doing Science: A Transcript of the Text-based Interface

6. Student Achieves Goal

Assigning new goal for session: 11/30/99 at 1:13 p.m.

As a player in the Geology Explorer You have accomplished your third goal and are playing at the advanced level. You have a general goal: to 'report' all the rocks and minerals you find. You also have a specific goal: to 'report' the identity of Potassic Feldspar Potassic Feldspar is a mineral.

Doing Science: A Transcript of the Text-based Interface

7. Student is Assigned New Goal

Maps of Planet OitMaps of Planet Oit(from text to graphics)(from text to graphics)

The Geology ExplorerThe Geology Explorer(Graphical Prototype)(Graphical Prototype)

Virtual Field InstrumentsVirtual Field Instruments

The Geology ExplorerThe Geology Explorer(Navigating on Planet Oit)(Navigating on Planet Oit)

Intelligent TutoringIntelligent Tutoring

Geology Explorer:Geology Explorer:

• The simulation can track actionsThe simulation can track actions

• The simulation can generate warnings and The simulation can generate warnings and explanationsexplanations

• Tutor “visits” are triggered by user actionTutor “visits” are triggered by user action

Tutors are NeededTutors are Needed

In Virtual Environments:In Virtual Environments:

• Students can join from any remote location Students can join from any remote location

• They can log in at any time of day or nightThey can log in at any time of day or night

• Human tutors cannot be available at all Human tutors cannot be available at all times to helptimes to help

• Students can make mistakes and not know Students can make mistakes and not know whywhy

Tutors are NeededTutors are Needed

In Virtual Environments:In Virtual Environments:

• Student interacts with the intelligent Student interacts with the intelligent tutoring agenttutoring agent

• Students can ignore advice and carry on at Students can ignore advice and carry on at their own risktheir own risk

Software Tutoring AgentsSoftware Tutoring Agents

Software Tutoring AgentsSoftware Tutoring Agents

• Deductive TutoringDeductive Tutoring: : Provides Provides assistance with deductive reasoning assistance with deductive reasoning needed to solve a scientific problemneeded to solve a scientific problem

• Case-based TutoringCase-based Tutoring: : Presents Presents examples of relevant experience examples of relevant experience

(case studies)(case studies)

• Rule-based TutoringRule-based Tutoring: : Provides Provides assistance when student actions assistance when student actions

break encoded rules for the domainbreak encoded rules for the domain

Authentic AssessmentAuthentic Assessment

• Assessment in authentic contextsAssessment in authentic contexts

• Recall of strategies and conceptsRecall of strategies and concepts

• Not “multiple choice” recognitionNot “multiple choice” recognition

• Content specific: GeologyContent specific: Geology

• Problem solving, hypothesis formation, Problem solving, hypothesis formation,

deductive reasoningdeductive reasoning

Authentic tasks requireAuthentic tasks requireauthentic assessmentauthentic assessment

To understand science is to: To understand science is to: • understand the activities of scientistsunderstand the activities of scientists

• understand the tools of scientistsunderstand the tools of scientists

ScenariosScenarios

• Student presents subjectiveStudent presents subjective response to a scenarioresponse to a scenario

• Scenario is a story, in whichScenario is a story, in which a geologic problem is presenteda geologic problem is presented

• Student is encouraged to present Student is encouraged to present a solutiona solution

Example of a ScenarioExample of a Scenario

You are in northern Manitoba on a fishing trip. Fishing has been good. At dawn on the day of your departure, you cut across country to a remote bay and have more good luck: you catch your limit of walleye.

On the way back to the lodge, you stumble across a heavy, moss-covered rock on the shoreline, flipping it over. Looking down, you see the underside of the rock shining with a brilliant metallic yellow. You pick up the rock and lug it back to the lodge.

At the airport luggage check-in, the baggage agent notes that you are 20 kg overweight . . . . . . exactly the weight of the rock that you found. He says, “It’s okay to ship rocks back to the States, eh, but at $15 per kilogram, you’re going to owe $300!”

As a geologist, what do you do? Please respond to the following:

Scenario QuestionsScenario Questions

List the questions that you would ask yourself, and give reasons behind asking those particular questions:

List the factors that you would consider in making your final decision:

Procedures for Assessment Procedures for Assessment by Scenarioby Scenario

• Assess computer literacyAssess computer literacy• Pre-Test: Present scenario, students Pre-Test: Present scenario, students

propose course of action or propose course of action or solutionsolution• Engage students in learning experienceEngage students in learning experience

(Control and experimental groups) (Control and experimental groups) • Post-Test: Present similar scenario, Post-Test: Present similar scenario,

student responsestudent response

• Analyze assessment dataAnalyze assessment data

The Geology Explorer:The Geology Explorer:Assessment Protocol, Fall, 1998Assessment Protocol, Fall, 1998

Pre-course Assessment:Pre-course Assessment:400+ students400+ students

Computer Literacy Assessment:Computer Literacy Assessment:(244 volunteers)(244 volunteers)

Divide by Computer Literacy Divide by Computer Literacy and Geology Lab Experienceand Geology Lab Experience

Geomagnetic Geomagnetic (Alternative) Group:(Alternative) Group:

(122 students)(122 students)

Geology Explorer Geology Explorer Treatment Group:Treatment Group:

(122 students)(122 students)

Non-Participant Control Non-Participant Control Group:Group:

(150 students, approx.)(150 students, approx.)

CompletedCompleted(78 students)(78 students)

Non-Non-completedcompleted(44 students)(44 students)

CompletedCompleted(95 students)(95 students)

Non-Non-completedcompleted(27 students)(27 students)

Post-course Assessment:Post-course Assessment:368 students368 students

Scenario EvaluationScenario Evaluation

• Scenarios evaluated by a trained Scenarios evaluated by a trained individualindividual

• Scenario judging is then replicated Scenario judging is then replicated for reliability using a second, trained for reliability using a second, trained individualindividual

• Additional validation can beAdditional validation can be accomplished within standard testingaccomplished within standard testing

Fall, 1998, Test Results:Fall, 1998, Test Results:

Results of a Duncan test showedResults of a Duncan test showedthat the Geology Explorer group that the Geology Explorer group was significantly different . . . was significantly different . . . with the nature of the signifi-with the nature of the signifi-cance being a higher averagecance being a higher averagescore for the Geology Explorerscore for the Geology Explorergroup.group.

95% Confidence Intervals for Mean Scores on Post Experience

Scenario Assessments

Group No. Mean score 95% CIAlternate 104 17.0 4.8Control 157 19.4 5.0Planet Oit 65 31.8 4.9

Alternate Exercise Group

Control Group

Planet Oit Group

10 15 20 25 30 35 40

mean score

To “Visit” Planet Oit:

oit.cs.ndsu.nodak.edu