1

Mobility for All: Mobility for All: architecture and technology demo

• approach

• architecture

• technology demo

• future work

Jim SullivanCo-Director, Cognitive Levers Project

Center for LifeLong Learning and Designjames.sullivan@colorado.edu

Alexander RepenningCEO and PresidentAgentSheets, Inc.

alexander@agentsheets.com

2

Old approach: “fit the user into the system”Old approach: “fit the user into the system”

“Here is your map ….

You live here …

Your destination is here …

Your bus will have this label…

When you see this landmark, remember to pull the cable on the bus so the driver knows you will get off at the next stop.

This is where you will get off…

Don’t forget your backpack!

OK, now let’s talk about the schedule …. do you know how to read a clock? … “

3

New approach: design a system to “fit the userNew approach: design a system to “fit the user””

other things I can do

things I have to remembermy bus

my drawing of my house

my mom works here

4

Mobile architectureMobile architecture

mobility agents

data servers

internet backbone

mobile users support communities

transportation systems

wireless networks

mobile internet

5

constructive

Technology demonstration componentsTechnology demonstration components

real

virtual

GPSvehicle

locations

distance toperson/stop

agent mediatedattention & memory

prompts

6

““Constructive” solution for mobile usersConstructive” solution for mobile usersProof-of-concept of a location-aware, mobile device that:

• gives personalized, logical choices (based on location, time of day and week, abilities, etc.)

• provides multi-modal information and feedback in response to user choices and actions.

• communicates with a “virtual” transportation system (and potentially other sources of information) to:

locate the “right bus” prepare for boarding get on the “right bus” prepare to get off at the “right” location reward good performance provide “cognitive post-its” to remember items

easily forgotten in a complex itinerary

7

Virtual 3D/real-time displayVirtual 3D/real-time displayFor caregivers:

Supports preparation and training:• to better visualize/understand/interact with a complex and dynamic

system

• to design see how personalized user prompts (prompting content & sequence, preparation time, prompting frequency, etc.) will interact with real-time vehicles.

Support real-time monitoring and assessment:• use a 3D real-time display to make “confederate observations” of

MULTIPLE users

• determine real-time errors, and offer contextualized, real-time help

• review performance errors, and create training/intervention strategies

8

Simulated person

Real-time tracked busses

Speech recognition

9

Research hypothesesResearch hypotheses• independence: mobile architecture will afford an ability to

learn more routes, leading to increased independence.

• learning: instantiates an “errorless learning” strategy; supports learning and using “individually relevant” routes.

• efficiencies: less time to learn a route; more time to learn different routes; allows overworked therapists to identify and focus on users with greatest needs.

• personalization: memory and attention prompts can be contextualized and dynamically tailored to suit user needs.

• safety: dynamic error detection and recovery strategies can incorporate both automated and human intervention.

• assessment: can collect real-time data for development, user training and personalization, while avoiding abandonment.

• scale: can be used in other transportation systems with bus GPS infrastructure technologies (see nextbus.com).

many potential “space program” applications!

10

Mobility for All - future workMobility for All - future work• architecture integration (goal: seamless “look and

feel” for user communities)

• error detection and recovery (“panic button”)

• caregiver feedback (identify training and technology needs, script creation and modification)

• personalization technologies (customizable by caregivers; adaptable to users; engaging to use; supportive of learning and growth)

• test and evaluation on a mobile, wireless platform

11

Cognitive Levers ProjectCognitive Levers Projectsponsored by the Coleman Institutesponsored by the Coleman Institute