Project BARN

Project BARN

Technical Presentation

What’s on the menu- Software Architecture

- Messyboard application- Web program- Database details

- Hardware Details- Mimio- Dashboard- Audio system- Social Geometry- Interactive Devices

- Rollout Numbers- Lessons Learned and Closing Thoughts

Project BARN

Project BARN

Brain

TS App

Desktop

keyboard

devices

muteTWI

Audiologging

Socialgeo

microphonecellphone

iPen/mimeoMouse

captureapp

clock

Databasesign-in &

reservation

WebPage

Interface

desktop display

TS app

file UL/DL

social geo display

chat

lighting control

text

Image

Imag

e

audio

Audio files?inform

ation

information

imag

e

Text

msg

sTe

xt p

ost-i

ts

Image file

TS App files

Image file

files

data structures

logininformation

text

reservations

files

Text post-its

screen shot

coor

dina

tes

files

coords.

text

TS Server

Web BARN

Database

Peripheral

Messyboard

Project BARN

Project BARN

Messyboard!

Simple ‘board’ to be used for communication and organization of ideas

Mouse-click based menu

Rectangle, circle, text box commands

Chat box bubble and chat tool

Arrows to link everything together

Save and load function

Toolbars at the bottom of the board (e.g. trash, circle, rectangle)

Pen stroke to ease writing

Easily accessible with Java Applets

“Thinking Surface of the Future”

Project BARN

Server <–> Client structure means that there can be numerous clients looking at a single server.

Each client sends requests to the server to lock thinking surface elements (in order to make changes) and makes those changes on a local database. Requests are sent through as packets.

The client has a “local” copy and a “true” copy of the state of the board. The “true” copy is the state which has been validated by the server. The “local” copy is the state which is pending upon acknowledgement from the server.

The server handles all requests in a sequential fashion. Upon accepting an element lock request, the server sends an acknowledgement to the client that sent it, and broadcasts the change details it receives to the other clients.

Client receives Acknowledgement packet and sends the changes to the server. It then updates the “true” state and updates the “local” state to the true state.

If the client was denied the lock request, then it merely reverts the “local” state to the last known “true” state.

(Written in Java, the base code is thanks to Adam Fass)

Project BARN

Project BARN

Web BARN!

Your key to logging in and reserving BARN space

A view of all you need to know going on in a BARN

Update applications allow for real-time view of presentations

Keep track of what’s on the Messyboard

Chat program allows for easy communication, private or public

Access to all files and presentation materials

“As if you were actually in the Barn!”

Project BARN

Chatter Program

– Based off the Build-a-Chat Program

– Allows for logging of messages

– Allows for private chat

– Highly configurable and written in Perl

Web Portal

– Based off of Microsoft’s .NET architecture

– Module based, can be easily customized

– Built for scalability

Project BARN

Project BARN

Project BARN

Jfna9^8743!@$y5ba09v93$^949a04rya0b93yrma9w#83u[rabv8wgr#$awvyr&^*(*(naw93ghvbq4$^6tqcb2ey12yr)(**cb3&$68g4t9ac4hrcwb$^@jdh38t4bv0#%!2y3ma92jerc9a23yvr280((*yrcna9823urma2938yrh@$^nc827yraj0874hya9283yr235nca902hr308nx7@$^%ay2987a98m7yan2087ty098t7amtrhy20!$!@987tka29(4tujhma2984cha0(*&&&827tnh08&(c2^)(*)athq02amh#@!tm^q02a4x8h4t0a9m80dfhv14t414yb@$^93yvbt84tgns84&tus8(**&*&3049v8n305398)(*&y53874c5%$%mrja290384747#@^%19843ycjs39845n293a8ych7*&^)(yc0a24h&0aw5319j4uawertvj38974yq08k45q09ju0%$#)*#98c27!#$!#%y5q90827y50q2 $^@jdh38t4bv0#%!2y3ma92jerc9a23yvr280((*yrcna9823urma2938yrh@$^nc827yraj0874hya9283yr235nca902hr308nx7@$^%ay2987a98m7yan2087ty098t7amtrhy20!$!@987tka29(4tujhma2984cha0(*&&&827tnh08&(c2^)(*)athq02amh#@!tm^q02a4x8h4t0a9m80dfhv14t414yb@$

Project BARN

Organizes and maintains all files used by the BARN

Can upload and download to the Database, before or after a meeting

All applications use the database as a transfer point

Post-meeting archiving transfers all active meeting files to a permanent database

– Uses a special program to auto-transfer active files when meeting sign-off detected

“You put your Files In, You take your Files Out,You put Files In, and you Shake it all about…”

Database

Project BARN

c:/Meeting/

/CurrentFiles/ /Group1/ /Group2/ …

TS.jpg

DT.jpg

SG.jpg

/DataFiles/ /MeetingFiles/

Blah.ppt

Blah2.doc

/ChatLog/ /Sound/

…

/Attendance/ /TSFiles/

FileNamebyDate.txt FileNamebyDate.mp3 FileNamebyDate.txt FileNamebyDate.tsf

… … … …

Members.txt

Login/group info

Key: Green = folders Yellow = files

Project BARN

The Brain[Projections, web host, database]

Messyboard Host People Loc. Devices

Internet

Projectors

social geometry information

Messy boardprotocols

Project BARN

Project BARN

Users ID-in

Restore existing group project workspace

Create a new Group

Room environmental controls

TWI, Mute buttons

Dashboard!“So much Control at your Fingertips”

Project BARN

System Architecture

– Vertical array of sensors creates interaction zones for the user

– Stamp II Microprocessor monitors the sensors, applies protocols for the RFID

RFID behind faceplate at the bottom for ID reads

Communicates with Brain through custom VB application over 2 RS232 serial ports

Projected buttons are aligned with actual sensor arrays, combining the flexibility of a digital display with actual physical interaction

Project BARN

Dashboard : Implementation

Stamp

Brain

VB Application RFID Reader

Capacitive-sensorInteraction zones

Serial 1

Serial 2

Customprotocol

Projector

Project BARN

Project BARN

Project BARN

Mimio uses ultrasound technology to pinpoint pen locations

Each pen emits a different frequency allowing Mimio detector to differentiate between them

One time calibration process is required for each new environment

Ultrasound waves are emitted when pen circuit is complete and internal pressure buttons are activated by pressing pen tip to writing surface

Mimio detector has internal memory that is able to capture and store information until download to PC through USB port

Mimio!“A picture is worth a thousand words.”

Project BARN

Uses ultra-sound technology. When the pen tip is pressed, it touches contacts inside the pen that enable ultra-sound waves be emitted

Each pen has different waves that allow the Mimio unit to differentiate between them

Calibration must be done for each pen, but only once

The Mimio unit can handle a blackboard space of 4x8 feet

Project BARN

Project BARN

Project BARN

KLH 6-Piece Home Theater with 50-watt subwoofer

– 2 way satellites for front, center and surround channels

– Magnetically shielded

Kenwood 500-Watt A/V Receiver with Dolby Digital

– 5.1 Channel Experience

– Compression of frequency response

High-end base microphone captures the entire audio environment of the Barn without a need for individual wireless microphones

Audio Logging

– Continuous recording throughout meeting for archiving

– TWI button to mark important segments during meeting

– Compresses into mp3 format for space efficiency

Audio Devices!“Listen to the sound of my voice… you are getting sleepy….”

Project BARN

Audio Logging

– At the meeting start, forks a new process that tells the audio program to begin recording

– The application is called Loop Recorder. It has built-in features such as scheduled recording and auto-compression

– TWI button sends a signal to fork a new process and begin recording in a separate segment

– Prevents redundant recording data

Microphone positioned at the ceiling corner to best capture room audio

Project BARN

Project BARN

In-Room social geometry

– Makes use of the augmented reality toolkit

– Digital Camera tracks unique visual markers

– Markers map location and direction of each participant

X10 for environment control through automated handling of electronic devices based on the detected social geometry

Campus wide network to locate absent members via the wireless network

– Members are located based on the access points they are logged into

– Authorization is required by users since privacy is a major issue

Data and visualizations are logged during meetings

Social Geometry!“Nerds of a feather flock together.”

Project BARN

•AR toolkit tracks markers of unique markers with no symmetry.

•Social Geo then generates a JPEG representation.

•Allows for interpretation of social geometry.

•Allows for automated control of environment.

Project BARN

What is included?– ActiveHome PC kit – a PC interface that allows computerized control of

electric devices. Commands can be sent through WinXP command line or Windows Messages

– Wall Switch Module – control any wall switch with X10

– 4 Lamp Modules – control any electric lamp with dimming capabilities

– Motion Sensor – know when there is activity in the room

Lamp ModulePC Kit Wall SwitchMotion Sensor

Project BARN

Project BARN

RFID technology and AR Toolkit

– RFID reader and tags used to identify people in the BARN

– RFID tags can be placed covertly onto any ID card

Remote whiteboard control of the iPen is done by the Gyromouse

– Gyromouse is a remote mouse with 3D control

– Can program the Gyromouse to draw lines or highlight items

– Receiver uses USB connection to the Brain

Integration of Gyromouse and Mimio Pen

– Cut out unnecessary parts and combine the Gyromouse and Mimio Pen to make the iPen

– Can edit the Whiteboard directly and remotely

Interactive Devices!“Set phasers to stun.”

Project BARN

RFID systems use radio transmissions to send energy to a RFID Tag

RFID Tag emits a unique identification code back to a data collector reader

Reader is linked to the PC through a serial port

Project BARN

Project BARN

Project BARN

Moo….

Project BARN

Class, 994, 25%

Meetings, 897, 22%

Report/PPT/Adm. Tasks, 610, 15%

Research/Design, 619, 15%

Development/Coding, 663, 16%

Testing/Integration, 280, 7%

Project BARN

Organization and leaders tend to evolve Engineers are from Mars, HCI are from Venus Cross-pollination of groups makes for interesting benefits and extra chaos There has to be a top-level decision maker and organizer Communication is key in large groups. A “common list” of big issues and questions should be

kept and maintained It is important to adhere carefully to the timelines Start on technical aspect earlier. Expect problems and delays Get orders for components early. Expect them to ship everything LATE Always have a Plan B, and sometimes a Plan C Integration, integration, INTEGRATION Don’t expect technical support to be helpful The small things are what will get people to say “That’s cool!” People will be discouraging. They might express doubts, they might laugh at you, they might

outright tell you that you will fail. Succeed or not, take pride in the lessons learned and the work done

But when it does get finished, it feels GREAT

Project BARN

Add some entertainment consoles for “free-time” gaming during the lunch hour and alter the iPen case to look like a gun

Add a karaoke machine and get some wireless microphones

Add a laser gun option to the iPen (with stun mode)

Change the door so that it slides open in a very futuristic/slick manner

Add extra chairs for watching movies in the Barn (hey, it’s got great surround sound)

Wear those nifty social geometry hats ALL THE TIME

Add a fridge next to the Dashboard. ID in for your free drinks!

Project BARN