Robots, Microcontrollers & Sensors http://www.martinet.nl

TankBot @ New York Toy Fair iPod, iPhone, and iPad controllable robot

$20

Popchilla @ Autism Center of Pittsburgh & Interbots iPad app + robot

Therapy for children with Autism

Control the robot to identify emotions

Microcontroller Small computer on a single integrated circuit

Processor Core

Memory

I/O peripherals

Embedded Applications

Example: Arduino, Gumstix, …

Arduino Flexible, easy to use platform

Microcontroller: ATmega168

14 Digital I/O pins, 6 Analog input pins

Serial Communication

Programming: Preburned bootloader allows to upload new codes through Arduino software.

Programming Example Change LED brightness according to potentiometer value

Sensors

Display

Compass

GPS

Accelerometer

Gyro

Pressure Sensor

Microphone

Camera

Force sensor

IR sensor

Robots Scribbler

iRobot Roomba

Manoi

Aibo

Serial Communication

Teams Input Device Design

Arduino/Sensor Programming Establishing wireless communication via Bluetooth Glove design Machine Learning - Pattern Recognition

Robot Application Design Robot Programming Application design & Programming Establishing wireless communication

Pattern Recognition

Pressing Swiping

1/18/11

1

Multi Input Glove

!!Collaboration with Children’s Healthcare of Atlanta

!!Cerebral Palsy patients

!! Incapable of dexterous tasks

Multi Input Glove

!!Current Technology

!! Computerized speech generating device !! Touch screen / Tablet Computers

!! Many patients have hard time pressing buttons

1/18/11

2

Multi Input Glove

!!A glove that turns your forearm into a big remote controller.

!! Force Sensitive Resistor sensors

!! Safety issues

Concept Sketch

Sliding through sensors

1/18/11

3

Concept Sketch

Tapping each sensor

Tasks

!!Design multi-input ‘glove’ device

!! Arduino board and the sensors

!! Interface/Control

!! iPad application

!! Robot

!! ??

1/18/11

4

References !! Engaging Children with Severe Physical Disabilities via

Teleoperated Control of a Robot Piano Player

!! Making Muscle-Computer Interfaces More Practical !! Scott Saponas, Desney Tan, Dan Morris, Jim Turner, and James Landay,

Proceedings of ACM CHI 2010, April 2010

!! Demonstrating the Feasibility of Using Forearm Electromyography for Muscle-Computer Interfaces !! T. Scott Saponas, Desney S Tan, Dan Morris, Ravin Balakrishnan, Conference on

Human Factors in Computing Systems, 2008

!! !Skinput: Appropriating the Body as an Input Surface !! Chris Harrison, Desney S Tan, Dan Morris, Proceedings of ACM CHI 2010

!! Experimental Research Methods !! Wickens, Gordon, and Li, An Introduction to Human Factors Engineering, 1998.