Smart Objects for Human Computer

Interaction, Experimental Study

Doggen, J.*; Neefs, J.; Brands, E.; Peeters, T.;Bracke, J.; Smets, M.; Van der Schueren, F.

*jeroen.doggen@artesis.be

March 22, 2012

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

2/29

Arduino based Smart Objects

I We developed a wireless sensormodule based on the Arduinodevelopment board.

I We use the “smart dice” tocontrol computer applications.

I This basic concept can beadapted to implement varioussensor based applications.

3/29

Arduino based Smart Objects

I We developed a wireless sensormodule based on the Arduinodevelopment board.

I We use the “smart dice” tocontrol computer applications.

I This basic concept can beadapted to implement varioussensor based applications.

3/29

Arduino based Smart Objects

I We developed a wireless sensormodule based on the Arduinodevelopment board.

I We use the “smart dice” tocontrol computer applications.

I This basic concept can beadapted to implement varioussensor based applications.

3/29

Wireless Sensor Networks & Smart Objects

I A wireless sensor network is a set of small autonomous sensornodes which cooperate to solve a common application usingsome kind of perception of physical parameters1.

I Smart objects sense their environment and communicate toincrease sensing efficiency and enable new ways of end-userinteraction.

1An FDL’ed Textbook on Sensor Networks, Thomas Haenselmann.4/29

Wireless Sensor Networks & Smart Objects

I A wireless sensor network is a set of small autonomous sensornodes which cooperate to solve a common application usingsome kind of perception of physical parameters1.

I Smart objects sense their environment and communicate toincrease sensing efficiency and enable new ways of end-userinteraction.

1An FDL’ed Textbook on Sensor Networks, Thomas Haenselmann.4/29

Arduino Development Platform

I The Arduino development platformallow designers to develop electronicprototypes.

I The platform has gained increasedpopularity over the last years.

I The open-source community has70000 registered users and anabundance of user submittedlibraries.

I Ease of use is the main selling point.

5/29

Arduino Development Platform

I The Arduino development platformallow designers to develop electronicprototypes.

I The platform has gained increasedpopularity over the last years.

I The open-source community has70000 registered users and anabundance of user submittedlibraries.

I Ease of use is the main selling point.

5/29

Arduino Development Platform

I The Arduino development platformallow designers to develop electronicprototypes.

I The platform has gained increasedpopularity over the last years.

I The open-source community has70000 registered users and anabundance of user submittedlibraries.

I Ease of use is the main selling point.

5/29

Arduino Development Platform

I The Arduino development platformallow designers to develop electronicprototypes.

I The platform has gained increasedpopularity over the last years.

I The open-source community has70000 registered users and anabundance of user submittedlibraries.

I Ease of use is the main selling point.

5/29

Arduino based Smart Objects

I We built a WSN using theArduino platform to developa smart object.

I A “smart dice” to controlcomputer applications.

I The dice can be replaced byany object, e.g. a kids’ toy

6/29

Arduino based Smart Objects

7/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

8/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

9/29

System Architecture

10/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

11/29

Hardware Specifications

I Seeeduino development boardI Digi XBee wireless interfaceI Freescale Semiconductor MMA7361 analog accelerometerI InvenSense ITG-3200 digital gyroscopeI Sharp GP2Y0A21YK infra-red distance sensor

12/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

13/29

Arduino Libraries

I Arduino software libraries make it straightforward for anyone tostart embedded development.

I Used Arduino librariesI ITG-3200 Gyro library

I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering

I XNA library to connect the module to C# applications

14/29

Arduino Libraries

I Arduino software libraries make it straightforward for anyone tostart embedded development.

I Used Arduino librariesI ITG-3200 Gyro library

I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering

I XNA library to connect the module to C# applications

14/29

Arduino Libraries

I Arduino software libraries make it straightforward for anyone tostart embedded development.

I Used Arduino librariesI ITG-3200 Gyro library

I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering

I XNA library to connect the module to C# applications

14/29

Arduino Libraries

I Arduino software libraries make it straightforward for anyone tostart embedded development.

I Used Arduino librariesI ITG-3200 Gyro library

I Developed Arduino librariesI Sharp GP2Y0A21YK infra-red distance sensorI MMA7361 accelerometerI Signal filtering

I XNA library to connect the module to C# applications

14/29

Arduino Library Example

1. Include header files

2. Initialise objects and variables

3. setup → configuration

4. loop → start example program

15/29

Arduino Library Example

1. Include header files

2. Initialise objects and variables

3. setup → configuration

4. loop → start example program

15/29

Arduino Library Example

1. Include header files

2. Initialise objects and variables

3. setup → configuration

4. loop → start example program

15/29

Arduino Library Example

1. Include header files

2. Initialise objects and variables

3. setup → configuration

4. loop → start example program

15/29

Arduino libraries: usage statistics

I MMA7361 accelerometer library2

I Sharp GP2Y0A21YK infrared distance sensor library3

I Total downloads: both ± 320

2http://code.google.com/p/mma7361-library3http://code.google.com/p/gp2y0a21yk-library/

16/29

Arduino libraries: usage statistics

I MMA7361 accelerometer library2

I Sharp GP2Y0A21YK infrared distance sensor library3

I Total downloads: both ± 320

2http://code.google.com/p/mma7361-library3http://code.google.com/p/gp2y0a21yk-library/

16/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

17/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

18/29

Signal Filtering

I Many analog sensors have signal differences between individualsensors.

I Calibration and signal filtering is needed to compensate forthese undesirable effects.

I We implemented three simple software based filters:

I variable-length weighted moving average filterI Bessel low-pass filterI Chebychev low-pass filter

I The signal filtering library is available online4.

4http://code.google.com/p/arduino-signal-filtering-library

19/29

Signal Filtering

I Many analog sensors have signal differences between individualsensors.

I Calibration and signal filtering is needed to compensate forthese undesirable effects.

I We implemented three simple software based filters:I variable-length weighted moving average filterI Bessel low-pass filterI Chebychev low-pass filter

I The signal filtering library is available online4.

4http://code.google.com/p/arduino-signal-filtering-library

19/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

20/29

Software Tools

I SerialMonitor: log and analyse sensor data

I SerialForwarder: forward serial data over a TCP/IP socket

21/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

22/29

Demo Applications

I Flight simulator: sensor actsas a joystick

I Pac-man clone: sensorgenerates arrow inputs

23/29

Demo Applications

I 2-D platform game:I Left/right: tilt

detectionI Jump: upward

movement

24/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

25/29

Future Work

I Use mixed RF technologiesI Support the more power efficient nRF24

wireless technology

I Minimise energy consumptionI Use the module for various student

projects:

I Development of embedded softwareI Printed circuit board designI Signal processing applications

I Projects

I Development of a city monitoringapplication

I Cooperation with product developmentdepartment: prototyping

26/29

Future Work

I Use mixed RF technologiesI Support the more power efficient nRF24

wireless technology

I Minimise energy consumption

I Use the module for various studentprojects:

I Development of embedded softwareI Printed circuit board designI Signal processing applications

I Projects

I Development of a city monitoringapplication

I Cooperation with product developmentdepartment: prototyping

26/29

Future Work

I Use mixed RF technologiesI Support the more power efficient nRF24

wireless technology

I Minimise energy consumptionI Use the module for various student

projects:I Development of embedded softwareI Printed circuit board designI Signal processing applications

I Projects

I Development of a city monitoringapplication

I Cooperation with product developmentdepartment: prototyping

26/29

Future Work

I Use mixed RF technologiesI Support the more power efficient nRF24

wireless technology

I Minimise energy consumptionI Use the module for various student

projects:I Development of embedded softwareI Printed circuit board designI Signal processing applications

I ProjectsI Development of a city monitoring

applicationI Cooperation with product development

department: prototyping

26/29

Outline

Introduction and Problem Statement

System DesignSystem ArchitectureHardware SpecificationsSoftware Libraries

ApplicationsSignal FilteringSoftware ToolsDemo Applications

Future Work

Conclusion

27/29

Conclusion

I We developed an Arduino based “smart cube”, equipped withvarious sensors.

I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.

I The system and its derivatives are being used for studentprojects.

I We plan to cooperate with third parties by developing similarmodules:

I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.

28/29

Conclusion

I We developed an Arduino based “smart cube”, equipped withvarious sensors.

I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.

I The system and its derivatives are being used for studentprojects.

I We plan to cooperate with third parties by developing similarmodules:

I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.

28/29

Conclusion

I We developed an Arduino based “smart cube”, equipped withvarious sensors.

I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.

I The system and its derivatives are being used for studentprojects.

I We plan to cooperate with third parties by developing similarmodules:

I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.

28/29

Conclusion

I We developed an Arduino based “smart cube”, equipped withvarious sensors.

I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.

I The system and its derivatives are being used for studentprojects.

I We plan to cooperate with third parties by developing similarmodules:

I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.

28/29

Conclusion

I We developed an Arduino based “smart cube”, equipped withvarious sensors.

I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.

I The system and its derivatives are being used for studentprojects.

I We plan to cooperate with third parties by developing similarmodules:

I Evaluation of the feasibility of industrial applications.

I Prototyping tool for product development purposes.

28/29

Conclusion

I We developed an Arduino based “smart cube”, equipped withvarious sensors.

I The LGPL licensed Arduino software libraries for these sensorsare freely available for download.

I The system and its derivatives are being used for studentprojects.

I We plan to cooperate with third parties by developing similarmodules:

I Evaluation of the feasibility of industrial applications.I Prototyping tool for product development purposes.

28/29

Questions & Answers

29/29