wizardhand - simon fraser university

WizardHand

1  

ENSC440W/305W Instructor: Andrew Rawicz

Steve Whitmore Simon Fraser University

April 18th, 2016

Team members: Alex Chen - CEO Albert Xu - CFO Current Zeng -CTO Scott Zhu - CMO

Outline

2  

•  Introduc,on  •  Hardware  •  So2ware  •  Business  Case  •  Finance  •  Schedule  

•  Conclusion  •  Ques,on                          

Introduction

3  

Aimbot’s Staffs

4  

Name Position Main Responsibility

Alex Chen CEO Hardware, Arrange meeting, Purchasing

Current Zeng CTO Software, hardware

Albert Xu CFO Hardware, Purchasing

Scott Zhu CMO Software, Documentation and Research

Work Break Down Table High  Level  Tasks   Current  Zeng   Albert  Xu   Sco:  Zhu   Alex  Chen  

Component  Determina,on   xx   x  

Circuit  Design   x   xx   x  

Circuit  Build   x   xx   x   x  

Packaging   x   xx  

Data  Transfer   xx   x  

Windows  Form  Design   xx   x  

Virtual  Events   xx   x   x   x  

IMU  Research   xx   x  

IMU  Data  Processing   xx  

Quaternion  Research   x   x   xx   x  

Market  Research   x   xx  

Administra,ve  Tasks   x   x   xx  

5  Where  xx  =  Primary  Responsibility;  x  =  Some  Responsibility  

Background and Motivation

• Mo,va,on  • We  are  trying  to  built  a  product  that  is  portable  and  make  human  being’s  life  easier  

• Our  staffs  are  op,mis,c  about  the  wearable  device  in  the  future  • Background  

• Help  people  to  achieve  wireless  cursor  control  • Wide  range  of  using:  PCs,  projectors,  smartphones,  etc.  •  There  is  no  such  product  in  the  world  

6  

Hardware and Circuit

7  

Demo Recording for basic function

8  

Overview of Components

•  4  x  So2  poten,ometers    

•  1  x  Arduino  Pro-­‐mini  

•  1  x  Iner,a  Measurement  Unit  

•  1  x  Charging  unit  

9  

•  1  x  Bluetooth  Module  

•  1  x  850mAh  Li-­‐ion  ba_ery  

•  1  x  Programmer  

•  1  x  Li-­‐ion  ba_ery    

Soft Potentiometers

•  4  of  them  are  applied  on  index  finger  to  li_le  

finger  

•  By   bending   the   strip,   the   resistance   linearly  

changes   from   100Ohms   to   10,000Ohms.  

Thus,   it   provides   different   signals   reflec,ng  

the  fingers’  posi,on.

10

Arduino Pro-mini

Compact  size  -­‐  18mm  x  33mm  Weight  less  than  2  grams    Enough  pin  to  handle  our  inputs    

11

Programmer

• Required  by  Arduino  Pro-­‐mini  • Only  for  loading  embedded  so2ware  • Not  presented  on  user’s  system  

12

Inertia Measurement Unit

•  Including  three  measurements:    1.  Accelera,on  2.  Angular  difference  3.  Magne,c  field  

•  This  component  controls  the  loca,on  of  cursor  

13

Bluetooth Mate Silver

•  Good  signal  transfer  range  –  10m  •  Support  of  various  baud  rates  •  Achieving  wireless  communica,on  with  PC  

14

Li-ion Battery 850mAh

•  850mAh  Li-­‐ion  ba_ery  • Rechargeable  • Compact  

15

Charging Unit

•  Bring  up  Li-­‐ion  ba_ery  voltage  to  5V    •  Charge  the  ba_ery  using  micro  USB  connector  

16

The Integrated Circuit

17

Project Assembly

18

Software

19  

Software Part 1.  What  You  Can  See  

2.  What  You  Cannot  See  

20  

User Form - General

• User  Interface  Layout  •  Simple  and  Easy  

•  Three  Tabs  in  One  Window  

•  Connec,on  Op,on  Tab  

•  Monitoring  Tab  

•  Debugging  Tab  

21  

User Form – Connection Tab

1.  Choose  Port  Name  and  Connec,on  

Method  Before  Using  the  Device  

2.  The  Switches  is  to  Enable/Disable  Mouse  Control/Hand  Gesture  

Func,ons  

3.  Open/Close  Bu_on  are  Used  to  

Enable/Disable  the  Device  

22  

User Form – Monitoring Tab

1.  Fingers  Monitor  is  Monitoring  the  

Status  of  the  Hand  Gestures  

2. Mouse  Func,on  and  Hot-­‐Keys  

Monitor  Is  to  Show  what  Func,ons  

are  being  used  

3.  The  Scroll  Bar  Is  Used  to  Adjust  

Mouse  Sensi,vity  

23  

User Form – Debugging Tab

This  Tab  is  for  Debugging  Propose  Only  

24  

C++ Structure – General

There  Three  Parts  in  This  Project:  

1.  Header  Files  

2.  Resource  Files  

3.  Source  Files  

The  Parts  that  Enrolled  Most  of  Our  

Algorithm  are  IMU_SP.h  and  

IMU_SP.cpp    

25  

IMU to Cursor Position

•  IMU  is  Iner,a  Measurement  Unit  • We  are  using  Accelerometer  and  Gyroscope  only  

•  Gyroscope  Measures  Angular  Velocity  •  Integrate  Angular  Velocity  into  Angle  Which  Represent  Orienta,on  of  User’s  Hand  

•  Accelerometer  Measures  Accelera,on  •  The  accelera,ons  it  picks  up  are  projec,ons  of  gravity  on  X,  Y  and  Z  axis's  of  the  Accelerometer    

•  Based  on  the  projec,ons,  the  angles  of  the  accelerometer’s  coordinate  can  be  calculated  

26  

IMU to Cursor Position

• Gyroscope  is  integra,ng  its  measurement  over  ,me  •  It  accumulate  errors  –  long  term  error  

•  It  can  only  be  rely  on  short  term  applica,ons  

• Accelerometer’s  readings  do  not  depends  on  ,me  •  Its  reading  has  unwanted  noise    •  It  can  provide  accurate  long  term  results  

•  It  is  good  to  use  it  in  a  long  term  applica,on  

27  

IMU to Cursor Position

• Complementary  

• When  Device  is  s,ll  (Accelerometer  readings  are  not  changing)  

•  Rely  on  Accelerometer  more  

•  Use  Gyroscope  to  stabilize  Accelerometer  Reading  

• When  Device  is  being  moved  

•  Rely  on  Gyroscope  more  

•  Use  Accelerometer  to  correct  the  final  reading  of  Gyroscope(when  device  is  s,ll)  

28  

IMU to Cursor Position •  The  Orienta,on  is  represented  in  form  of  Quaternion  in  programming  

• Use  the  orienta,on  to  es,mate  rota,on  of  the  device    

•  The  device  is  treated  as  a  vector  during  the  rota,on  

•  The  projec,on,  of  the  vector,  on  Y  and  Z  axis  is  used  as  X  and  –Y  coordinate  of  the  cursor  

29  

Business Case

30  

Market Target  People:  •  Everyone  • Disabled  People  • People  interested  in  new  electronic  device  

• Retailers  (e.g.  NCIX,  Amazon)  

31  

Apply  Area:  •  No  flat  surface  around  (e.g.  Sofa,  Bed)  •  Far  away  from  PC  •  No  Wi-­‐Fi  environment       Actual Cost $691.5

Expect Cost for Mass Production

$100

Selling Price $200

Profit $100

Expected Time for Reproduing

12 Hours

Competition •  There  are  some  people  already  built  the  similar  device  (e.g.  Razer),  but  the  products  are  s,ll  not  sold  on  market.      

•  The  reason  may  be  is  the  cost  is  too  high.  • Most  people  is  s,ll  using  normal  mouse,  they  cannot  use  mouse  in  some  situa,ons.  

• But  the  cost  of  nomal  mouse  is  cheap.  

32  

Finance

33  

Schedule

34  

Conclusion

35  

Learning Experiences • Hardware  

• Arduino  usage  • Electrical  circuit  designing  and  building  • Arrangement  of  components  

• So2ware  • Visual  Studio  experiences  • Virtual  mouse/keyboard  event  • Serial  communica,on  

• Others  • Design  and  manufacture  process  • Teamwork  

36  

Future Plans

• Improve  the  system  • Poten,ometer  could  be  smaller  and  so2er  

• Bluetooth  can  be  faster  (  115200)  • Closure  and  packaging  can  be  be_er    

• Reduce  the  cost  • Buy  components  from  China  

• Manufacture  our  own  board  by  designing  the  PCB  board  

37  

Acknowledgement

Dr.  Andrew  Rawicz  

Prof.  Steve  Whitmore  

TA:  Hsiu-­‐Yang  Tseng  

           Jamal  Bahari  

           Mahssa  Abdolahi  

           Mona  Rahbar  

           Soroush  Haeri    

38  

Question?

39