emg-based human machine interfaceee.bradley.edu/.../emg/proposalpresentation... · 11/28/2017 ·...
TRANSCRIPT
![Page 1: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/1.jpg)
1 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
EMG-Based Human Machine Interface
By Aditya Patel and Jim Ramsay
Advised by Dr. Yufeng Lu
and Dr. In Soo Ahn
![Page 2: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/2.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 2 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
EMG Explained
• Electromyography Signals (EMG)
o Electrical signals produced by
muscle activation
• Surface EMG (sEMG):
o A technique for acquiring EMG
signals by using electrodes placed
on the skin of the body, directly
above the desired muscle Diagram of forearm muscles [1]
![Page 3: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/3.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 3 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Uses of EMG
• Primarily for medical purposes
o Diagnosing and testing for muscle and nerve injuries
• Control of prosthetic limbs
• Gesture control
o Drones
o Computers
o TV
![Page 4: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/4.jpg)
Background
•Literature
•Previous Work
November 28th, 2017 4
Introduction
Problem Statement
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Background
![Page 5: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/5.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 5 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Applicable Literature
• Study of Virtual Control of a Robotic Arm via a Myo
Armband for the Self-Manipulation of a Hand Amputee
International Journal of Applied Engineering Research ISSN 0973-4562 Volume 11, Number 2 (2016) pp
775-782 © Research India Publications. http://www.ripublication.com
![Page 6: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/6.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 6 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
2016-2017 Senior Capstone Project
• Developed an EMG-based
HMI for a mobile robot
• Used a neural network to
detect user motion 2016-2017 EMG System
![Page 7: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/7.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 7 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
2016-2017 Senior Capstone Project
Limitations:
• Uncomfortable
• Short battery life
• One sensor – limited information
2016-2017 EMG System
![Page 8: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/8.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 8 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
2016-2017 Senior Capstone Project
Improvements:
• Armband design - easy to slide
on/off
• Extended battery life
• 8 sensors Myo Armband
![Page 9: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/9.jpg)
Background
•Literature
•Previous Work
November 28th, 2017 9
Introduction
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Project Overview
![Page 10: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/10.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 10 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Problem Statement
• Current market for gesture control of security systems is
limited
o Based on image recognition
• Security monitoring can be tedious
• Solution: gesture-based control of cameras
![Page 11: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/11.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 11 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Project Goals
1. Collect and analyze sEMG data
2. Develop pattern recognition algorithms
3. Control security camera system with hand gestures
![Page 12: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/12.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 12 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
System Diagram
Video Output Port
Camera System 1 Camera System 2
Camera 1 Video Output Camera 2 Video Output
Raspberry Pi 3B
Pan servo motor
Pi Camera
Video
Monitor Raspberry Pi 3B
Thalmic Labs
Myo Armband
Bluetooth
Connection Video Input
![Page 13: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/13.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 13 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Functional Requirements
• Myo armband worn on right
forearm
• Bluetooth connection between
Myo and Pi
• Calibration process executed by Pi
o Based on machine learning
• Generate PWM signals for pan
action
• Display camera video feed on
monitor
• User controls
o Myo armband sleep/wake up
o Calibration
o Camera selection
o Pan camera view
![Page 14: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/14.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 14 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Operating Modes Function Gesture Haptic Feedback
Toggle armband lock/unlock Fingers spread (hold for 2 seconds) Vibration (3 seconds)
Calibration Mode Make fist (hold for 2 seconds) 3 Vibrations (1 second each)
Camera Selection Control Activate CCW circle with fist 1 Vibration (1 second)
Camera Position Control Activate CW circle with fist 2 Vibrations (1 second each)
Next Camera 1. Start with palm facing in
2. Move wrist outward N/A
Previous Camera 1. Start with palm facing in
2. Move wrist inward N/A
Pan Left 1. Start with palm facing in
2. Move wrist inward Vibrate low while moving
Pan Right 1. Start with palm facing in
2. Move wrist outward Vibrate low while moving
![Page 15: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/15.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 15 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
System Flow Chart
![Page 16: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/16.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 16 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Specifications – Myo Armband
• 8 EMG sensor electrode pairs
• Sampling rate = 200 Hz
• EMG data sent via Bluetooth
o 8-bit signed integer
o Unitless, represents muscle
activation
• Compatible with:
o Windows 7, 8, and 10
o OSx 10.8 and up
o Android 4.3 and up
• Battery life
![Page 17: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/17.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 17 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Specifications – Raspberry Pi 3B
• Broadcom BCM2387 64-bit ARMv7
Quad Core Processor (1.2 GHz)
• BCM43143 WiFi
• Bluetooth (BLE 4.1)
• Boots from Micro SD
• Runs Linux or Windows 10 IoT
(Internet of Things)
• Input / Output
o 40-Pin 2.54 mm expansion header
(2x20 strip)
o CSI Camera port for Raspberry Pi
Camera
o 4 Port USB
o HDMI
o Ethernet
![Page 18: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/18.jpg)
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Background
•Literature
•Previous Work
EMG Human Machine Interface
Aditya Patel and Jim Ramsay November 28th, 2017 18
Introduction
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule
Engineering Efforts Completed
![Page 19: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/19.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 19 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Initial Data Collection
• Use Visual Studio (C++) to
record and save data
• Import the data and analyze
in MATLAB
First Attempt at Data Collection
![Page 20: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/20.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 20 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Initial Data Collection
• Control Variables
o Test duration: 10 seconds
o Armband worn the exact same way for each test
o Movements, repeated multiple times:
Palm facing in, wrist action in
Palm facing in, wrist action out
![Page 21: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/21.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 21 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Revised Data Collection
Multiple datasets of wrist moving outward for 10 seconds
![Page 22: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/22.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 22 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Data Analysis
Palm in, wrist
action outward
Palm in, wrist
action inward
High Sensor
Activity 2, 3, 4, 5 1, 6, 7, 8
Moderate Sensor
Activity 1, 6 2
Low Sensor
Activity 7, 8 3, 4, 5
Palm in, wrist action out Palm in, wrist action in
2
1 8 7
6
Myo Gesture Control Armband
with labeled sensors
v
![Page 23: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/23.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 23 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Data Analysis
• Data Analysis
o Envelope detection
o Fourier Analysis
o Thresholds
o Dominance table
• Gesture Recognition
o Supervised / unsupervised learning
o Look-up table
o Neural network
![Page 24: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/24.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 24 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Future Data Collection
• Continue to collect data
o Different users
o Test all gestures
• Pattern recognition
o Choose method for pattern recognition
o Associate patterns with gestures
![Page 25: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/25.jpg)
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Background
•Literature
•Previous Work
November 28th, 2017 25
Introduction
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Parts List
![Page 26: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/26.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 26 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Parts List
• Thalmic Labs Myo Armband (1)
• Raspberry Pi 3B and Power Supply (3)
• Raspberry Pi 3b Camera (2)
• 8GB Micro SD Card (3)
• HDMI / VGA / DVI Cable (only need one of these options)
• Computer Monitor (1)
• Servo Motor (2, one motor to pan each camera)
![Page 27: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/27.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 27 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Parts List
• Case for the Raspberry Pi boards
• Material to make a mount for the servo motors and Pi
board cases
• Second Myo armband
![Page 28: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/28.jpg)
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Background
•Literature
•Previous Work
November 28th, 2017 28
Introduction
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Looking Forward
![Page 29: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/29.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 29 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Division of Labor
Aditya Patel Jim Ramsay
Communication
• Video feed communications
• System component communication network
• Monitor connections
• Website design
Data Collection
• Pattern recognition
• Armband configuration
• Data analysis
Computing
• Raspberry Pi 3B setup / code
• PWM generator
• Pi GPIO configuration
Camera Hardware Design
• Case
• Mounts
• Servo motor wiring
![Page 30: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/30.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 30 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Schedule Weeks 1 & 2 Weeks 3 & 4
November
1. Write proposal
2. Submit parts list to Chris Mattus
3. Get raw data from armband
4. Discuss/consider filtering options
1. Make website
2. Draft project proposal presentation
3. Practice presentation
4. Revise proposal for final submission
December 1. Finalize the website design
2. Post project deliverables 12/7/2017
1. Collect data
2. Start thinking about data analysis options
January 1. Start pattern recognition
2. Develop preliminary tests for gesture detection
1. Compare gesture detection options and
choose which to continue with
2. Begin Raspberry Pi development
![Page 31: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/31.jpg)
Introduction
Background
•Literature
•Previous Work
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule 31 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Schedule Weeks 1 & 2 Weeks 3 & 4
February 1. Configure Raspberry Pi and peripherals
2. Hardware design and building
1. Finalize and compile code
2. Gather any data needed for final
submission
March 1. Begin work on final draft 1. Make poster
2. Finish final draft
April 1. Practice poster presentation
2. Begin drafting project presentation
1. Finalize project presentation
2. Practice project presentation
3. Finalize project report
![Page 32: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/32.jpg)
Project Overview
•Problem / Goals
•System Diagram
•System Functions
•Operating Modes
•Flow Chart
•Specifications
Background
•Literature
•Previous Work
November 28th, 2017 32
Introduction
Engineering Efforts Completed
•Data collection
•Analysis
Parts List
•Submitted
•Possible Additions
Looking Forward
•Division of Labor
•Schedule EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Questions?
![Page 33: EMG-Based Human Machine Interfaceee.bradley.edu/.../emg/ProposalPresentation... · 11/28/2017 · EMG-Based Human Machine Interface Aditya Patel and Jim Ramsay Specifications –](https://reader034.vdocuments.mx/reader034/viewer/2022052014/602c149df57ef91da305a562/html5/thumbnails/33.jpg)
33 November 28th, 2017 EMG-Based Human Machine Interface
Aditya Patel and Jim Ramsay
Sources
• https://www.ripublication.com/ijaer16/ijaerv11n2_05.pdf