Richard LandauSarah PattenJacob Stewart

BROBOTTHE STUDY COMPANIONGROUP 25

BroBot assists in easing the minds of students longing for a worry-free break.

Watches study materials while the user is away from the table.

Sends updated images and alerts to user through an

Android app on user’s phone.

Will provide real-time updates and will notify user if something is stolen.

PROJECT OVERVIEW

Detect theft of an object.Alert user when a theft

occurs.Be reliable and simple to

use.Rechargeable or easily

replaceable battery Be lightweight, portable,

and affordable.

GOALS AND OBJECTIVES

Specification

Weight Less than 3 lbs

Dimensions Less than 6inX6inX6in when closed

Communication Range At least 250 ft

Battery Life while in operation

At least 2 hours

Image Comparison Rate 2/sec

Refresh App Picture Every 15 seconds

DESIGN SPECIFICATIONS

OVERALL BLOCK DIAGRAM

All of the computations are on the microcontroller side

A good amount of serial communication protocols (SPI, I2C, UART)

Low power modes including sleep modeSpecial features with digital cameras (?)Good community backingCheap development board with all the pin

outs on the microcontroller

PROCESSOR CONSIDERATIONS

TM4C123GH6PM STM32F407VG ATSAM4SFlash Memory 256 KB 1 MB 1 MBSRAM 32 KB 192KB 128 KBGPIOs 43 72 47Max Speed 80 MHz 168 MHz 120 MHzPackage 64 LQFP 100 LQFP 64 LQFPDev Price (USD) 12.99 14.90 39.00Board pluses Not too many

output pins but has good community behind it

Comes with many MEMS sensors and all output pins

Comes with 2GB external flash and all output pins

ARM MICROCONTROLLERS

3.3V VoltageLow power modesDigital Camera

Interface(DCMI)Can take 8 bit parallel

data from a cameraGood amount of SRAMFast operation speedA lot of serial

communication linesGood community backing

it with pre-written libraries for most features

STM32F407VG

MT9D111 LinkSprite JPEG Color Camera

Control Communication

Own protocol UART

Data Lines 8 Bit Parallel UARTVoltage 3.1V 5VCurrent (Max Operation)

350 mA 100mA

Max Resolution 1600x1200 640x480Cost 20.00 44.95

CAMERAS

Cheap and smallAdjustable outputAdjustable resolutionAdjustable quality on

the JPEGsParallel dataControl on shutter

speed, and auto focusSleep modesHas own serial protocol Interfacing parallel data

might be tricky

MT9D111

Local shippingHigher voltage neededData is serial making it

easier to interface but slower overall

Smaller resolutionWill be used mostly for

testing, or used if we have troubles with the MT9D111

Bought since we are under budget

LINKSPRITE JPEG COLOR CAMERA

Wi-Fi direct and Bluetooth are comparable

Wi-Fi direct has longer range than Bluetooth

However, Bluetooth has more support and is easier to implement

Bluetooth is also more common in everyday life so we wanted experience with it

BLUETOOTH VS WIFI-DIRECT

Chose RN41 due to low cost, high range, and black box functionality

WT41 strong contender but expensive and drains battery quickly

Bluetooth Module Comparison

Name TI LMX9830

BC04 RN41 BLE112 WT41

Connection Type

UART UART UART UART UART

Range 2 – 10m 1-15m 1 – 100m 2-10m 1-800mLow Power

Yes Yes Yes Yes No

Price $13.46 $9.96 $21.70 $21.00 $33.00

All components need 3.3V

Around 500mA when everything is going

Power source needs to be small and lightweight

Rechargeable or easily replicable power source

One switching regulator3 AA Batteries held in a

battery holder

POWER SYSTEM OVERVIEW

Exact platform hasn’t been determined

Bluetooth antenna needs to be protruding

Small and lightweight Expandable/ Contractible

casing for easy traveling

BROBOT’S PLATFORM

Use computer vision techniques.Compare 2 images from different points in timeDetermine if there has been a significant amount of

change

ITEM WATCHING OVERVIEW

≠

Store an “original” imageEvery ½ a second, take a new picture Compare new picture with “original”If the images differ by too much, sound alarmEvery 15 seconds replace “original” with the

newest picture taken

ALGORITHM EXPLANATION

PSEUDOCODE

Android application’s main focus is to alert the user if something has been stolen

Picture of BroBot’s current view will be refreshed for the user to view at any time

App will vibrate to alert the user if something is taken

APP SUMMARY

Android represents a bigger market shareDoes not require a Mac to codeGood APIs to interface with Bluetooth

ANDROID VS IOS

VS

APP DESIGN

Initial screen shown upon startup

If connection fails, user will see an error

If it succeeds…

User will be taken to screen showing BroBot’s field of vision

When his sight is aligned properly, press the button to start the item watching software

This button will be replaced with a “Stop Watching” button, or a “Silence Alarm” button if it is tripped falsely.

BLUETOOTH CONNECTION

Once Bluetooth connection is established, app opens an input thread and output thread

Output thread stays idle and waits for signals to be sent to BroBot

Input thread constantly looks for new pictures or information from BroBot

Bluetooth’s input stream buffer reads in an array of bytes

Combine these bytes and restore the original picture

Bluetooth module to terminal communication Items are bought Item watching algorithm done App GUI is done

SUCCESSES!

Camera shippingApp Bluetooth ConnectionConverting byte array into viewable JPEGEnough time for testing for Item Watching Finalize power

DIFFICULTIES

Item PricePlatform $20.00STM Discovery Development Board

$14.90

RN-41 Bluetooth Module $21.702 Megapixel camera $18.99Printed Circuit Boards $75.00Report Binding $15.00Batteries $20PVC supplies $20.00 Total $205.59

ORIGINAL BUDGET

Item PriceSTM Discovery Development Board

$0.00(Previously Owned)

RN-41 Bluetooth Module $29.89MT9D111 Camera $18.99Backup Camera $44.95Report Binding $5 Total $98.83

CURRENT SPENDING

Still $106.76 in our budgetNeed: Platform Battery PCB

App communicating with module by first week of February

Bluetooth Module communicating with ARM processor by mid February

Camera communications finished by end of February Item watching program tested and working on a

desktop by end of FebruaryPCB designed and finished by early MarchFull app development finished by mid March Item watching program testing during March, finished

by end of MarchFull prototype testing during mid March and finished

by early April

PLANS FOR SUCCESS

PROGRESS CHART

Total

Testing

Prototype

Design

Research

0 10 20 30 40 50 60 70 80 90

48

20

20

78

72

Total Progress

Siren implementation Video stream

OTHER CONSIDERATIONS

QUESTIONS?