![Page 2: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/2.jpg)
Embedded Vision Sensors
![Page 3: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/3.jpg)
Part 1: Why are opening up our hardware
Part 2: Reconciling chip design and open source
![Page 4: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/4.jpg)
My Obsession (since 1996)
Saccade away from regions
with high optic flow
Centering: equalize lateral O.F.s
Speed control: keep global
O.F. average constant
Major Goal: Use optical flow and other vision techniques to allow a small robotic aircraft to fly through an environment without crashing into obstacles
![Page 5: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/5.jpg)
2001
16 pixels, PIC18C252, 2MIPS
http://www.youtube.com/watch?v=EkFh_2UX-Jw
![Page 6: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/6.jpg)
2003
3 X (88 pixels, PIC18F, 10MIPS)
http://www.youtube.com/watch?v=Ah-eESVigd4
![Page 7: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/7.jpg)
2009
512 pixels, Atmel AVR32, 60MHz, 3.0g
http://www.youtube.com/watch?v=pwjUcFQ9b3A
![Page 8: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/8.jpg)
2009
8 pixels!
http://www.youtube.com/watch?v=AoKQmF13Cb8
![Page 9: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/9.jpg)
!"#$%&$'(&%$%)*+$%&$%&,&$-./(01$/+$%.23-(4+$5&$,&6&*,7)89 -Albert Einstein
http://www.youtube.com/watch?v=dDbazL5IplI
![Page 10: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/10.jpg)
Vertically Integrated Approach
!"#$#%&'()#*+
Vision sensor
Image processing
Vehicle
Control algorithms
Optics ,Split processing between optics, circuitry, and algorithms as appropriate ,Optimize to figures of merit that really matter as opposed to arbitrary metrics ,Control the interface- optimize them instead of being constrained by some industrial standard ,Include useful features ,Eliminate unnecessary features ,Eliminate unnecessary pixels!!
![Page 11: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/11.jpg)
And so why open source?
We have experience with the vertically integrated approach -'.&/'%0)12$'/%'&%03 Therefore: ,40'#$'5126'/#77#89:0'0%'8%&516'1;.80:6'<).0'%92'018)&%:%=6'!#$+ ,Things that are obvious to us are not to others (We are not smarter than others- <1'>9$0').51'1;*12#1&81-?
Why open source hardware? ,We need to make it easy for others to tinker and experiment ,Transparency and openness is the only way to encourage this ,Our technology is both software and hardware
![Page 12: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/12.jpg)
Basic Chip Design You draw both the connections and the components!
The problem: Design rule files and library files for chip design are generally NOT open!
![Page 13: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/13.jpg)
"6$!:*,+/*33;$<=&(9$*$:.66/5/3/+;> Well, it is possible, but would the community accept it?
!"#$%
&'()%
*+,-%
V
G
IO
IO
IO
IO
Output pad
A input
B input
Chip boundary
Ground pad
10k pull down
2-input AND
Tri-state buffer
Z input
Power pad Routing
Detailed layout
@3'!A#//:1B.&+'%2'foundry generates native level layout
3. Fabricate!
1. Designer creates abstract layout
![Page 14: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/14.jpg)
Batch Fabrication of Chips is Pretty Common
(#&/6C$'8)#*
D210C$'8)#*
E2:1&1C$'8)#*
F%&C$'8)#*
![Page 15: Open Source Embedded Vision Sensors2011.oshwa.org/files/2011/09/Centeye.pdf · Open Source Embedded Vision Sensors Geoffrey L. Barrows geof@centeye.com Centeye, Inc](https://reader033.vdocuments.mx/reader033/viewer/2022050511/5f9c27db58db852e8e36f475/html5/thumbnails/15.jpg)
The Numbers: Hypothetical Batch Chip Fab
Cost for a fab on a 0.6um process: $35,000 ,$20,000 for the mask set ,GHIJIII'7%2'.'K.08)'%7'HI';'L+'<.712$
, Note: About 30+ reticles per wafer or 300+ reticles total ,$5,000 for dicing Scenario: Get 100 customers to contribute 100 different designs ,M10#8:1'N'@HBB';'@HBB'O'@BB';'@BB'7%2'1.8)'/1$#=& ,Total fab cost per customer for chips = $350 (for 300 chips!) ,Add $100 per customer for packaging (5 chips in DIP packages) ,Total cost per customer: About $450 ,If we multiply by 2.6, we bill the customer $1170