20140923 movidius_sean mitchell
DESCRIPTION
Computational Imaging, Visual AwarenessTRANSCRIPT
© Copyright Movidius 2014 - Confidential
Movidius TCD R&D Collaboration
© Copyright Movidius 2014 - Confidential
Who Are We?
Vision Processor
- Computational Imaging
- Visual Awareness
© Copyright Movidius 2014 - Confidential
Myriad2 Processor
Mai
n
Bu
s
DDR Controller
12
8
Bridge
SW Controlled I/O Multiplexing
UART ETH 1Gb SDIO
SPI x3
USB3 OTG
SPI x3
SPI x3
SPI x3
I2C x3
SPI x3
I2S x3
RISC-RTOS
L1 32/32kB
L2 128kB
ROM 64kB
Stacked KGD 1-8Gbit LP-DDR2/3
PLL & CPM
RISC-RT
L1 4/4 kB
L2 32kB
MIPI D-PHY x12 lanes NAL LCD CIF
AMC Crossbar
RAW LSC Debayer Chroma Denoise
Sharpen Filter
Polyphase Scaler
Median Filter
LUT Edge Oper
Conv Kernel
Harris Corner
Colour Combination
Luma Denoise
Arbiter & 16:1 mux
L2 cache 256kB
32x HW
Mutex
Inter-SHAVE Interconnect (ISI)
SHA
VE
0
SHA
VE
1
SHA
VE
2
SHA
VE
3
SHA
VE
4
SHA
VE
5
SHA
VE
6
SHA
VE
7
SHA
VE
8
SHA
VE
9
SHA
VE
10
SHA
VE
11
SIPP Hardware Accelerators
power 17 independent power islands
CMX Memory Fabric 2MB Multi-Ported RAM Subsystem
© Copyright Movidius 2014 - Confidential
Development Tools
Development Frameworks; OpenCL/HALIDE Front-end
MV182 Development Board Hardware (with Myriad2 VPU)
Reference Application Examples Movidius Partner
Applications
CV Library Linear Algebra
Library
Movidius Partner
Libraries
MoviTools
IDE Compiler
Assembler Simulator
Profiler Debugger
ISP Library
Board Support Package (BSP)
© Copyright Movidius 2014 - Confidential
Project Tango
Mobile Applications
Enhanced Photography
Natural User Interfaces
Immersive Gaming
Augmented Reality
Indoor Navigation
Visual Search
3D Scanning
Robotics
© Copyright Movidius 2014 - Confidential
Movidius collaborates with TCD to:
Access the latest research in strategic areas
Pursue longer term developments without the distractions to our internal resources
Get more people familiar with our architecture
Motivation for R&D Collaboration
© Copyright Movidius 2014 - Confidential
SFI-funded Lero project High performance linear algebra libraries for embedded
applications
Principles
• David Gregg, Mircea Ionica
Contributions
• Embedded version of algorithm ported to Movidius Myriad2
• 2 posters accepted for HotChips 2014 in Cupertino
Compiler Technologies
© Copyright Movidius 2014 - Confidential
SFI-funded Lero project Domain-Specific Languages for Computer Vision
Principles
• David Gregg, Shixong Xu, Andrew Anderson
Contributions
• Port of Halide and Darkroom DSLs to Myriad2 leveraging Movidius LLVM-based compiler backend
Compiler Technologies
© Copyright Movidius 2014 - Confidential
EVES project Vision-based indoor navigation for mobile and robotics
applications
Based on Wingwatch project from TCD
EI Enterprise partnership between TCD, Movidius and Surewash
Result will be an embedded solution for pose-estimation which is faster and more robust compared to incumbent 5 and 9-point algorithms
Principles
• Gerry Lacey, Rozenn Dayhot, Peter Redmond
Contributions
• Automated testing framework based on Google sheets
• Embedded version of algorithm ported to Movidius Myriad2
Computer Vision
© Copyright Movidius 2014 - Confidential
Movidius has long-standing collaboration with TCD for R&D in areas that are strategic to Movidius
We’ve seen outputs from these programs that have direct application for us in the marketplace
We look forward to future collaboration for many years to come
Summary