20140923 movidius_sean mitchell

10
© Copyright Movidius 2014 - Confidential Movidius TCD R&D Collaboration

Upload: irish-software-innovation-network

Post on 29-Nov-2014

99 views

Category:

Technology


2 download

DESCRIPTION

Computational Imaging, Visual Awareness

TRANSCRIPT

Page 1: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

Movidius TCD R&D Collaboration

Page 2: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

Who Are We?

Vision Processor

- Computational Imaging

- Visual Awareness

Page 3: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

Myriad2 Processor

Mai

n

Bu

s

DDR Controller

12

8

Bridge

SW Controlled I/O Multiplexing

UART ETH 1Gb SDIO

SPI x3

USB3 OTG

SPI x3

SPI x3

SPI x3

I2C x3

SPI x3

I2S x3

RISC-RTOS

L1 32/32kB

L2 128kB

ROM 64kB

Stacked KGD 1-8Gbit LP-DDR2/3

PLL & CPM

RISC-RT

L1 4/4 kB

L2 32kB

MIPI D-PHY x12 lanes NAL LCD CIF

AMC Crossbar

RAW LSC Debayer Chroma Denoise

Sharpen Filter

Polyphase Scaler

Median Filter

LUT Edge Oper

Conv Kernel

Harris Corner

Colour Combination

Luma Denoise

Arbiter & 16:1 mux

L2 cache 256kB

32x HW

Mutex

Inter-SHAVE Interconnect (ISI)

SHA

VE

0

SHA

VE

1

SHA

VE

2

SHA

VE

3

SHA

VE

4

SHA

VE

5

SHA

VE

6

SHA

VE

7

SHA

VE

8

SHA

VE

9

SHA

VE

10

SHA

VE

11

SIPP Hardware Accelerators

power 17 independent power islands

CMX Memory Fabric 2MB Multi-Ported RAM Subsystem

Page 4: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

Development Tools

Development Frameworks; OpenCL/HALIDE Front-end

MV182 Development Board Hardware (with Myriad2 VPU)

Reference Application Examples Movidius Partner

Applications

CV Library Linear Algebra

Library

Movidius Partner

Libraries

MoviTools

IDE Compiler

Assembler Simulator

Profiler Debugger

ISP Library

Board Support Package (BSP)

Page 5: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

Project Tango

Mobile Applications

Enhanced Photography

Natural User Interfaces

Immersive Gaming

Augmented Reality

Indoor Navigation

Visual Search

3D Scanning

Robotics

Page 6: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

Movidius collaborates with TCD to:

Access the latest research in strategic areas

Pursue longer term developments without the distractions to our internal resources

Get more people familiar with our architecture

Motivation for R&D Collaboration

Page 7: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

SFI-funded Lero project High performance linear algebra libraries for embedded

applications

Principles

• David Gregg, Mircea Ionica

Contributions

• Embedded version of algorithm ported to Movidius Myriad2

• 2 posters accepted for HotChips 2014 in Cupertino

Compiler Technologies

Page 8: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

SFI-funded Lero project Domain-Specific Languages for Computer Vision

Principles

• David Gregg, Shixong Xu, Andrew Anderson

Contributions

• Port of Halide and Darkroom DSLs to Myriad2 leveraging Movidius LLVM-based compiler backend

Compiler Technologies

Page 9: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

EVES project Vision-based indoor navigation for mobile and robotics

applications

Based on Wingwatch project from TCD

EI Enterprise partnership between TCD, Movidius and Surewash

Result will be an embedded solution for pose-estimation which is faster and more robust compared to incumbent 5 and 9-point algorithms

Principles

• Gerry Lacey, Rozenn Dayhot, Peter Redmond

Contributions

• Automated testing framework based on Google sheets

• Embedded version of algorithm ported to Movidius Myriad2

Computer Vision

Page 10: 20140923 Movidius_Sean Mitchell

© Copyright Movidius 2014 - Confidential

Movidius has long-standing collaboration with TCD for R&D in areas that are strategic to Movidius

We’ve seen outputs from these programs that have direct application for us in the marketplace

We look forward to future collaboration for many years to come

Summary