for battery powered devices always-on artificial intelligence · wake word detection speaker...

SYNTIANT PROPRIETARY AND CONFIDENTIAL – Copyright 2019

Always-on Artificial Intelligence for Battery Powered Devices

Syntiant Confidential CNDA ICAP63156SYNTIANT PROPRIETARY – Copyright 2019

Syntiant Summary

Number of Employees: 48

Median Experience: 20 yrs

Funds Raised: $30M

Focus: Always-on machine learning semiconductors for battery powered devices

First Product Samples: July 2018

First Product Production: July 2019

Location: Irvine, CA

2

Strategic Investors


Machine Learning At The Edge

3

DeepLearning

TransistorDesign


NDP10x Application Examples

4

Strong Devices● AP provides NDP & mic clock● NDP awakens AP with INT● AP collects match on SPI● AP optionally collects matched audio on SPI

SYNTIANT

NDP100

Application Processor

SPI

PCLK

INTMicrophone

PDAT

Active Audio Devices● AP streams audio over SPI● AP collects match on SPI

SYNTIANT

NDP100 Application Processor SPI

Microphone(s)INT

SYNTIANT

NDP101 SPI

GPIOSOther

Devices

Light Devices● SPI and GPIOs connect rest of system

MicrophonePCLK

PDAT


NDP100 Audio Neural Decision Processor

Features● 2 PDM microphones, I2S or PCM-over-SPI input● Frequency, time-domain & batch input models● 3sec 16-bit input audio holding tank● encoded ‘winner’, 1-bit & 8-bit outputs

Specifications

Classes 64

Parameters 560K

Max Frame Rate 200 Hz

Always-on Power 140µW

Applications● Keyword speech interface● Wake word detection● Speaker identification● Event detection● Other ‘low-speed’ tasks

5

VDD18

SPI Slave

Output Processing

Feature Extraction

Micro Controller

NDP100

PDAT/SDPCLK/SCK

VDD

GND

CLK

INT

Neural Network

AudioFront End

Holding Tank

SS

SCLK

MISO

MOSIProduction Now

NDP100 - WLBGA12

WS


Syntiant NDP10x Platform Demo

6

NDP101 QFN32 (5X5)NDP1001.4mm X 1.8mm

Alexa wake word with Music

http://www.youtube.com/watch?v=S_WkzfmPA_Q


Syntiant NDP10x Platforms

7

iRobot® Create 2 with voice

USB and M.2 Card

Mobile Phone

http://www.youtube.com/watch?v=aZqFxrk9tOc


Syntiant Alexa Wake Word Package

8

Syntiant’s close-talk audio lab

< 3 False accepts in 24 hours

FRR 0.00 at high SNR

FRR < 0.04 over range of 2 - 20 dB SNR

Tested under six noise conditions

Chips + wakeword package ready for Alexa integration


Syntiant Software

9

● Develop algorithms and training exactly as for idealized deployment● NDP parallelism ensures no performance artifacts of hardware mapping● Syntiant TDK packager collects neural network parameters for chip update

SYNTIANT

NDP

NN Parameterbinary package

Data

StandardFramework

SYNTIANT

TDK

Standard AlgorithmDevelopment & Training

NN Parameters

SYNTIANT TDK Packager

Customer Training

Syntiant Speech Service Alexa, OK,

up, down, mode, ....

CustomerVocabulary SYNTIANT

NDP

NN Parameterbinary packageSYNTIANT

Training


Syntiant Training Overview

10

Syntiant Keyword Speech Training Pipeline● applies best-known production deep neural network training practices● applies industrial-strength validation aligned with Amazon AVS chip qualification criteria● employs multiple layers of iteration

Deep Learning Shifts Solution Development From Algorithms to Analysis, Validation and Iteration

Data Preparation Modeling Analysis

Aug

men

tatio

n

Training

Data

Data Acquisition

Acq.App

3rd PartyData

QA

Labeling

Aug. Data

Aug. Algos

ValidationSignal

Noise

Model

Real World vs Model Correlation Feedback

Model Behavior Feedback

Production Model

Pass/Fail

LabeledData

RawData


Conclusion

▪ We have production silicon ready to deploy ML at the edge with a solid training pipeline

▪ Extremely powerful Neural Classifier ideal for Amazon AVS certification

▪ Optimized for voice, but ready for any sensors

▪ Programming model is straight from TensorFlow

▪ We are hiring!

11

for battery powered devices always-on artificial intelligence · wake word detection speaker...

Documents