gst, from sensor to decision - european...

11
GST, from Sensor to Decision Technology based on neuro-inspired algorithms: Embedded Systems based on the func2oning of the human brain for detec2on and object recogni2on. Mul2Media sound, images 2D, 3D,.. Videos Signals GST: Created in september 2011 12 persons (10 in R&D and 2 in Business) February 3rd 2017 Neuromorphic Compu2ng - Brussels 1 www.gsensing.eu

Upload: others

Post on 19-Jun-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

GST, from Sensor to Decision

Technology based on neuro-inspired algorithms: Embedded Sys tems based on thefunc2oningofthehumanbrainfordetec2onandobjectrecogni2on.

Mul2Mediasound,images2D,3D,..

VideosSignals GST:

Createdinseptember201112persons(10inR&Dand2inBusiness)

February3rd2017 NeuromorphicCompu2ng-Brussels 1

www.gsensing.eu

Page 2: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

2

Concerned Applications

Ø  Human-Machine-Interac7on(TV,computers,smartpads,…)

Ø  R o b o 7 c s , A u t o m o 7 v e(automated driving, objectdetec2on and target tracking inmovement,…)

ADAS(Advanced

DriverAssitantSystems)

Ø  Surveillance-Security indoor and outdoor (noveltydetec2on,facerecogni2on,tracking,…)

Ø  Produc7on automa7on (anomaly detec2on, productselec2on,iden2fica2on,…)

Ø  Homeautoma7on(peoplecoun2ng,preven2onoffallsforelderly,…)

February3rd2017 NeuromorphicCompu2ng-Brussels

Page 3: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

GST Technology:

Embedded Neuro-inspired Systems

February3rd2017 NeuromorphicCompu2ng-Brussels 3

Mul2Mediasound,images2D,3D,..

VideosSignals

Page 4: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

4 February3rd2017 NeuromorphicCompu2ng-Brussels

AvailableGSTSmartNeuroCam-1

BasedonNeuro-FPGA-1

XilinxSpartan6lx16

SDRAM512Mo

FTDIUSB

controller

CogniMemCM1K

1024neurons

ConfigROM

Configserialflash

4Moserialflashmemory

5xtestpoints 88I/O Externalsupply 4xLEDUSB

752x480pixels

ExposureTime:

100µsto20ms

Page 5: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

February3rd2017 NeuromorphicCompu2ng-Brussels 5

PNeuroaccelerator

Objec7ve:Designaprocessorintegra2ngwithinthesamechipsignalprocessingfunc2onsandneuralfunc2ons:ConvNet(CNN),Hmax,…

(JointLaboratoryCEA&GSTini2atedin2013)

………ClusterNeuroCores

DataIn(Signals,Images)

FromPreviousPNeuro

ToNextPNeuro

Classifica2onResult

PNeuro:ACascadableParallelArchitecture

ClusterNeuroCores

ClusterNeuroCores

Page 6: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

February3rd2017 NeuromorphicCompu2ng-Brussels 6

PNeuroacceleratoroverview

Page 7: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

•  Fully-programmableenergyefficienthardwareaccelerator•  DesignedforDNNprocessingchains

•  CNN,Hmax•  Suppor2ngtradi2onalimageprocessingchains(filtering,etc.)

•  ClusteredSIMDarchitecture•  Op2mizedoperatorsforMAC&NL-approxima2on•  Op2mizedmemoryaccessestoperformefficientdatatransferstooperators•  ISAincluding~50instruc2ons(control+compu2ng)

•  Programmingtoolsunderdevelopment•  Libraryincludingmost-commonkernelswithassociatedparameters(convolu2on,

maxpooling,fully-connectedlayers)toeaseprogramming•  BasedonN2D2placormwithdedicatedexportsforPNeuro

PNeuroaccelerator:MainSpecifica7ons

NeuromorphicCompu2ng-Brussels

Page 8: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

•  Firstdemonstra7ononaFPGA-basedPNeurousingConvNet(CNN)•  Singleclusterconfigura7on(4Neuro-Cores)•  EmbeddedCNNapplica2on(60neuronsonthehiddenlayer,450KOps)

•  Facesextrac2on,18000images(48x48pixels)onthedatabase,96%recogni2onrate•  Sameapplica2onportedon5differentarchitectures

•  EmbeddedCPU:RaspberryPI2B,OdroidXu3•  EmbeddedGPU:NVidiaTegraK1(batch)•  DesktopCPU:IntelI7•  PNeuro,QuadNeuro-Cores

•  UsingaCEAcustomprototypingboard

•  FPGAapproachisalreadycompe77vewithexis7ngCPU&GPUsolu7ons•  FPGAproductdevelopedforearly2017byGST(NeuroFPGA-2board)

•  EmbeddedFPGA:Ar7x100(~1W),17.6cm²fortheboard,includingonecluster

Target Freq(MHz)

EnergyEff.(Images/s/W)

Perf(Images/s)

IntelI7 3400 160 5800

QuadARMA15 2000 350 860

QuadARMA7 900 380 480

TegraK1 850 600 3550

PNeuro(FPGA) 100 2000 4960

PNeuroonFPGA

NeuromorphicCompu2ng-Brussels

Page 9: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

•  Caracteriza2onchipinfabrica2on(tapeoutendofjune2016)inFDSOI28nm

•  Peakperformancesupto1.8TOPS/W@500MHz

•  0.4mm² for a single cluster and its control,w i th a power consump2on under35mW@500MHz

•  ASICEVALUATION

NeuromorphicCompu2ng-Brussels

Page 10: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

GST Roadmap

10

ConvNetHmax

1DSignals2D&3DImagesMul2mediaDataDatamining

Smartphone&Cloudà2015…

EmbeddedprocessorPNeuroà2016-2017

Workingsta2ons(PC,Mac)à2012…

EmbeddedSystemNeuroFPGAà2012….

February3rd2017 NeuromorphicCompu2ng-Brussels

Page 11: GST, from Sensor to Decision - European Commissionec.europa.eu/.../2017-8/11_paindavoine_michel_-_gst... · GST Roadmap 10 ConvNet Hmax 1D Signals 2D & 3D Images Mul2media Data Data

For further information or video examples, visit our website

www.gsensing.eu

GSTSalesSalesDepartment23,ruePaulBert

92100Boulogne,FranceTel.:[email protected]

GSTHeadquarterTechnicalDepartment

14,ruePierredeCouber2n21000Dijon,Francewww.gsensing.eu

February3rd2017 11NeuromorphicCompu2ng-Brussels