spinnaker: a spiking neural network architecture...spinnaker racks (1m arm cores) • hbp platform...

13
SpiNNaker: A Spiking Neural Network Architecture Petruț Bogdan [email protected]

Upload: others

Post on 20-Jan-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

SpiNNaker: A Spiking Neural Network

ArchitecturePetruț Bogdan

[email protected]

Page 2: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Can massively-parallel computing resources accelerate our understanding of brain function?

Can our growing understanding of brain function point the way to more efficient parallel, fault-tolerant computation?

Chapter 1: Origin

Bio-inspiration

Page 3: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Chip resources

Chapter 2: The SpiNNaker Chip

Page 4: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

SpiNNaker Multicast routing

Chapter 2: The SpiNNaker Chip

Page 5: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

SpiNNaker racks

(1M ARM cores)

• HBP platform– 1M cores

– 11 cabinets (including server)

• Launch 30 March 2016– then 500k cores

– 112 remote users

– 6,103 SpiNNaker jobs run

SpiNNaker chip

(18 ARM cores)

SpiNNaker board

(864 ARM cores)

SpiNNaker machines

Chapter 3: Building the SpiNNaker Machines

Page 6: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Simulation

Computational Neuroscience

Theoretical Neuroscience

Neurorobotics

Application range

Chapter 5: Applications – Doing Stuff on the Machine

Page 7: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Focus: structural plasticity for motion detection

Chapter 7: Learning in neural networksBogdan et. al (2019, EMiT Conference) Bogdan (2019, Thesis)

Page 8: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Intuition

Page 9: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Intuition

Homogenous delays

Page 10: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Intuition

Heterogeneous delays

Page 11: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Structural plasticity in the wild

Page 12: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Summary• Building neuromorphic hardware to make computation

more efficient, and to advance our understanding of the brain

• SpiNNaker is a 1-million ARM core digital neuromorphic machine currently in use to explore theoretical and computational neuroscience simulations and neurorobotics applications

• Various models of synaptic and structural plasticity are and can be implemented on this platform; digital substrate offers flexibility in exchange for efficiency

• Structural plasticity is a cool learning mechanism that can be used to grow synapses with different synaptic delays to optimize neuron responses to movement

Page 13: SpiNNaker: A Spiking Neural Network Architecture...SpiNNaker racks (1M ARM cores) • HBP platform – 1M cores – 11 cabinets (including server) • Launch 30 March 2016 – then

Thank you!@pabmcr

[email protected]