prlab tudelft nl. what is the source of this magic? deep net has more parameters than the shallow...

Post on 22-Dec-2015

216 Views

Category:

Documents

2 Downloads

Preview:

Click to see full reader

TRANSCRIPT

PRLabTUDelftNL

PRLabTUDelftNL

What is the source of this magic?

Deep net has more parameters than the shallow net;

Deep net is deeper than the shallow net; Nets without convolution can’t learn what nets

with convolution can learn; Current learning algorithms and regularization

procedures work better with deep architectures than with shallow architectures;

All or some of the above; None of the above?

PRLabTUDelftNL

Do Deep Nets Really Need to be Deep

Lei Jimmy BaUniversity of Toronto

Rich CaruanaMicrosoft Research

arXiv:1312.6184 ?

top related