Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

@DocXavi

Deep Learning for Computer VisionBeyond vision 5 May 2016

Xavier Giró-i-Nieto

Master en Creació Multimedia

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)2

When robots open their eyes...

...is because they have learned to see.

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learning only to see ?

Nexi, del MIT Media Lab (Foto: Spencer Lowel)

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Big data

Internet of things - IoT

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Personal data

Big data

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Atlas, de Boston Dynamics

Robust manipulation and motion

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Playing with other computers

Learning only to see ?

Mnih, Volodymyr, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. "Playing atari with deep reinforcement learning." arXiv preprint arXiv:1312.5602 (2013).

DeepMind

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Playing with humans

AlphaGo (Google DeepMind)

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Autonomous Driving

Google Self-driving car

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Visual arts

Google Research, “Going deeper into neural networks” - DeepDream (2015)

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Google Research, “Going deeper into neural networks” - DeepDream (2015)

Visual arts

Only open their eyes ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

http://turing.deepart.io/

Visual arts

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Music composition

Manuel Araoz, “Training a Recurrent Neural Network to Compose Music” (2016).

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Poetry

Ross Goodwin, Neuralsnap (2016).

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

“Scripts” (!?)

Darknet

JONHe leaned close and onions, barefoot from his shoulder. "I am not a purple girl," he said as he stood over him. "The sight of you sell your father with you a little choice.""I say to swear up his sea or a boy of stone and heart, down," Lord Tywin said. "I love your word or her to me."

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Public Health

Announcement of Google DeepMind Health (24/02/2016)

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Nacho Hernandez, “Why artificial intelligence will democratize healthcare” (TEDx Talk, 2014)

Public health

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Nancy Lublin, “The heartbreaking text that inspired a crisis helpline” (TED Talk 2015)

Mental health

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Psychological support and counseling ?

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)20

Affective computing

Rana el Kalioubi, “This app know how you feel, from the look on your face”, TEDTalks 2015.

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)21

Nexi Project, from MIT Media Lab (Photos: Spencer Lowel)

[video]

Affective computing

Learning only to see ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

“Google’s chairman (Eric Schmidth) thinks artificial intelligence will let scientists solve some of the world’s "hard problems," like population growth, climate change, human development, and education.” (Bloomberg Business, 11/01/2016)

[+info @ MIT Technology Review]

Artificial intelligence

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Google’s CEO Sundar Pichai: “Era Of Computers Will End Very Soon, AI Will Rule” (Fossbytes, 03/05/2016)

Artificial intelligence

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Jeremy Howard, “The wonderful and terrifying implications of computers that can learn”, TEDTalks 2014.

Artificial intelligence

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Artificial intelligenceStephen Hawking, “Artificial intelligence could spell out the human race.” (2014)

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Artificial intelligence

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Elon Musk (Tesla), one of OpenAI promoters

Artificial intelligence

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Neil Lawrence, OpenAI won’t benefit humanity without open data sharing (The Guardian, 14/12/2015)

Phd Comics: Who owns your data ? (Hint: it is not you)

Artificial intelligence

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)29

Xavier Sala-i-Martin (Columbia University), “Les conclusions del Fòrum de Davos”

(TV3, 03/02/2016) - in Catalan

Carles Boix (Princeton University), “La quarta revolució industrial”

(Diari Ara, 08/02/2016) - in Catalan

Artificial intelligence

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Artificial intelligenceOpen question: in which jobs will robots replace humans first ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)31

Source: 25 Best jobs in America (Glassdoor)

Data scientist.

The best job in the world ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)32

The best job in the world ?

Summer internships for Phd students related to Data Analytics.

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)33

The Economist, “Million-dollar babies” (02/04/2016)

The best job in the world ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)34

Nature, “AI talent grab sparks excitement and concern” (26/04/2016)

The best job in the world ?

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learn more with Nat & Lo 20% Google Project:

Learn more

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learn more● Friendly slides for dissemination (family & friends).

[Available on slideshare.net]

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learn more● Presentació amigable per a familiar i amics.

[Disponible a slideshare.net]

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learn moreKeras http://keras.io/Tensor Flow https://www.tensorflow.org/Caffe http://caffe.berkeleyvision.org/Torch (Overfeat) http://torch.ch/

Theano http://deeplearning.net/software/theano/MatconvNet (VLFeat) http://www.vlfeat.org/matconvnet/CNTK (Mcrosoft) http://www.cntk.ai/MxNet: https://github.com/dmlc/mxnet

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learn more

Source: @fchollet

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)40

?

Learn more

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)41

Learn morehttp://cs231n.stanford.edu/

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)42

Learn more

“Machine learning” sub-Reddit.

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)43

Learn more

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)44

Learn more

Grup d’estudi de machine learning Barcelona

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)45

Learn more● Reading Group with public listing of videos, slides and papers.

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

More details on the website by Professor Jordi Torres.

Learn more

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learn more

[Website]

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Learn more

[Website]

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Conclusions

49

Xavier Giró i Nieto, “Deep learning beyond vision”. Master in Multimedia, La Salle URL (May 2016)

Thanks a lot !

50

Slides available at:

https://imatge.upc.edu/web/people/xavier-giro

@DocXavi

/ProfessorXavi