ase 2014 augmented reality teaching

U N IV E R S ITAT D E B A R C E L O N AU

B1

Unitat de Farmacologia i Farmacognòsia - Facultat de Farmàcia

AugmentedRealityTeachingDr. Francisco Pérez GarcíaHead of Technology Dept. , Pompeu Fabra High School, MartorellHead of i-Campus Project, University of Barcelona, Barcelona

ASE Conference University of Birmingham, 9th January 2014


B2

Dr. Francisco Pérez García - Institut Pompeu Fabra

The author respects article 32 of the Spanish Law of Intellectual Property to use images and other materials contained in this presentation.The Berne Convention provides for a specific exception to allow uses of copyrighted works for the purpose of teaching:“ Art.10.2.-It shall be a matter for legislation in the countries of the Union, and for special agreements existing or to be concluded between them, to permit the utilization, to the extent justified by the purpose, of literary or artistic works by way of illustration in publications, broadcasts or sound or visual recording for teaching, provided such utilization is compatible with fair practice”


B3


Contents of this presentation

1. Augmented reality (AR) as a disruptive technology?2. Level 0: AR with no programming knowledge

a) App: Google Googles (QR and GeoWeb)b) Online: www.learnar.orgc) Free software: BuildAR

3. Level 1: AR with minor programming skillsa) Open Source software: processing 2b) libraries NyAR4psg, OBJLoader, etcc) Online: Create 3D objects

http://www.123dapp.com/catch4. Level 2: AR with programming skills: Google Glasses

http://www.learnar.org/

http://www.123dapp.com/catch





B4

Augmented reality

A disruptive technology?Lavandula angustifolia Something that generates a very

important change



B5

Augmented reality

A disruptive technology?Lavandula angustifolia Something that generates a very

important change



B6

Level 0

Level 1

Level 2

LEVEL OF PROGRAMMING SKILLS REQUIRED TO CREATE AUGMENTED REALITY APPLICATIONS

Programming skills

Higher

Lower


http://www.google.es/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=oXm48aKHgjc4OM&tbnid=b3zJVcnX3j6wwM:&ved=0CAUQjRw&url=http://www.realareal.com/learnar-elearning-with-augmented-reality&ei=0qjGUq34EcK30QXzg4HIDQ&bvm=bv.58187178,d.d2k&psig=AFQjCNHkp0QjUKkU_VPdiM83eQXBhRfz0Q&ust=1388837431417128

http://www.google.es/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=Z4vsC5Yk6sn2bM&tbnid=d23-6FWEi4dWhM:&ved=0CAUQjRw&url=http://www.realareal.com/hit-lab-nz-buildar-competition&ei=cyLHUvzlEMaN0AXH1ID4DQ&bvm=bv.58187178,d.d2k&psig=AFQjCNEOk8_tpYdP9_m4iIxehaSmAMOxEg&ust=1388868587563046


B7

Types of Augmented Reality

Trigger by

Hiperlinks in the real world

QR

Marker based augmented reality

Markers

Markerless augmented reality

Objects or pictures

Geoweb-Internet of places Objects and GPS positionInternet of things Sensors, objects and GPS



B8

Level 0 AUGMENTED REALITY: QR CODE

http://www.goqr.me (among many other ways to generate QR)Zint Barcode Generator


http://www.goqr.me/


B9



B10



B11



B12



B13

Internet of places - GeowebDr. Francisco Pérez García - Institut Pompeu Fabra


B14



B15


http://www.learnar.org AUGMENTED REALITY WITH A BROWSER AND MARKERS

http://www.learnar.org/


B16



B17



B18



B19



B20



B21



B22



B23



B24


http://6007.stem.org.uk Gravity, Bugs, Sounds and Materials

http://6007.stem.org.uk/


B25

Creating book with Augmented Reality with www.zooburst.com



B26

Download Build AR free version at http://www.buildar.co.nz/home/download/?did=6

Two examples in the next slides


http://www.buildar.co.nz/home/download/?did=6



http://www.google.es/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=Z4vsC5Yk6sn2bM&tbnid=d23-6FWEi4dWhM:&ved=0CAUQjRw&url=http://www.realareal.com/hit-lab-nz-buildar-competition&ei=cyLHUvzlEMaN0AXH1ID4DQ&bvm=bv.58187178,d.d2k&psig=AFQjCNEOk8_tpYdP9_m4iIxehaSmAMOxEg&ust=1388868587563046


B27

http://www.arined.org/ARfiles/Final_lecture_AR_Text.pdfMovement to understand eclipse


http://www.arined.org/ARfiles/Final_lecture_AR_Text.pdf

http://www.arined.org/ARfiles/Final_lecture_AR_Text.pdf


B28

http://www.buildar.co.nz/buildar-showcase-2/Movement to understand Stirling engine


http://www.buildar.co.nz/buildar-showcase-2/

http://www.buildar.co.nz/buildar-showcase-2/


B29

Students using technology or students creating technology?Dr. Francisco Pérez García - Institut Pompeu Fabra


B30


TO CREATE AUGMENTED REALITY APPS WE NEED CREATIVE STUDENTS…


B31


WITH COMMON HARDWARE, AND…


B32


SOME SOFTWARE, AND PROGRAMING SKILLS?


B33



B34



B35


Processing

Open Source softwareDerived from JavaMany available examplesMany contributed libraries: for Arduino, 3DObject, QRCode, Box2D for games, Open Computer Vision, for Augmented Reality like NyAR4psg or NyAR2, etc.


B36

Marker augmented reality(NyAR4psg, NyAR2 libraries)

Markerless augmented reality(OpenCV library)

Loading 3D objects(Saito OBJLoader library)

QR code library

Data communication(libraries for SMS,SQL databases,…)

Machine learning(Gnet library)

Arduino library(http://tecnologies.net/?page_id=206)


Games (pBox2D library)

Lego robots(NTXcomm library)

http://www.google.es/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=zs67oyMVLv55hM&tbnid=eQ9uTZV5mKobkM:&ved=0CAUQjRw&url=http://arduino.cc/en/Main/ArduinoBoardTre&ei=pr7GUofsJaHU0QXwn4HwCg&bvm=bv.58187178,d.d2k&psig=AFQjCNFHoHfKdE4Sh8_EoXBTXmo5WTPdkw&ust=1388843006170968


B37



B38

AUGMENTED REALITY MARKERS



B39



B40



B41

We need extra libraries and programs to start executing augmented reality code with Processing:

• Libraries

GSVideo

http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0 OBJLoader

https://code.google.com/p/saitoobjloader

/ Nyar4psg-1.3.1

http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=8920

• Programs

QuickTime

http://www.apple.com/es/quicktime/download

/

WinVDIG

http://www.eden.net.nz/7/20071008/


http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0

http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0

https://code.google.com/p/saitoobjloader/













http://www.apple.com/es/quicktime/download/






B42

Quicktime 7:http://www.apple.com/ca/quicktime/download/



http://www.apple.com/ca/quicktime/download/






B43

http://sourceforge.net/projects/gsvideo/files/gsvideo/1.0/

GSVIDEO LIBRARY (ONLY FOR PROCESSING 1.5.1)



B44


MAIN AR LIBRARY FOR PROCESSING: NyAR4psg



B45

http://cpbotha.net/files/nyar4psg_multimarker/

MULTIMARKER LIBRARY FOR AUGMENTED REALITYUSING PROCESSING








B46

http://code.google.com/p/saitoobjloader/downloads/list











B47

WHERE WE HAVE TO PUT THE EXTRA LIBRARIES

Libraries: Inside processing (modes>java>libraries)



B48

Programs: At the same folder than processing

WHERE WE HAVE TO PUT THE EXTRA PROGRAMS



B49

SIMPLELITE.PDESIMPLEST CODE FOR AUGMENTED REALITY

USING PROCESSING



B50

CODE CHANGES IF GSVIDEO LIBRARY IS USED

import processing.video.*; //core libraryimport codeanticode.gsvideo.*; //gsvideo contributed library

Capture cam;GSCapture cam;

cam=new Capture(this,width,height);cam=new GSCapture(this,width,height);

cam.start();



B51



B52



B53



B54



B55


CREATING 3D OBJECTS FROM PHOTOGRAPHS


B56



B57



B58


Creating 3D objects withwww.blender.org

www.sketchup.org

http://www.blender.org/

http://www.sketchup.org/


B59

http://flash.tarotaro.org/ar/MarkerGeneratorOnline.swf



B60

http://www.brosvision.com/ar-marker-generator/








B61

Online quiz about processing:http://blocs.xtec.cat/pile/2013/05/quiz1.swf



B62

Computer vision OpenCV library + Processing 2.1



B63

Level 2. AR WITH GOOGLE GLASSES



B64



B65



B66



B67


Woodpecker images from @tecnotic


B68

THE INTERNET OF THINGS

I detected a weigth of 60.4kg

My sensor measured 70.2kg

John and Anne are getting fat. I

must send a message now


John’s seat

Anne’s seat


B69

References

http://www.tecnologies.net http://www.processing.orghttp://www.learningprocessing.com/http://www.openprocessing.orghttp://www.creativeapplications.net/category/processing/https://www.coursera.org/course/digitalmedia


http://www.tecnologies.net/

http://www.processing.org/

http://www.learningprocessing.com/



http://www.openprocessing.org/

http://www.creativeapplications.net/category/processing/

http://www.creativeapplications.net/category/processing/

https://www.coursera.org/course/digitalmedia

https://www.coursera.org/course/digitalmedia


B70



B71

MOOC from University of London about www.processing.org



B72



B73

http://www.wiley.com/WileyCDA/WileyTitle/productCd-1118036638,miniSiteCd-SYBEX,descCd-DOWNLOAD.html



B74

ACKNOWLEDGEMENTS

-To the Government of Catalonia, Department of Educationfor the school innovation project “Technological Creativity” atPompeu Fabra High School-To the University of Barcelona for the innovation project “i-Campus”



B75

THANK YOU VERY MUCH FOR YOUR ATTENTION

QUESTIONS?


ase 2014 augmented reality teaching

Education

u25u n iv e r s itat

u9u n iv e r s itat

u10u n iv e r s itat

u11u n iv e r s itat

u12u n iv e r s itat

u14u n iv e r s itat

u16u n iv e r s itat

u17u n iv e r s itat