Cosc 5/4730

Augmented Reality

What is Augmented Reality?

• Generally:– Using a phone/tablet/glasses/smartwatch/etc– And one more “sensors”• GPS

– Location and maybe proximity.

• Maps– Not necessary real maps, could be fake (say Middle earth)

• Camera– Not necessary to take pictures, but allowing graphics to

overlay the real world. Using the camera as a view finder.

• Internet

What is Augmented Reality? (2)

• Not to be confused with Virtual reality.– VR: You can tour a museum on your phone.• You use you phone to virtually walk through and see

the art. But you are not there.

– AR: You tour the museum• And you use the phone via the camera to have a guided

tour. As the camera “sees” a piece of art, then it explains about it.

Very Basic example

Note, the altitude is not correct. Should be around 7200

Examples of AR

• AR light version– Using GPS navigation. Your phone uses GPS to give you directions.

• AR version– GPS navigation with google street view, gps, and the camera to match

up everything and give you “walking” directions.• Hybrid: when the phone is face up, a map. When it is one it’s side, shows

directions via the camera with a graphic overlay.

• Yelp and AR– Using the camera, gps and graphic overlays, plus internet (ie yelp)– Hold up your phone and you see how many stars overlaying the view

of the street (assuming restaurants are in the picture of course).

Examples of AR (2)

• Night sky maps– Available for android and glass.– Using the view finder, and orientation of the

phone, plus a map of the night sky.– Shows you the names of stars/planets/other as

that object is the center of the screen.– Draws the constellations on the stars as well.

AR and games

• GPS pong– Your phone is the paddle, using the view finder you can

see the ball. You physically move to move the paddle• And more interesting your friend can be in other country

and still play against you.

– Flip the phone to face up, and you can see the playing field and location of the ball as well.

• AR “warm/colder”– Using the gps, proximity, and direction facing– You can play warmer/colder like games.

AR and games (2)

• Using Markers– Think QR, but instead things will appear on the markers

(graphic overlays) via the view finder.

– Play space invaders on your desk or race a car around all the stuff on your desk?• There are interesting options.

AR and games (3)

• Ingress– an augmented reality massively multiplayer online role playing

GPS-dependent game created by Niantic Labs– The gameplay consists of establishing "portals" at places of public

art, landmarks, cenotaphs, etc., and linking them to create virtual triangular fields over geographic areas.

– YouTube channel http://www.youtube.com/user/ingress – How to play: http://

www.youtube.com/watch?v=Y6-JAm3NCAk&list=PLDEUWItbkQ5_z4i_FBLfjEGOz9uyFZE4c&index=1

– Get the game: https://play.google.com/store/apps/details?id=com.nianticproject.ingress Also available for IOS.

AR and drawing

• Note, this 360 panorama picture. The stones are straight. The top and bottomare blurry. This only make sense when viewed as full 360 picture, instead as above. Think about a map of the earth. Best viewed as sphere, not flat.• The default android camera app should be able to take a 360 panorama. See the settings.

Source: NY Gantry Plaza, at night.

AR and drawing.

• Using the phone as a “brush” you can draw a 360 degree picture.– Move the phone around to draw/see the picture.

– Similar in nature to take a 360 panoramic photography.• Actually working on being able to draw on the 360

panoramic pictures as well.

More?

• I just scratched the surface of the possible apps.– You and your “phone” interacting with the “real

world”.

• Just remember to look up now and again, so you do not fall into a pond or walk into light pole.

QA&