PowerPoint Presentation

Medical Augmented RealityChris TaccaBucknell University, 2018

What is Augmented Reality?

Augmented Reality: Technology that superimposes computer generated images onto a real world viewEx: Google Glass, Wikitude Mobile App

Augmented Reality Use in SurgeryAugmented Reality Assisted Surgery (ARAS): Superimposes a computer image onto the operative field to help guide the hands of the surgeon

Other Uses of Augmented Reality

Used in education, art, advertisements, gaming, and all different aspects of lifeThese are two examples of Augmented Reality use in advertisements

Image Processing in MatlabMatlabs Image Processing Toolbox allows users to read, modify, and display images

Matlab Graphical User Interface (GUI)GUIs: interfaces that use windows, icons, and menus which can be manipulated by a user to perform a taskExample of Matlabs GUI creation tool

Rotating Image in Matlab GUIMatlabs GUI tool can be used to create an interface for rotating an imageThis program uses a rotation matrix so that when the push button is pressed the image rotates

Stereoscopy

Stereoscopy: technique for creating the illusion of depth by putting two very similar but different images next to each otherViewers wear goggles to isolate the images to each eyeHere a photographer took an image of the same scene from two slightly different angles to create the stereoscopic image

Stereoscopy Continued

This diagrams how a stereoscopic image is created.

Examples of Stereoscopic Images

Using 3D Dataset in Matlab

Matlab can read in and interpret 3D datasets. Once the data is stored as a figure it can be manipulated using the image processing toolbox.The view can be adjusted to specific locations of horizontal rotation (az) and elevation (el). It can also be zoomed relative to its previous size.

Video on Matlab from FramesIn order to create a movie out of the 3D dataset the figure is saved at different locations along a path. These are the frames that can be put together into a movie

Stereoscopic Images from 3D DatasetStereoscopic images are made in Matlab by taking a figure and rotating it a certain degree to left and a certain degree to the right and combining those images side by side.

3D Cube VideoThis video combines the stereoscopic images into a video that appears to be 3D when viewing it with goggles.

Using OsiriX to Manipulate Image from CT ScanOsiriX is a program that reads medical images such as MRIs and CT scans more efficiently. The manipulation of the image works in the same way as Matlab by changing the rotation, elevation, and zoom as well as a pan.

Final 3D VideoThis video is made using the same method as the cube video.