augmented reality browser-traipse · 3.3. android studio android studio [11], is an official...

AUGMENTED REALITY BROWSER-TRAIPSE

Shraddha S. More1, Sejal Chaudhari 2, Tejal Girase 3, Saloni Wade4

1,2,3,4Department of Information Technology 1,2,3,4St.John College of Engineering and Management, Palghar, India

[email protected], [email protected], 3tejalgirase03gmail.com, [email protected]

Abstract: The current generation browser hardly helps us to see the virtual objects floating in the real world. The virtual reality provides innovative ways to make this browser more seamless and attractive. The proposed system is designed to provide users with the opportunity to experience interactive content navigation. In this users can receive all relevant information about the locations they want to visit. With the support of image and object labels, the users can get suggestions. The system even allows the user to scan for historical information about a particular place. Therefore an AR browser is an alternative to a web browser in augmented spaces that intensifies the tourism industry.

Keywords: Augmented Reality, Navigation, Tourism, Floating virtual

objects.

I.INTRODUCTION Augmented reality browser has become a vital resource with the rise in the

tourism industry. The travel industry has a lot to gain from the AR boom as 84

percent of consumers around the world would be interested in using AR as part

of their travel experiences and 42 percent believe that AR is tourism 's future.

Most of the public feel lost any time they visit some new location. They

sometimes come across areas they don't know what it is about. The biggest

obstacle to seeking guidance from the local people on the places to visit is also

in the new place language. Again, it is difficult to afford a tour guide to any

international city[1]. Augmented reality blends actual and computer-based

images and scenes to provide a seamless and enhanced world view [2].

Augmented Reality is a technology that uses computer graphics to superimpose

virtual objects for user interaction on real world images. Its mode of operation

consists of calculating a video device's location and angle by real-time

positioning or image processing, and then superimposing a virtual model and

details on the real world image [3]. The purpose is to pose virtual objects

through a video system in the real world scene and enable users to interact with

it.

II. LITERATURE REVIEW The major objective of this section is to get accustomed with the theme by

considering the analytical work done by former researchers. The following

Compliance Engineering Journal

Volume 11, Issue 5, 2020

ISSN NO: 0898-3577

Page No: 331

segment provides various algorithms and technologies used by former authors

that provides incentive to the present field.

In 2011, Mulloni A. et al.[4] Provided with the Augmented Reality

functionality imported into the cell phones. Since we know that everything is

progressing and there is nothing that can't be done without the use of mobile

phones, so how Augmented Reality can fall behind in this. This paper, together

with the Increased Conversion into Phones, also offers a secure tracking

orientation that improves the user experience that helps us draw more users to

this technology. In 2012, Raphael Grasset et al. [5] described visual saliency

algorithm and visual management technique that helps improvise proper

labeling. In an Augmented Reality browser, there is a possibility that some

labels may overlap when a particular location is scanned or that they will not

use proper image region and geometric constraints to display labels that may

create confusion for the user. This paper therefore uses the algorithm and novel

view control technique to solve this problem, so that the application can have

proper marking and the best user interface. In 2014, Tamas Matuszka et al. [6]

described Mobile AR. Mobile Augmented Reality browser's main objective is

to help navigate the users around the world and gather local-aware information.

The information in this paper is extracted from the well-known semantic

dataset, namely DBpedia, which contains Wikipedia knowledge in semantic

form. Coordinates of latitude and longitude of various locations are available in

the DBpedia which can be used as source of geographical data. A sensor-based

approach to monitoring was paired with the DBpedia RDF processing. The

GPS(Global Positioning System) is used to locate objects on Earth's entire

surface. The satellites around the world are backing it. The phone downloads

the satellites' orbital location, and then the weaker receiver will locate them

faster. In 2014, Langtoz T. et al. [7] Defined about database registration using

different features. Since we know that designing a system with Augmented

Reality is not an simple task, but one of the most difficult tasks is to register a

database that is the center of the system without which it is not possible to

develop this system, this paper allows us to register a database with or without

prior knowledge of the database. The other features that it focuses on are GPS-

tagged content and hybrid tracking that contribute to the system's extension. In

2016, Fatma Meawad [8] Stated about a multimodal navigation system that

allows the development of POI's (Points of Interest) insitu material. It discusses



ISSN NO: 0898-3577

Page No: 332

the framework that expands current crowd-based geo-tagged data, which for

example applies metadata to different media for geographical identification.

The photograph or video is geo-tagged. It overcomes mobile augmented reality

problems, such as noisy sensor data, restricted display and lack of relevant data.

III. TECHNOLOGIES USED

3.1. Mapbox

Mapbox [10], is an open source stage utilized for mapping which gives

highlights to specially crafted maps. Mapbox have various assortments of APIs

and SDKs which are building squares which coordinate area with a portable or

web application. It gives distinctive area and maps to the designer which makes

it simple for engineer to build up any area based application. It gives exact area

information and ground-breaking engineer instruments which can change the

route understanding. The APIs, SDKs and constant refreshing guide gave by the

mapbox gives instruments which can fabricate better mapping, navigation and

search understanding across various stages. The maps of mapbox gains from

application in which they are incorporated. They utilize constant information

from 600 million MAUs to give gigantic measure of information ordinary so

the engineers get ongoing exact information which can be utilized across

various stages. It additionally gives the architect highlights which empowers

them to structure the world at 60 edges for every second. It gives full command

over hues, textual styles camera points and so on. The creators can do anything

by utilizing all the highlights gave by mapbox which will make the guide or

route or any application so far as that is concerned progressively alluring.

Basically, Mapbox gives various maps, constant information, structuring

ability, Augmented reality route with the goal that the designer can make the

application may it be portable application or web application increasingly

appealing just as progressively exact and simpler to utilize.

3.2. Vision SDK

Vision SDK [8], is one of the SDK provided by mapbox which has capability



ISSN NO: 0898-3577

Page No: 333

to turn any camera may it be the inbuilt camera of any mobile phone or any

other USB camera into an AI-powered camera. The Vision SDK is a modular

platform which has capabilities of fleet management, ADAS and Augmented

Reality. Mapbox vision SDK is based upon computer vision algorithms which

are optimized for recent driving application or navigation application which

includes automotive systems, dashcam and mobile phones. The vision SDK has

a modular architecture which puts the developers in the driver’s seat in any

application which has AR navigation or ADAS feature. It helps to build heads

up navigation with custom made object and turn-by-turn navigation. Smart

alerts can be sent by integrating vision SDK into the dashcam or mobile app.

Alerts for speeding, tailgating, rolling stops and other risky driving behaviors

can be customized.

3.3. Android Studio

Android studio [11], is an official integrated development environment for

Android operating system which is built on JetBrains IntelliJ IDEA software

which is specifically designed for android development. Android Studio

provides gradle-based build support along with android specific refactoring and

quick fixes. It also has inbuilt support for google cloud platform and also it

allows developers to integrate the application with Firebase. Also, it helps the

developer to design rich layout editor which allows the developer to easily drag

the component and drop it on the desired position along with easy option to

preview the layouts of the designed application. Android studio has the android

virtual device (Emulator) which helps to run and debug apps in android studio

itself. Android studio supports all the programming languages of IntelliJ viz.

Java, C++, Kotlin etc. It is very convenient for the developers to develop apps

using android studio because of its variety of features given by the android

studio.

3.4. Adobe Illustrator

Adobe Illustrator [12], is used for vector graphics editing. It is developed by

adobe Inc. It was originally designed by Apple Macintosh. SVG (Scalable



ISSN NO: 0898-3577

Page No: 334

vector Graphics) is the native format of Ink-scape is supported by Adobe

illustrator. But these two implementations are not 100% compatible with each

other. Illustrator can recognize formats such as PS, EPS and PDF format which

is exported by Ink-scape. The side bar present on the left of the screen has

variety of tools which enables the user to select, create and manipulate objects

or artworks in illustrator. All the tools can be selected for different operations

which includes drawing, typing, reshaping, painting, slicing and cutting,

symbolism, moving and zooming and graph. There is a small triangle at the

bottom right if the toolbox icon which has the option to expand some hidden

tools by hold down the mouse button on the triangle.

IV. RESEARCH METHODOLOGY

The proposed system aims to provide the consumer with all relevant details

about the location he / she wants to visit, and also time management is an

important factor that is taken into consideration during the implementation of

this process.

For reference, if the user clicks on the cafe icon, he / she will get close by cafes

suggestions based on position on the marker. When the user needs specific

details about the location, he / she can scan the monument or building and the

system will include all the details about the scanned object on the marker that is

easy for the user to read after the scan has been completed.

4.1. Architectural of the proposed system

To locate a Global Positioning System device, a minimum of three satellites

should be considered and each satellite would form a radius of its reach where

in the radius would create a sphere and the location at which the sphere of each

satellite collides would be the actual location of the GPS handheld device.

This whole system is based solely on two most essential modules as shown in

Figure1 below.

4.1.1 Satellite: The satellite would form a trilateration and find the co-ordinates

of the location where user is currently present.



ISSN NO: 0898-3577

Page No: 335

4.1.2 User’s phone with application and camera: User will have a phone that

would be enabled with an application, which would get all the information

regarding the place user want to visit.

Figure 1. The block diagram of the proposed system.

The working of the proposed system includes:

1. To check for all the permission like camera, internet and location whether they

are granted or not.

2. Start the vision SDK.

3. There is requirement of three coordinates, which are: Frame co-ordinates,

World co-ordinates and Geo co-ordinates.

4. Further, translate co-ordinates from one system to another using the class vision

manager.

a. geoToWorld (): Converts the location of the point from a geographical

coordinate to a world coordinate.

b. worldTopixel (): Converts the location of the point from a world coordinate to a

frame coordinate.

c. pixelToworld (): Converts the location of the point from a frame coordinate to a

world coordinate.

d. worldTogeo (): Converts the location of the point from a geographical

coordinate to a world coordinate.



ISSN NO: 0898-3577

Page No: 336

5. In order to calculate the Point of Interest (POI) position using all the

coordinates, we use the following formula

i.e. given as,

d = √(𝒙𝟐 − 𝒙𝟏)𝟐 + (𝒚𝟐 − 𝒚𝟏)

𝟐 (1)

Above Formula is the Euclidean Formula for Two Dimensions where 𝒙𝟏 and

𝒙𝟐 are the latitudes whereas, 𝒚𝟏 and 𝒚𝟐 are the longitudes of the specific

location of the objects for which POI’s are calculated.

6. To filter the POI from distance to vehicle, there is given condition which is

use.,

• If d<1000, add the location of destination into an array.

7. Thus, the POI is drawn on the specific position. POI Mapping is referred to data

set that is quick, easy and accurate way to populate the mapping project with

important places of feature/buildings/ landmarks.

V. RESULTS AND DISCUSSION

In the proposed system, first, the user must appear on the screen when he / she

opens the application as shown in Figure 2. It represents the image that will be

shown when the application is opened. The screen provides the user with the

Login option if the user has already registered the login option shown in the

figure. 3, and if the user is new, he / she will be able to register by clicking

on the Sign-up button, which will take them to the sign-up page as shown

in the figure. 4

Figure 2. Main screen



ISSN NO: 0898-3577

Page No: 337

After logging in, the user will be set to the current location. As shown in

Figure.5 , additional users will be provided with a list of icons to search

according to their relevance. It shows the screen where the user has all the

options, he /she wants to access. The icons are restaurants, cafes, hospitals,

movies, ATMs, pharmacies, shopping centers, petrol pumps, etc.

Figure 5. Icons screen

Figure 3. Log-in screen Figure 4. Sign-up screen



ISSN NO: 0898-3577

Page No: 338

Figure. 6, shows the screen where the user can reset the password if they

forgetto use their registered email address. The user will receive an email with a

password reset link so that they can change the password. Figure. 7, shows

the screen where the user can logout from the account, they've logged

in. They'll get a button next to it to review their history if they want to.

Here are a few screenshots added concerning the operation of a Traipse

application and are as follows:

Figure 6. Forgot password screen Figure 7. Log-out screen

Figure 8.Output of Pharmaceuticals Figure 9. Output of Hospitals



ISSN NO: 0898-3577

Page No: 339

Figure.8, displays all nearby pharmaceuticals available at the current location

of users. Figure.9, in the same way displays all nearby hospitals available to

the user according to their current location. Figure.10, displays all the ATMs

that are available to the user. These are the final results that the user will get by

clicking on the icon. So,based on the current location of users, they will receive

popups or suggestions for the category they have chosen.

VI. CONCLUSION AND FUTURE WORK

With the help of the Android Open Source Platform and Mapbox, the proposed

"Augmented Reality Browser-Traipse" application is being developed to

enhance the tourism industry. The system is very useful for the tourist, as the

traveller can go along with the system wherever he / she needs it. This

application hastens feedback in real time by providing a lot of visual, location,

direction and acceleration related information. In addition to this system, the

user 's security parameters would be included. Application will also become

independent from the platform. In the future, we are planning to integrate AR

navigation along with the project, so that whenever the user gets suggestions for

locations according to their location, they can simply tap on that addition and

get details about the location and the option to navigate from their current

location to the destination they have chosen.The other functionality that we plan

Figure 10. Output of ATMs



ISSN NO: 0898-3577

Page No: 340

to integrate is to scan the location. Whenever a person travels to a new

location and finds some historic building or monument around him that he does

not know about, at that time he can simply use the app and scan that location

to get all the detailed information about it.

REFERENCES [1] R. Grasset, T. Langlotz, D. Kalkofen, M. Tatzgern, and D. Schmalstieg, ‘‘Image-driven view

management for Augmented Reality Browsers,’’ In Proc. IEEE International Symposium. Mixed

Augmented Reality, pp. 177–186, November (2012).

[2] Matuszka T., Kámán S., Kiss A., “A Semantically Enriched Augmented Reality Browser,”

In: Shumaker R., Lackey S. (eds) Virtual, Augmented and Mixed Reality (VAMR), Lecture

Notes in Computer Science, vol. 8525. Springer, Cham, March (2014).

[3] Fatma Meawad, “InterAKT: A Mobile Augmented Reality Browser for Geo-Social

Mashups,” In 4th International Conference on User Science and Engineering, Volume 4, (2017).

[4] Langlotz T., Nguyen T., Schmalstieg D., & Grasset R. “Next-Generation Augmented Reality

Browsers: Rich, Seamless, and Adaptive,” In Proceedings of the IEEE, Vol. 102, No. 2, pp. 155-

169, February (2014).

[5] Mulloni A., Seichter H., & Schmalstieg D. “User experiences with augmented reality aided

navigation on phones,” In 10th IEEE International Symposium on Mixed and Augmented Reality,

(2011).

[6] Matuszka T., Kiss A., “Alive Cemeteries with Augmented Reality and Semantic Web

Technologies,” In Proceedings on ICHCI, (2014).

[7] Zander S., Chiu C., Sageder G. “A computational model for the integration of linked data in

mobile augmented reality application.” In Proceedings of the 8th International Conference on

Semantic Systems, pp. 133-140, (2012).

[8] Vision SDK for Android by Mapbox, [Online] Available:

https://docs.mapbox.com/android/vision/overview/, Accessed on January 10, (2020).

[9] Drawing Points of Interest for Android by Mapbox, [Online] Available:

https://docs.mapbox.com/help/tutorials/android-vision-poi-drawing/, Accessed on January 15,

(2020).

[10] Definition of Mapbox by Eric Gunderson, [Online] Available: https://www.mapbox.com/,

Accessed on January 3, (2020).



ISSN NO: 0898-3577

Page No: 341

[11] Android Studio by Google and JetBrains’, [Online] Available:

https://developer.android.com/studio, Accessed on October 20, (2019).

[12] Adobe Illustrator by Adobe Inc., [Online] Available:

https://en.wikipedia.org/wiki/Adobe_Illustrator, Accessed on October 24, (2019).



ISSN NO: 0898-3577

Page No: 342

augmented reality browser-traipse · 3.3. android studio android studio [11], is an official...

Documents