augmented reality in industry 4.0

AUGMENTED REALITY IN INDUSTRY 4.0: ENABLING TECHNOLOGIES AND THE

POTENTIAL FOR SMEs

GULAY EKRENSinop University

BIRGIT OBERERSakarya University

ALPTEKIN ERKOLLARSakarya University

Co-workers

Alptekin ERKOLLAR, Phd

Sakarya University, TURKEY

Faculty of Management, Department of Management Information Systems

erkollar@sakarya.edu.tr

Birgit OBERER, Phd

Sakarya University, TURKEY

Faculty of Management, Department of Management Information Systems

oberer@sakarya.edu.tr

Gülay EKREN, Phd Student

Sinop University, TURKEY

Departmant of Computer Technologies, Vocational School of Ayancık

gekren@sinop.edu.tr

Intr

od

uct

ion • Industry 4.0 (I4.0)

• I4.0 required• advanced technologies (e.g. artificial intelligence,

robotics, 3D printing) and business models• a high level of maturity

• small and medium-sized businesses (SMEs)• face difficulties in adopting Industry 4.0 ideas• hesitant to invest in new technologies (QR codes,

RFID tags, AR markers etc.)

Intr

od

uct

ion • Augmented Reality (AR)

• plays a significant role in industrial environments

• support and facilitating opportunities for SMEs

• new technologies should be developed for SMEs in coming years

Aim

s• Industry 4.0 (I4.0)

• I4.0 required• advanced technologies (e.g. artificial intelligence,

robotics, 3D printing) and business models• a high level of maturity

• small and medium-sized businesses (SMEs)• face difficulties in adopting Industry 4.0 ideas• hesitant to invest in new technologies (QR codes,

RFID tags, AR markers etc.)

• This study aims• to introduce industrial AR technologies that

SMEs can use to improve their Industrial 4.0 capabilities

• potentials that facilitate the process of SMEs' adaptation to Industry 4.0.

• a set of case studies is presented to examineopportunities of AR technologies for SMEs.

SMEs

and

I4.0

• Criteria for inclusion; Research should be:• Conducted in the context of distance higher education• Examined the effect of openness on distance

education. • used quantitative, qualitative, mixed or other research

methods. • providing necessary information for openness in its

abstract.

• Digital transition

• in Europe the initiatives named as "Industrie 4.0" in Germany, "Catapult" in the United Kingdom, "Factory of the Future" in France and Italy

• in China, a range of activities named as "Made in China 2025" initiative

• in the USA, a whole range of federally funded programs have been initiated to promote advanced manufacturing

SMEs

and

I4.0

• Criteria for inclusion; Research should be:• Conducted in the context of distance higher education• Examined the effect of openness on distance

education. • used quantitative, qualitative, mixed or other research

methods. • providing necessary information for openness in its

abstract.

• SMEs are socially and economically important• represent 99% of all enterprises as well as

around 65 million employments in the Europe (http://ec.europa.eu).

Criteria for micro, small or medium-sized enterprises (EC, 2015)

Ad

op

tio

n o

f SM

Es t

o I4

.0

(Kleindienst & Ramsauer, 2016)2016)

Tech

no

logi

es

Rel

ated

toA

R

• Criteria for inclusion; Research should be:• Conducted in the context of distance higher education• Examined the effect of openness on distance

education. • used quantitative, qualitative, mixed or other research

methods. • providing necessary information for openness in its

abstract.

• AR markers (e.g. QR code), • displays and hologram technologies (e.g. head-

mounted devices, glasses), • mobile devices, • cloud computing, • tracking technologies (e.g. GPS, RFID, Infra-red

LEDs), • interaction technologies (e.g. touch screen,

speech recognition).

Tech

no

logi

es

Rel

ated

toA

R

• Criteria for inclusion; Research should be:• Conducted in the context of distance higher education• Examined the effect of openness on distance

education. • used quantitative, qualitative, mixed or other research

methods. • providing necessary information for openness in its

abstract.

• AR markers

Tech

no

logi

es

Rel

ated

toA

R

• Criteria for inclusion; Research should be:• Conducted in the context of distance higher education• Examined the effect of openness on distance

education. • used quantitative, qualitative, mixed or other research

methods. • providing necessary information for openness in its

abstract.

• Displays and Hologram technologies

Elevator maintenance with Microsoft HoloLens (https://www.youtube.com/watch?v=8OWhGiyR4Ns)

Tech

no

logi

es

Rel

ated

toA

R

• Criteria for inclusion; Research should be:• Conducted in the context of distance higher education• Examined the effect of openness on distance

education. • used quantitative, qualitative, mixed or other research

methods. • providing necessary information for openness in its

abstract.

• Mobile devices and Cloud computing

AR experience using a mobile device(Speicher et al., 2015)

Cas

e St

ud

ies

• Index AR Solutions (http://www.indexarsolutions.com/)

An AR application of Index AR Solutions (https://www.youtube.com/watch?v=oBzIKZqEGwI)

Cas

e St

ud

ies

• AR Solutions of Immersion (http://www.immersion.fr)

An AR tool of Sunna Design (https://www.youtube.com/watch?v=NIyyb5Jj7tk )

Cas

e St

ud

ies

• AR Solutions of VTScada (https://www.trihedral.com/ )

SCADA systems control with HoloLens (https://www.youtube.com/watch?v=XK_hW_c99Xs)

Cas

e St

ud

ies

• The SCS Concept and DMG solutions(http://scsconcept.com, http://www.dmgsolutions.net/)

A visual production guide for manufacturing (https://www.youtube.com/watch?v=0m67O1Em7dY)

Cas

e St

ud

ies

• Solutions of EquipCodes (http://www.equipcodes.com/)

An AR equipment training & maintenance app(https://www.youtube.com/watch?v=nHfY56lHZjU)

InC

losi

ng

• SMEs for Industry 4.0 • There is a high potential,• a lack of adoption the emerging technologies

• AR technology• Early enterprise adopters will gain a significant

competitive advantage

• A range of case studies presented here can help SMEs to add value to their business processes through AR technology in the vision of Industry 4.0.

Alam, M. F., Katsikas, S., Beltramello, O., & Hadjiefthymiades, S. (2017). Augmented and virtual reality based monitoring and safety system: A prototype IoT platform. Journal of Network and Computer Applications, 89, 109-119.Bareño, J. (2014). Large-scale Integrated Project (IP). Available from:https://forge.fiware.org/docman/view.php/7/5017/D11.2.3_Exploitation_Plan,_including_IPR_Managementv_M44.pdf [accessed July 14, 2017].Billinghurst, M., Clark, A., & Lee, G. (2015). A survey of augmented reality. Foundations and Trends® in Human–Computer Interaction, 8(2-3), 73-272.Broll, W., Meier, E., & Schardt, T. (2000, September). The virtual round table-a collaborative augmented multi-user environment. In Proceedings of the third international conference on Collaborative virtual environments (pp. 39-45). ACM.Chi, H. L., Kang, S. C., & Wang, X. (2013). Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Automation in construction, 33, 116-122.Cordis Project (2017). SME 4.0. Available from http://cordis.europa.eu/project/rcn/207061_en.pdf [July 21, 2017]Decker, A. (2017). Industry 4.0 and SMEs in the Northern Jutland Region. In Value Creation in International Business (pp. 309-335). Springer International Publishing.EC, European Commission (2015). SME Definition - user guide 2015. Available from: http://ec.europa.eu/DocsRoom/documents/15582/attachments/1/translations [accessed July 17, 2017].Erol, S., Jäger, A., Hold, P., Ott, K., & Sihn, W. (2016). Tangible Industry 4.0: a scenario-based approach to learning for the future of production. Procedia CIRP, 54, 13-18.Faller, C., & Feldmüller, D. (2015). Industry 4.0 learning factory for regional SMEs. Procedia CIRP, 32, 88-91.Gammeter, S., Gassmann, A., Bossard, L., Quack, T., & Van Gool, L. (2010, June). Server-side object recognition and client-side object tracking for mobile augmented reality. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on (pp. 1-8). IEEE.Gervautz, M. & Schmalstieg, D. (2012). Anywhere Interfaces Using Handheld Augmented Reality. IEEE Computer Society. (pp. 26-31).Gracia, L., Perez-Vidal, C., Mronga, D., de Paco, J. M., Azorin, J. M., & de Gea, J. (2017). Robotic manipulation for the shoe-packaging process. The International Journal of Advanced Manufacturing Technology, 1-15.Guerin, K. R., Lea, C., Paxton, C., & Hager, G. D. (2015, May). A framework for end-user instruction of a robot assistant for manufacturing. In Robotics and Automation (ICRA), 2015 IEEE International Conference on (pp. 6167-6174). IEEE.Han, D. I., Jung, T., & Gibson, A. (2013). Dublin AR: implementing augmented reality in tourism. In Information and communication technologies in tourism 2014 (pp. 511-523). Springer, Cham.Izkara, J. L., Pérez, J., Basogain, X., & Borro, D. (2007, June). Mobile augmented reality, an advanced tool for the construction sector. In Proceedings of the 24th W78 conference, Maribor, Slovenia (pp. 190-202).

Kleindienst, M. & Ramsauer, C. (2016). SMEs and Industry 4.0 – Introducing a KPI based Procedure Model to identify Focus Areas in Manufacturing Industry. Athens Journal of Business and Economics, 2(2), 109-122.Kwon, O. S., Park, C. S., & Lim, C. R. (2014). A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented reality. Automation in construction, 46, 74-81.Langlotz, T., Degendorfer, C., Mulloni, A., Schall, G., Reitmayr, G. & Schmalstieg, D. (2011). Robust detection and tracking of annotations for outdoor augmented reality browsing. Computers & Graphics, 35, 831–840.Materna, Z., Kapinus, M., Beran, V., SmrĚ, P., Giuliani, M., Mirnig, N., ... & Tscheligi, M. (2017, March). Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (pp. 201-202). ACM.Malý, I., Sedláček, D., & Leitão, P. (2016, July). Augmented reality experiments with industrial robot in industry 4.0 environment. In Industrial Informatics (INDIN), 2016 IEEE 14th International Conference on (pp. 176-181). IEEE.Ong, S. K., Yuan, M. L., & Nee, A. Y. C. (2008). Augmented reality applications in manufacturing: a survey. International journal of production research, 46(10), 2707-2742.Quigley, M., & Burke, M. (2013). Low-cost Internet of Things digital technology adoption in SMEs. International Journal of Management Practice, 6(2), 153-164.Pan, Z., Polden, J., Larkin, N., Van Duin, S., & Norrish, J. (2012). Recent progress on programming methods for industrial robots. Robotics and Computer-Integrated Manufacturing, 28(2), 87-94.Paelke, V. (2014). Augmented reality in the smart factory: Supporting workers in an industry 4.0. environment. In Emerging Technology and Factory Automation (ETFA), 2014 IEEE (pp. 1-4). IEEE.Papagiannakis, G., Singh, G., & Magnenat‐Thalmann, N. (2008). A survey of mobile and wireless technologies for augmented reality systems. Computer Animation and Virtual Worlds, 19(1), 3-22.Schröder, C. (2017). The Challenges of Industry 4.0 for Small and Medium-sized Enterprises. A project by the friedrich-ebert-stiftung 2015–2017. Available from http://library.fes.de/pdf-files/wiso/12683.pdfShi, L. (2017). Improving AR tracking and registration with markerless technology (Master's thesis, Universitat Politècnica de Catalunya).Speicher, M., Kristina T., Simon H. & Harry H. (2015). "Enabling Industry 4.0 with holobuilder". In: INFORMATIK 2015. Ed. By D. W. Cunningham, P. Hofstedt, K. Meer & I. Schmitt. 246, (pp. 1561–1575). Available fromhttps://www.researchgate.net/publication/282293186_Enabling_Industry_40_with_holobuilder [accessed July 14, 2017].

Stock, T., & Seliger, G. (2016). Opportunities of sustainable manufacturing in industry 4.0. Procedia Cirp, 40, 536-541.Tabusca, A., & Maniu, L. C. (2017). Modern Technologies and Innovation-Source of Competitive Advantage for Tourism SMEs. Journal of Information Systems & Operations Management, 83.Thalen, J. P., & van der Voort, M. C. (2012). Facilitating user involvement in product design through virtual reality. In Virtual Reality-Human Computer Interaction. Intech.Unzeitig, W., Wifling, M., Stocker, A., & Rosenberger, M. (2015, June). Industrial challenges in human-centred production. In MOTSP 2015-International Conference Management of Technology (pp. 10-12).Van Krevelen, D. W. F., & Poelman, R. (2010). A survey of augmented reality technologies, applications and limitations. International Journal of Virtual Reality, 9(2), 1.Velandia, D. M. S., Kaur, N., Whittow, W. G., Conway, P. P., & West, A. A. (2016). Towards industrial internet of things: Crankshaft monitoring, traceability and tracking using RFID. Robotics and Computer-Integrated Manufacturing, 41, 66-77. Zhou, F., Duh, H. B. L., & Billinghurst, M. (2008). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (pp. 193-202). IEEE Computer Society.