augmented reality and music entertainment: then and now
DESCRIPTION
An overview of augmented reality in music entertainment covering how it has been used in the past, current examples, and future directions -Presented by Jarrell Pair, Chief Technology Officer (CTO), at LP33.tv during Augmented Reality Event 2010 (ARE2010), on June 3, 2010 in Santa Clara, CA.TRANSCRIPT
![Page 1: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/1.jpg)
Augmented Reality and Music
Entertainment: Then and Now
Jarrell PairChief Technology Officer
LP33.tv
![Page 2: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/2.jpg)
OVERVIEW
• Relevance to music entertainment
• Music AR applications “Then”
– What was feasible ten years ago?
• Music AR applications “Now”
– What can be done in 2010?
• Future possibilities and challenges
![Page 3: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/3.jpg)
TECHNOLOGY ADOPTION IN
MUSIC ENTERTAINMENT
• History of early adoption by artists and labels
– Music creation
– Live show enhancement
– Fan engagement
– Marketing and promotion
• AR can address these areas
• Ten year history
![Page 4: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/4.jpg)
MUSIC & AR THEN (CIRCA 2000)
• Low level development: C/C++, no middleware
• Expensive Hardware: SGI 02, high end PC
• Content pipeline restrictions
• Difficult to pitch: Few comparisons
• No mass market delivery platform
• Niche applications feasible
![Page 5: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/5.jpg)
AR INTERACTIVE MUSIC INSTALLATIONS
• Augmented Groove (2000) Video source: http://modin.yuri.at/tangibles/
• Poupyrey, I., Berry, R., Kurumisawa, J., Nakao, K. and Billinghurst, M. 2000.
Augmented Groove: Collaborative Jamming in Augmented Reality. In
Proceedings of ACM SIGGRAPH 2000 Conference Abstracts and Applications, ACM
Press/ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference
Series, ACM, 77.
![Page 6: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/6.jpg)
AR IN LIVE PERFORMANCE• Duran Duran Pop Trash Tour (2000-2001)
– AR 3D animated characters and effects appear live on stage with band
– AR scene viewed on stage video screen
– Used modified version of ARToolKit
![Page 7: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/7.jpg)
AR IN LIVE PERFORMANCE
• "Girls on Film" Computer generated women danced on top of the
crowd and interacted on stage with lead singer Simon Le Bon.
![Page 8: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/8.jpg)
AR IN LIVE PERFORMANCE• "Hallucinating Elvis”: A computer animated Elvis was created to "shake,
rattle, and roll" alongside band members
• Girls on Film, the Reflex
• J.Pair, J.Wilson, J. Chastine, M. Gandy. "The Duran Duran Project: The
Augmented Reality Toolkit in Live Performance". The First IEEE
International Augmented Reality Toolkit Workshop, 2002.
More info: www.jarrellpair.com/ddar
![Page 9: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/9.jpg)
MUSIC & AR NOW (2010)
• Variety of development options: Flash, C/C++,
Cocoa
• Easier to create 3D objects, animations, effects
• Demand in marketing, advertising, gaming
• Mass market delivery via webcam and mobile
apps
• Wide spectrum of applications possible
![Page 10: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/10.jpg)
AR WEB APPS
• Interactive Album Covers and Promo Flyers
• View at http://devblog.lp33.tv/aralbum/
![Page 11: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/11.jpg)
AR WEB APPS
• Interactive Album Covers and Promo Flyers
• View at http://devblog.lp33.tv/arconcert/
![Page 12: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/12.jpg)
AR WEB APPS• John Mayer “Heartbreak” AR Music Video
• View at: http://johnmayer.com/ar
![Page 13: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/13.jpg)
EXAMPLE: AR WEB APPS
• Blink 182 Doritos Campaigns
• View video here
![Page 14: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/14.jpg)
AR WEB APPS
• AR in Live Streamed Performances
• View at: http://devblog.lp33.tv/arconcert/
![Page 15: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/15.jpg)
AR WEB APPS• AR in Live Streamed Performances
• View at http://devblog.lp33.tv/arvideowall/
![Page 16: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/16.jpg)
ARTIST MOBILE APPS
• Major artists release mobile apps: David Guetta, Lady
Gaga
• AR as an app added feature
![Page 17: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/17.jpg)
ARTIST MOBILE APPS
• AR music videos and performances
• More info: http://apetrus.com/en/argirl/
![Page 18: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/18.jpg)
NEAR FUTURE
• Additional Platform Options
– Tablets
• Camera equipped
– Consoles
• Handling production value expectations
• Improved 3D rendering and lighting
– Wider availability of AR capable mobile devices
![Page 19: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/19.jpg)
SUMMARY• Why?
– Music creation, compelling live shows, fan engagement,
marketing, promotion
• Then
– An emerging technology, interactive installations, AR in live
performance
• Now
– Mass market reach through webcam and mobile apps,
• Future
– Tablets, consoles, more
• Challenge
– Delivering entertainment value vs. novelty
![Page 20: Augmented Reality and Music Entertainment: Then and Now](https://reader033.vdocuments.mx/reader033/viewer/2022060119/558d296ad8b42aa52a8b4629/html5/thumbnails/20.jpg)
QUESTIONS
Jarrell Pair
• E-mail: [email protected]
• Company: www.lp33.tv
• Web: www.jarrellpair.com
• Blog: www.laboratory4.com
• Twitter: laboratory4