jyväskylä 15/04/2013 talk: the body and the brain…

45
the body and the brain as controller Talk to Digital Culture students @University of Jyvaskyla, Finland 15 April 2013 erik champion http://erikchampion.wordpress.com [email protected]

Upload: curtin-university-perth-australia

Post on 30-Nov-2014

412 views

Category:

Education


3 download

DESCRIPTION

Jyväskylä 15/04/2013 talk "the body and the brain" to Digital Culture Students in Finand

TRANSCRIPT

Page 1: Jyväskylä 15/04/2013 talk: the body and the brain…

the body and the brain as controller

Talk to Digital Culture students ���@University of Jyvaskyla, Finland

15 April 2013���

erik champion

http://erikchampion.wordpress.com [email protected]

Page 2: Jyväskylä 15/04/2013 talk: the body and the brain…

Civilization comprises the laws that allow people to live close together, in a city, civitas. ���

���Culture is what is cultivated or allows one to

cultivate a setting, a local domain.

Osvald Spengler

Page 3: Jyväskylä 15/04/2013 talk: the body and the brain…

virtual heritage

•  …the use of computer-based interactive technologies to record, preserve, or recreate artefacts, sites and actors of historic, artistic, religious, of cultural significance and to deliver the results openly to a global audience in such a way as to provide formative educational experiences through electronic manipulations of time and space."

•  Stone, Robert, and Takeo Ojika. 2000. Virtual heritage: what next? Multimedia, IEEE no. 7 (2):73-74. "

Page 4: Jyväskylä 15/04/2013 talk: the body and the brain…

Virtual meetings no more interesting than real ones so why recreate mundality?

Page 5: Jyväskylä 15/04/2013 talk: the body and the brain…

Non digital-interactivity sometimes better than the digital

Page 6: Jyväskylä 15/04/2013 talk: the body and the brain…

Goodbye body

•  Spengler wrote “This machine technics will end with the Faustian civilization and one day will lie in fragments, forgotten -- our railways and steamships as dead as the Roman roads and the Chinese wall, our giant cities and skyscrapers in ruins like old Memphis and Babylon.”

Page 7: Jyväskylä 15/04/2013 talk: the body and the brain…

scale is also important

Page 8: Jyväskylä 15/04/2013 talk: the body and the brain…

the brain

•  space and memory are inextricably linked

• memory is more a jigsaw than filing cabinet

• memory decay can be challenged

•  games help multi-tasking

•  biofeedback can help evaluation

Page 9: Jyväskylä 15/04/2013 talk: the body and the brain…

Humans See Tools Differently Than Other Primates

Caption: The flow of object information in a monkey brain (left) and a human brain. Credit: Sabine Kastner, Princeton University

Page 10: Jyväskylä 15/04/2013 talk: the body and the brain…

•  Computers don’t have flashes of insight. But the human brain can..for gamifying RNA.

• One proposal they kicked around was to have snippets of RNA fight each other to the death, in the style of a Japanese combat game called Senshuken; another was to create a first-person experience in which players navigated the world as RNA molecules of their own design.

RNA Game (Wired magazine) “EteRNA”

Page 11: Jyväskylä 15/04/2013 talk: the body and the brain…

use lego to discover?

Page 12: Jyväskylä 15/04/2013 talk: the body and the brain…

http://publicvr.org/html/pro_oracle.html

Page 13: Jyväskylä 15/04/2013 talk: the body and the brain…

media architecture biennale���http://www.mediaarchitecture.org/biennale-2012-workshops/���

or http://moritzbehrens.com/2013/mab12/ ���15 November 2012, Aarhus

prototyping for ownership Klaus Birk Roman Grasy"

Page 14: Jyväskylä 15/04/2013 talk: the body and the brain…

sketchy sketches

Page 15: Jyväskylä 15/04/2013 talk: the body and the brain…

Xbox Kinect+Projector+VVV ���and Crazy dancers..

Page 16: Jyväskylä 15/04/2013 talk: the body and the brain…

dance projection

• imagine... •  public squares

•  flashmob dance mixes

•  crowdsourcing VJs

Page 17: Jyväskylä 15/04/2013 talk: the body and the brain…

machinima tools

Page 18: Jyväskylä 15/04/2013 talk: the body and the brain…

MOODLE-unity

Page 19: Jyväskylä 15/04/2013 talk: the body and the brain…

kinect, jibe, drawing interfaces

Page 20: Jyväskylä 15/04/2013 talk: the body and the brain…

peripheral projection

Page 21: Jyväskylä 15/04/2013 talk: the body and the brain…

warped screen���peripheral fear

our peripheral vision is not colour, it reacts to movement

how to best utilize this?

Page 22: Jyväskylä 15/04/2013 talk: the body and the brain…

biofeedback

Page 23: Jyväskylä 15/04/2013 talk: the body and the brain…
Page 24: Jyväskylä 15/04/2013 talk: the body and the brain…

biofeedback

Page 25: Jyväskylä 15/04/2013 talk: the body and the brain…

Skyrim + body

Skyrim game can host virtual recreations (of Nordic stories or any other), the player can control the avatar, and issue voice commands recognised by the game). Inhabitants can be easily reprogrammed to share stories. Trading, praying, conversing healing etc are possible, not just violence.!

Page 26: Jyväskylä 15/04/2013 talk: the body and the brain…

Oblivion Eric Fassbender PhD thesis project, scripted tour guide of lighthouse, Macquarie University!

Page 27: Jyväskylä 15/04/2013 talk: the body and the brain…

mixed reality Second Life and VR tracker and googles see Georgia Tech Project!

Page 28: Jyväskylä 15/04/2013 talk: the body and the brain…

2006 calligraphic interfaces

University of Queensland: project by year 3 multimedia students, Amy and Isaac, Team AI studios!

Page 29: Jyväskylä 15/04/2013 talk: the body and the brain…

Journey to the West

Page 30: Jyväskylä 15/04/2013 talk: the body and the brain…

touch screen taoism @Vsmm2012, MILAN

Page 31: Jyväskylä 15/04/2013 talk: the body and the brain…

“new media…offers enormous possibilities for the enhancement and enrichment of heritage experience and interpretation” ���

Y. E. Kalay, T. Kvan, & J. Affleck, New Heritage: new media and cultural heritage.

New York: Routledge, 2008.

Page 32: Jyväskylä 15/04/2013 talk: the body and the brain…

“Qin” literally refers to a unique seven-string Chinese music instrument “Guqin”, which was invented 3,000 years ago in ancient China."

http://chinablog.cc/2009/10/siyi-four-arts-of-the-chinese-scholar/"

http://www.youtube.com/watch?v=nvhKTFzQG8Y"https://eee.uci.edu/programs/rgarfias/sound-recordings/qin/index.html"

Page 33: Jyväskylä 15/04/2013 talk: the body and the brain…

Daoism is an ancient Chinese combination of religion, philosophy, and folk beliefs, including ritual healing. Its different strands of belief date far back in history. Daoism is deeply entwined with Chinese culture and history."

http://chinablog.cc/2009/10/siyi-four-arts-of-the-chinese-scholar/"

Page 34: Jyväskylä 15/04/2013 talk: the body and the brain…

•  to be a scholar or a master is to be an artist, measured by one’s grasp of the “Four Arts”.

•  The “Four Arts” are Music (“Qin”), the board game (“Qi”), calligraphy (“Shu”), and brush painting (“Hua”).

•  Helped “perceive the ultimate doctrine of the heavens”, “make themselves [be] enlightened”, “express their emotions/their understanding of the doctrine”, and “inspire others” so that their lives achieve peace and harmony. "Z. Dainian, Key Concepts in Chinese Philosophy. Beijing: Foreign Languages Press, 2002."

Page 35: Jyväskylä 15/04/2013 talk: the body and the brain…

youtube links •  Opening http://youtu.be/gFYG4zTn4Js

•  Game Hua http://youtu.be/DiGDezTM8hY

•  Game Qi1 http://youtu.be/jP9nfdUFDTU

•  Game Qi2 http://youtu.be/orCga2CQBjs

•  Game Qin http://youtu.be/iC2BGT5IbDE

•  Game Shu http://youtu.be/dv_TOnl_sbc

Page 36: Jyväskylä 15/04/2013 talk: the body and the brain…

•  What are the Five Elements in the traditional Chinese culture?

•  What are the Five Basic Tones in the traditional Chinese music?

•  What are the traditional Chinese philosophical concepts revealed by Go?

•  Which one of the following features is one of the main features of Chinese character writing system? ] Cuneiform / [ ] Alphabet / [ ] Pictography / [ ] Phonology?

•  What are the tools for Chinese traditional painting?

Page 37: Jyväskylä 15/04/2013 talk: the body and the brain…

•  Very difficult to recreate original action scenes and moments of discovery as game devices.

•  Chinese players, familiar with a distorted version of the original, not aware their cultural knowledge was not accurate, did not appreciate being told this.

•  Recreating linear narrative via game design is torturous.

•  OR: simulate the procedural knowledge of rituals and symbol-making via thematically-akin interaction..

Page 38: Jyväskylä 15/04/2013 talk: the body and the brain…

•  what is needed: more comprehensive pre-test and post-test questionnaire.

•  The general questions are too vague.

•  Consider changing from rating games to ranking them.

•  Test extrapolated knowledge rather than memory of simple facts.

•  Examine how tacit knowledge can be learnt and evaluated.

•  Compare tests between touch-screen and non-touch screen games.

•  A more 3D interface: sculptures, HD projection on rice paper or liquid media, with 3D audio effects and ambient movies projection.

•  Ambient movies react to the player’s physiological changes -by biosensors.

•  Can interactive digital media convey and evaluate tacit knowledge?

Page 39: Jyväskylä 15/04/2013 talk: the body and the brain…

crazy ideas

Page 40: Jyväskylä 15/04/2013 talk: the body and the brain…

•  Dutch thriller App sends to your phone additional storyline information..

•  why not have biofeedback sent back to the movie..

Page 41: Jyväskylä 15/04/2013 talk: the body and the brain…

fps...

•  when your character dies, why not have the death spasms relate to the heartbeat-GSR?

•  or only respawn when you calm down..

•  reactions relate to heartbeat

•  enemies attack peripherally sensing fear

Page 42: Jyväskylä 15/04/2013 talk: the body and the brain…

RPGs-chameleon effect

•  when you start shaking you lose your character or change between ethnic profile

•  Cinematic camera views=biofeedback

•  you can only convince NPCs when calm

Page 43: Jyväskylä 15/04/2013 talk: the body and the brain…

sew some characters •  http://lilypadarduino.org/

Page 44: Jyväskylä 15/04/2013 talk: the body and the brain…

reflective games

Kuthodaw Paya: must walk around Buddhist description of universe-biggest book in the world-

but aesthetic experience being eroded

Page 45: Jyväskylä 15/04/2013 talk: the body and the brain…

IF+3D model+body http://www.dreamingmethods.com/