kill the search button ii - mobile gestures
DESCRIPTION
Code4Lib presentation about smartphone gestures. I talk about an alternative gesture based paradigm for mobile devices and show an example of how to augment an iPhone library search app with gestures.TRANSCRIPT
![Page 1: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/1.jpg)
Kill the Search Button II
The Handheld Devices Are Coming
![Page 2: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/2.jpg)
Gestures for a Mobile Search App
Michael Poltorak Nielsen
![Page 3: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/3.jpg)
Today's agenda
● Current Mobile Interaction Paradigm
● An Alternative
● Smartphone Gestures
● Demo: A Library Search App with Touch and Gestures
![Page 4: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/4.jpg)
![Page 5: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/5.jpg)
But, the Current Handheld Interaction Paradigm is based on:
![Page 6: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/6.jpg)
Glass
![Page 7: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/7.jpg)
![Page 8: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/8.jpg)
![Page 9: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/9.jpg)
The future is sliding, toomicrosoft.com/office/vision
![Page 10: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/10.jpg)
![Page 11: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/11.jpg)
![Page 12: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/12.jpg)
![Page 13: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/13.jpg)
![Page 14: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/14.jpg)
Pictures Under GlassTransitional paradigm dictated by technology, not human capabilities Bret Victorworrydream.com/ABriefRantOnTheFutureOfInteractionDesign
![Page 15: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/15.jpg)
Alternative Paradigm
Direct Manipulation Gesture Driven Palpable Tactile
![Page 16: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/16.jpg)
![Page 17: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/17.jpg)
![Page 18: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/18.jpg)
![Page 19: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/19.jpg)
Harrison, C. and Hudson, S. E. 2009. Providing Dynamically Changeable Physical Buttons on a Visual
Display
![Page 20: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/20.jpg)
Not bad, huh?
![Page 21: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/21.jpg)
Near Future?
+
![Page 22: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/22.jpg)
Have a Moment
![Page 23: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/23.jpg)
Our Mobile Projects
![Page 24: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/24.jpg)
Mobile Search App(s)
HTML5 + iPhone app, Android?● search library data (10M + 800M)● request stuff, favourites● view own items● renew In beta, to be published really soon
![Page 25: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/25.jpg)
Barcode to Map Location AppWith Silkeborg Public Library
![Page 26: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/26.jpg)
● Augment search app with gestures
● Can gestures be combined with multi-touch interactions?
● Goals: ○ Produce alpha app○ Test usability
Now: Gestures
![Page 27: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/27.jpg)
Smart Phone Interactions and Inputs
Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position
![Page 28: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/28.jpg)
Focus on
Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position
![Page 29: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/29.jpg)
Gestures
AdvancedCircle, cross, up-down, etcMovement hard to measure Can't reliably calculate movement from acceleration
SimpleTilt, flip, turn, rotate, shake, throwAccelerometer data
![Page 30: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/30.jpg)
What Can Browsers do Accelerometer-wise?
![Page 31: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/31.jpg)
So: Going Native iPhone app with gestures
HTML5 web app without gestures
Android?
![Page 32: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/32.jpg)
Search App Interactions
Do search query, toggle search boxSwitch views compact, normal, expandendNext/previous page switch search results Show full record full info about itemRequest get the materialFavourites save material
![Page 33: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/33.jpg)
![Page 34: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/34.jpg)
![Page 35: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/35.jpg)
![Page 36: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/36.jpg)
![Page 37: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/37.jpg)
![Page 38: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/38.jpg)
![Page 39: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/39.jpg)
Demo Time
![Page 40: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/40.jpg)
What's next?
From Nokia
![Page 41: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/41.jpg)
Challenges
No standard mobile gestures Gestures may be individualGestures may not be appropiate at allSophisticated gestures hard to codeObjective-C Argh!
![Page 43: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/43.jpg)
![Page 44: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/44.jpg)
![Page 45: Kill the Search Button II - Mobile Gestures](https://reader033.vdocuments.mx/reader033/viewer/2022060106/54954813ac7959ff2d8b4ddc/html5/thumbnails/45.jpg)