1. The Employment of Affective Computingon the Interactive Design of Digital ArtsKoong LIN, National University of Tainan

2. (Affective Computing) 2012/12/30 392 (123) 2 3. , 1997 ISAC ISMS (ISO 27001) LA () DDLab (Since 1995) Boom 2012/12/30 392 (123) 3 4. 2012/12/30 392 (123) 4 5. () () 2012/12/30 392 (123) 5 6. 2012/12/30 392 (123) 6 7. 2012/12/30 392 (123) 7 8. 2012/12/30 392 (123) 8 9. 2012/12/30 392 (123) 9 10. --2012/12/30 392 (123) 10 11. DDLab Best Paper Award (Arts Creation), ICDC2010, International Conferenceon Digital Contents, 12/21-22, 2010. Best Paper Award, ICWE2010, 3rd International Conference of Web 2.0and Education, 11/20, 2010. Best Paper Award, AIED@TAAI, 14th Conference on ArtificialIntelligence and Applications, 2009/10. 201217Fun Music! () 201015 () 201217MIDI () 201116Excelent - Google App EngineGoogle Docs APIHTML5Excel () 99Speshow Stage! ()2012/12/30 392 (123) 11 12. 2011 ()2003 2011 2012/12/30 392 (123) 12 13. 2012/12/30 392 (123) 13 14. 3/6-4/11, 2010. Dec. 4-12, 2010. November 1-30, 2010. 5/23-8/26, 2012. (Impossible to Define)20129/28-11/11, 2012. Nov., 2011. (Me, and theOthers) 20118/19-9/18, 2011.2012/12/30 392 (123) 14 15. (Enough BeEnough)TenSee U Next 102010TADASeptember 3-12, 2010. 3/16-18, 2011. ICDDC200910/8-9, 2009. 9/25-10/24, 2009. 8/1-8/30, 2009. Exhibition Chair, ArtsIT2009, -9/24-25, 2009. DDLab20097/1-8/30, 2009. 2012/12/30 392 (123) 15 16. Affective Computing & 2012/12/30 392 (123) 16 17. Affective Computing INPUT: & & 2012/12/30 392 (123) 17 18. Physiological, Facial Expression Face Detection Eye TrackingDevelopment Toolkits Attention Meter(MIT Media Lab ) A Vision-basedInput Toolkit forInteraction Designers2012/12/30 392 (123) 18 19. -2012/12/30 392 (123) 19 20. EyeTracking Report Gaze Plot Hot Spot2012/12/30 392 (123) 20 21. 2012/12/30 392 (123) 21 22. 2012/12/30 392 (123) 22 23. 2012/12/30 392 (123) 23 24. 2012/12/30 392 (123) 24 25. 2012/12/30 392 (123) 25 26. 750 g FireWire 1394 880 nm MangoldVision images, videos, text, web2012/12/30 392 (123) 26 27. 2012/12/30 392 (123) 27 28. -Heatmap (Tree&People) 10 2012/12/30 392 (123) 28 29. 2012/12/30 392 (123) 29 30. -AOI (Tree&People)2012/12/30 392 (123) 30 31. INPUTOUTPUT (Multimedia Feedback) Avatar AR Emotion Transition2012/12/30 392 (123) 31 32. 3452012/12/30 392 (123) 32 33. ATS: Affective Turoring System 2012/12/30 392 (123) 33 34. AR( Augmented Reality) .flv http://daid.mooo.com/arecs/demo/AR ECS_lamp.wmv http://daid.mooo.com/arecs/demo/AR ECS_motor.wmv2012/12/30 392 (123) 34 35. 2012/12/30 392 (123) 35 36. 2012/12/30 392 (123) 36 37. 2012/12/30 392 (123) 37 38. OpenCV Face Detection, http://www.youtube.com/watch?v=hNBeEpKtGlo&feature=player_embedded2012/12/30 392 (123) 38 39. Markerless Mobile AR - ARBOX2012/12/30 392 (123) 39 40. Levels of Machine Emotions To recognize emotions To express emotions To have emotions EmotionalIntelligence Intention Estimations Affective Computing, Affective Design, Emotion Recognition2012/12/30 392 (123) 40 41. Computational Intelligence SVM LIBSVM CRF,KNN, HMM, ANN SymbolicAI Ontology OMCSnet (Logic Inference, LISP-Like) OCC Model HowNet + NLP Understanding Parser + Semantic Roles (Theta Grid) 2012/12/30 392 (123) 41 42. Facial Expression DEASM(Detected Emotion based on Active Shape Model) ActiveShape Model Library (ASMLibrary 5.0) SDK Ammar (2010) webcam frame 2012/12/30 392 (123) 42 43. frame 2012/12/30 392 (123) 43 44. Ammar Di2012/12/30 392 (123) Di 44 45. D1 D2D3 D4 D5 D6 Joy Sadness Anger or Fear? Disgust Surprise 2012/12/30 392 (123) 45 46. DEASM OMCSNetKai Demo 392 (123) 2012/12/3046 47. 1) 2) 3) 4) 2012/12/30 392 (123) 47 48. 2012/12/30 392 (123) 48 49. 2012/12/30 392 (123) 49 50. ATS + 2012/12/30 392 (123) 50 51. 2012/12/30 392 (123) 51 52. PhilipsSKINProbo 2007 2012/12/30 392 (123) 52 53. MAX/MSPMIDI 2012/12/30 392 (123) 53 54. 2012/12/30 392 (123) 54 55. A C A2012/12/30 392 (123) 55 56. MIDI(Pitch)(Articulation)(Loudness)(Tempo)(Major) 2012/12/30 392 (123) 56 57. ()Joy2012/12/30 392 (123) 57 58. MIDI 12 MIDI 2012/12/30 392 (123) 58 59. ()2012/12/30 392 (123) 59 60. :1. 0, 0, 1, 2, 4, 3, 4, 16 / 8 1.5 ( 222. 0, 0, 0, 0, 0, 5, 6, 5 2.6 ( 2012/12/30 392 (123) 60 61. ()2012/12/30 392 (123) 61 62. Fun Music! : : : IAP7-11 63. 2012/12/30 392 (123) 63 64. Processing Max/MSP Pad 2012/12/30 392 (123) 64 65. 2012/12/30 392 (123) 65 66. 2012/12/30 392 (123) 66 67. 2012/12/30 392 (123) 67 68. ( ) 69. + () Processing, 2012/12/30 392 (123) 69 70. 2012/12/30 392 (123) 70 71. 2012/12/30 392 (123) 71 72. 2012/12/30 392 (123) 72 73. 2012/12/30 392 (123) 73 74. 2012/12/30 392 (123) 74 75. 2012/12/30 392 (123) 75 76. 2012/12/30 392 (123) 76 77. 2012/12/30 392 (123) 77 78. 2012/12/30 392 (123) 78 79. Light up the Speshow Stage! , , ()2012/12/30 392 (123) 79 80. Max/MSP/Jitter Arduino MaxMIDI MSPAudio Jitter 2012/12/30 392 (123) 80 80 81. 2012/12/30 392 (123) 81 82. + VJ + + + ++2012/12/30 392 (123) 82 83. -2012/12/30 392 (123) 83 84. Zoe2012/12/30 392 (123) 84 85. 2012/12/30 392 (123) 85 86. 2012/12/30 392 (123) 86 87. 2-22012/12/30 392 (123) 87 88. +2012/12/30 392 (123) 88 89. 1-Night Flight2012/12/30 392 (123) 89 90. 2-2012/12/30 392 (123) 90 91. 3-2012/12/30 392 (123) 91 92. 10--2012/12/30 392 (123) 92 93. 9--2012/12/30 392 (123) 93 94. 2012/12/30 392 (123) 94 95. -1-2012/12/30 392 (123) 95 96. 2012/12/30 392 (123) 96 97. swingsway curvespiralturn 2012/12/30 392 (123) 97 98. 2012/12/30 392 (123) 98 99. -2-2012/12/30 392 (123) 99 100. 2012/12/30 392 (123) 100 101. -3-2012/12/30 392 (123) 101 102. 2012/12/30 392 (123) 102 103. The Process of Death by XOR 2012/12/30 392 (123) 103 104. Max/MSP/JitterSobelMIDI 2012/12/30 392 (123) 104 105. [] http://web.tnnua.edu.tw/~koong/GoHomeBridge-0113.wmv () MIDI () 2012/12/30 392 (123) 105 106. 2012/12/30 392 (123) 106 107. 108. MIDI 2012/12/30 392 (123) 108 109. (Sensor) MSP 2012/12/30 392 (123) 109 110. MIDI Conway (Game of Life) (Gardner, 1970) (Happening) 2012/12/30 392 (123) 110 111. [Step 1] Edge detection Sobel f = mag(f) = [Gx2+Gy2]1/2 =[(f / x )2+(f / y)2]1/2 f |Gx|+|Gy| Gx= (Z9-Z5) Gy= (Z8-Z6) f = [(Z9-Z5)2+(Z8-Z6)2]1/2 f |Z9-Z5|+|Z8-Z6| f |(Z7+2Z8+Z9)-(Z1+2Z2+Z3)|+ |(Z3+2Z6+Z9)-(Z1+2Z4+Z7)|2012/12/30 392 (123) 111 112. G G 1 2 x Gy 2 2 Edge detection Sobel33XY GxGy -1 -2 -1 -1 0 1 000-2 0 2 121-1 0 1 (x, y) G 1G G Gy 2 x2 2 2012/12/30 392 (123) 112 113. Edge detection RobertsCross operator Sobel operator Noise-Sensitive Smoothing 2012/12/30 392 (123) 113 114. [Step 2] Control the Work bySound Signals Cycling74 (2007) Jitter Tutorial (2006) MSP MIDI () 2012/12/30 392 (123) 114 115. [Step 3]Tracing of the peak sound Max snapshot~ avg~ peakamp~ (Peak Value) peakamp~ peakamp~ 2012/12/30 392 (123) 115 116. [Step 4] Decibel transformation peakamp~ 10 dBdB 20 log 10 ( A ) A0 AA0 Noise Floor Noise Floor Cycling74AtodB 0-1202012/12/30 392 (123) 116 117. [Step 5]Automatic event detection (Attack) 2012/12/30 392 (123) 117 118. [Step 6] Generating MIDI music via sound signals MIDIMIDI1. 0-120 (120)MIDI 2. 96-36 (-296) MIDI3. (2) 4. 2012/12/30 392 (123) 118 119. Generating MIDI music via sound signals2012/12/30 392 (123) 119 120. [Step 7] Controlling the image processing via sound signals RGB Frame2012/12/30 392 (123) 120 121. [] http://web.tnnua.edu.tw/~koong/HotDinnerY.wmv!2012/12/30 392 (123) 121 122. 2012/12/30 392 (123) 122 123. []http://web.tnnua.edu.tw/~koong/GreenDinner.wmv 2012/12/30 392 (123) 123 124. 2012/12/30 392 (123) 124 125. Play + :2012/12/30 392 (123) 125 126. Play 404 , 2008 , 2007 , 2007 3D + Virtools English versionhttp://tw.youtube.com/watch?v=zI_Tv29bTXsWorking progresshttp://tw.youtube.com/watch?v=QjLFfuvwvCk2012/12/30 392 (123) 126 127. 2000/08-2005/01 (170002500) 1992/02- 1997/08-1998/02 1996/05-1997/03 NEC (Princeton)1995 1997/08-2000/07 1999/01-2000/12 2012/12/30 392 (123) 127 128. TAAIIAoMICDCICWEDCMACABMTEC20082012/12/30 392 (123) 128 129. 2009-11/8, 2009. 200910/8, 2009. 2009/2/7. 2009/1/10. 2008-10/5, 2008. 20088/29-9/7,2008. 20073C10/26-11/4, 2007. Boom6/5-7/8, 2007.2012/12/30 392 (123) 129 130. 2008 ()9/12-11/9, 2008. 11/27, 2007. Nollywood 11/17, 2007. 9/27, 2007. Eleanor Gates Stuart 2007 5/29-6/126/5-7/8, 2007. 5/28, 2007. 2006ANUNew Media Arts Center, Australia NationalUniversity, 11/28-12/5, 2006. Oct., 2006. Oct., 2006. 2012/12/30 392 (123) 130 131. 2012/12/30 392 (123) 131 132. Intel 2012/12/30 392 (123) 342(169) 132 133. Affective Computing MIT Rosalind Picard 2012/12/30 392 (123) 134 134. Affective ComputingRosalind W. PicardMIT Press, 20002012/12/30 392 (123) 135 135. 2012/12/30 392 (123) 136 136. emguCV 2012/12/30 392 (123) 137 137. AR Marker ()2012/12/30 392 (123) 138 138. 2012/12/30 392 (123) 139 139. OMCSNet OMCSNet Semantic Network Inference Toolkit written in Python/Java. Open Mind Common Sense corpus Currently contains over 280,000 separatepieces of common sense information OMCSNet-WordNet project WordNet synonym sets OMCSNet concepts semantic linkage data from WordNet.2012/12/30 392 (123) 140 140. [Accident] to [Sad] ./omcsnet --path accident sad > accidentTOsad.txt 13 Path(s) from [accident] to [sad] found! Path 1: accident (CapableOf) ==> kill people kill people (SubeventOf) ==> death death (PropertyOf) ==> sad Path 7: accident (Do) ==> kill people kill people (SubeventOf) ==> death death (OftenNear) ==> cry cry (PropertyOf) ==> sad2012/12/30 392 (123) 141 141. Computation accident (CapableOf) ==> kill peoplekill people (SubeventOf) ==> deathdeath (PropertyOf) ==> sad accident (CapableOf) ==> kill peoplekill people (SubeventOf) ==> deathdeath (OftenNear) ==> personperson (PropertyOf) ==> angry "accident" emotions: happy: 0.642857, sad: 0.714286, angry: 0.642857,2012/12/30 392 (123) 142 142. Linear Clues+Structural Info Lexical Structural2012/12/30 392 (123) 143 143. Motivation The emotion informatic TWISTSbecause of the grammatical structure. For example: [S [NP [S ]]] [S [NP ] ] [S [VP ] [VP ]] [S [NP [S ]] ] Clues: Agents Structures Connectives etc. Heuristics? Rule-based?2012/12/30 392 (123) 144 144. SONY Aibo NCR SONY 2012/12/30 392 (123) 145 145. & (MIT) (Pressure Mouse) (Emotion mouse) 2012/12/30 392 (123) 146 146. Bubelle blushing dress 2012/12/30 392 (123) 147 147. DEMO 148. MIDI2012/12/30 392 (123) 149 149. 2012/12/30 392 (123) 150 150. () 2012/12/30 392 (123) 151 151. 1979 1990 2012/12/30 392 (123) 152 152. () () Not 2012/12/30 392 (123) 153 153. 2012/12/30 392 (123) 154154 154. 2011Billboard Music AwardsBeyonce Performs_Who Run thaWorld (Girls)2012/12/30 392 (123) 155 155. - 2012/12/30 392 (123) 156 156. 2012/12/30 392 (123) 157 157. -2012/12/30 392 (123) 158 158. NEXUS-2012/12/30 392 (123) 159 159. 2012/12/30 392 (123) 160 160. 1--lucy2012/12/30 392 (123) 161 161. 3--12-LUCI-122012/12/30 392 (123) 162 162. 2012/12/30 392 (123) 163 163. 7-2012/12/30 392 (123) 164 164. -2012/12/30 392 (123) 165 165. 2012/12/30 392 (123) 166 166. 2012/12/30 392 (123) 167 167. 2012/12/30 392 (123) 168 168. The Process og Death Makeing of / 2012/12/30 392 (123) 169 169. 2012/12/30 392 (123) 170 170. ProcessingArduino 171. 1722012/12/30 392 (123) 172 172. 1.RGBxfade2012/12/30 392 (123) 173 173. 2012/12/30 392 (123) 174 174. 2012/12/30 392 (123) 175 175. 2012/12/30 392 (123) 176 176. 115 2012/12/30 392 (123) 177 177. 2012/12/30 392 (123) 178 178. 2012/12/30 392 (123) 179 179. http://www.youtube.com/watch?v=B-w6Lfl- sxc&feature=mfu_in_order&list=UL 2012/12/30 392 (123) 180 180. http://www.youtube.com/watch?v=G5M47Nii3TM2012/12/30 392 (123) 181 181. 2012/12/30 392 (123) 182 182. . io2technology . T2012/12/30 392 (123) 183 183. 2012/12/30 392 (123) 184 184. 2012/12/30 392 (123) 185 185. 2012/12/30 392 (123) 186 186. 3D Sensor2012/12/30 392 (123) 187 187. [] http://web.tnnua.edu.tw/~koong/BodyTimeRail.mov2012/12/30 392 (123) 188 188. [] (Disembodied) 2012/12/30 392 (123) 189 189. 2012/12/30 392 (123) 190 190. [, ] http://web.tnnua.edu.tw/~koong/TreeRing.mov2012/12/30 392 (123) 191 191. [, ] ? ?2012/12/30 392 (123) 192 192. 2012/12/30 392 (123) 193 193. (Video Arts)8 48 2012/12/30 392 (123) 194 194. 2012/12/30 392 (123) 195 195. 2012/12/30 392 (123) 196 196. 197. () 198. 2012/12/30 392 (123) 199 199. 2012/12/30 392 (123) 200 200. () () ( & ) ( & ) () () Dong-He Hardware (Su,Yu-Xian Seeing and Recognized (Chen Hsin-yuan) Flow (Tseng, Yu-Chuan & Lee, Chia-Hsiang) Spectrum, the Sparkling Dots (Sappoho & Monbaza) Felicitous Dinner (Lin, Hao-Chiang)2012/12/30 392 (123) 201 201. 202. Su,Yu-Xian 1982 1982born in Taiwan Tainan National University of TheArts, Graduate Institute of PlasticArts2012/12/30 392 (123) 203 203. 2012/12/30 392 (123) 204 204. 2012/12/30 392 (123) 205 205. Digital print (sensation) (inter-subject) 2012/12/30 392 (123) 206 206. Chen, Hsin-yuan 1982 1982was born in Taipei Tainan National University of TheArts, Graduate Institute of PlasticArts2012/12/30 392 (123) 207 207. 2012/12/30 392 (123) 208 208. 2012/12/30 392 (123) 209 209. 2012/12/30 392 (123) 210 210. 2012/12/30 392 (123) 211 211. 2012/12/30 392 (123) 212 212. Tseng, Yu-Chuan & Lee, Chia-Hsiang 2004.5~ 1992-1994, New York University Studio ArtsM.A. 2006, Tseng, Yu-Chuan 2004.5~ National Chiao Tung University, Institute of Applied Arts Ph.D.candidate 1992-1994, New York University, Master of Arts in Studio Art Lee, Chia-Hsiang 2006 Graduate Institute of Mechanical and Electrical Engineering ,National Taipei University of Technology, Ph.D. program2012/12/30 392 (123) 213 213. 2012/12/30 392 (123) 214 214. 2012/12/30 392 (123) 215 215. (Flow) Communication Art 2012/12/30 392 (123) 216 216. 2012/12/30 392 (123) 217 217. () (Video Arts) Boom Play 2012/12/30 392 (123) 218 218. 2012/12/30 392 (123) 219 219. Video Art ()()2012/12/30 392 (123) 220 220. 2012/12/30 392 (123) 221 221. Play VTS_04_1.VOB 00:08:22 2012/12/30 392 (123) 222 222. ( + ) http://www.youtube.com/watch?v=pmG3NqmQfGM neilwang99 ( > ) http://www.youtube.com/watch?v=XbWkgTO1b0k ( + ) http://www.youtube.com/watch?v=dqT0RM4yqaI neilwang99 http://www.wretch.cc/blog/neilwang992012/12/30 392 (123) 223 223. & 2012/12/30 392 (123) 224 224. 225. AROSS: Augmented Reality Online Shopping SystemEC +AR2012/12/30 392 (123) 226 226. 2012/12/30 392 (123) 227 227. 2012/12/30 392 (123) 228 228. 2012/12/30 392 (123) 229 229. 2012/12/30 392 (123) 230 230. 2012/12/30 392 (123) 231 231. 2012/12/30 392 (123) 232 232. vs. 2012/12/30 392 (123) 233 233. AR: Augmented Reality (VirtualReality) (Augmented Reality) (Mixed Reality)2012/12/30 392 (123) 234 234. Augmented RealityReality and Virtuality (RV) Continuum.2012/12/30 392 (123) 235 235. 2012/12/30 392 (123) 236 236. 2012/12/30 392 (123) 237 237. Augmented Reality2012/12/30 392 (123) 238 238. 2012/12/30 392 (123) 239 239. 2012/12/30 392 (123) 240 240. 2012/12/30 392 (123) 241 241. 2012/12/30 392 (123) 242 242. 2012/12/30 392 (123) 243 243. Display Method (See-Trough AR) (Monitor Based AR)(HeadMounted Display, HMD) Milgram et al. (1944)2012/12/30 392 (123) 244 244. Display Method 2012/12/30 392 (123) 245 245. Markers2012/12/30 392 (123) 246 246. Marker Design Marker size Marker pattern Marker material Webcamresolution: CCD CMOS2012/12/30 392 (123) 247 247. Marker Design Tracking range for different sized patterns1 inches = 2.54 cm2012/12/30 392 (123) 248 248. Marker DesignDaniel (2004) 2012/12/30 392 (123) 249 249. Marker Designhttp://flash.tarotaro.org/blog/2008/12/14/artoolkit-marker-generator-online-released/ 2012/12/30 392 (123) 250 250. Marker Design http://flash.tarotaro.org/blog/2009/07/12/mgo2/2012/12/30 392 (123) 251 251. AR Authoring ToolTools ARToolkit (Augmented Reality Toolkit)OSGARToolkit (Open Scene Graph Augmented Reality Toolkit)ARToolkitPlus (Augmented Reality Toolkit Plus)MRToolkit (Mixed Reality Toolkit)Matlab ARToolkit (Matlab Augmented Reality Toolkit)JARToolkit (Java Augmented Reality Toolkit) MIDAS (Media Interaction Design Authoring System) DART (Designers Augmented Reality Toolkit)ComposAR (Composer Augmented Reality)Build AR (Build Augmented Reality) Black Magic2012/12/30 392 (123) 252 252. AR Authoring Tool FLARToolKit (Flash ARToolKit)ActionScript 3ARToolKitC/JavaUI FLARToolKit + Papervision3D = AR on the web Flash CS3AMIREFLARToolKitVirtoolkitsPapervision3DProcessingWebcam Max/MSPMarker2012/12/30 392 (123) 253 253. AR Authoring Tool ARToolKit http://www.hitlabnz.org/ http://www.hitl.washington.edu/artoolkit/ 2012/12/30 392 (123) 254 254. 2012/12/30 392 (123) 255 255. 2012/12/30 392 (123) 256 256. BlackMagic Book http://www.hitlabnz.org/wiki/BlackMagic_Book2012/12/30 392 (123) 257 257. BuildAR http://www.hitlabnz.org/wiki/BuildAR2012/12/30 392 (123) 258 258. Markerless AR Face Detection () RFID2012/12/30 392 (123) 259 259. OpenCV Face Detection, http://www.youtube.com/watch?v=hNBeEpKtGlo&feature=player_embedded2012/12/30 392 (123) 260 260. Markerless ()2012/12/30 392 (123) 261 261. 2012/12/30 392 (123) 262 262. 2012/12/30 392 (123) 263 263. The Optical Tracking System ELTECs PCEye2 frame-grabber TM-9701 PULNiX.2 Head-mounted display (HMD)2012/12/30 392 (123) 264 264. 2012/12/30 392 (123) 265 265. 2012/12/30 392 (123) 266 266. 2012/12/30 392 (123) 267 267. 2012/12/30 392 (123) 268 268. 2012/12/30 392 (123) 269 269. 2012/12/30 392 (123) 270 270. 2012/12/30 392 (123) 271 271. 2012/12/30 392 (123) 272 272. 2012/12/30 392 (123) 273 273. 2012/12/30 392 (123) 274 274. 2012/12/30 392 (123) 275 275. 2012/12/30 392 (123) 276 276. 2012/12/30 392 (123) 277 277. 2012/12/30 392 (123) 278 278. TaeheeLee, Tobial Hollerer IEEE Virtual Reality 2008 8-12 March, Reno, Nevada, USA2012/12/30 392 (123) 279 279. Handy AR 6 Marker 5 () 13D2010/10/19 Digital Arts and Interactive Design Lab 280 2012/12/30 392 (123) 280 280. Method Description2012/12/30 392 (123) 281 281. Initializinga Coordinate System AR 2012/12/30 392 (123) 282 282. () () + DOF = 6 Degree of Freedom Wiimote Emotion Sensor Camera PS Move 2012/12/30 392 (123) 283 283. 2012/12/30 392 (123) 284 284. Augmented reality andphotogrammetry: A synergy tovisualize physical andvirtual city environments Cristina Portals , Jos Luis Lerma, Santiago Navarro ISPRS (2010)2012/12/30 392 (123) 285 285. 2012/12/30 392 (123) 286 286. 2012/12/30 392 (123) 287 287. 2012/12/30 392 (123) 288 288. 2012/12/30 392 (123) 289 289. 2012/12/30 392 (123) 290 290. 2012/12/30 392 (123) 291 291. AR technology can save more than 50% of the time needed tobuild up the 3D model2012/12/30 392 (123) 292 292. FingARtips - Gesture BasedDirect Manipulation in Augmented Reality FingArtips Volkert Buchmann, Mark Billinghurst, Stephen Violich, Andy Cockburn GRAPHITE 04 Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia2012/12/30 392 (123) 293 293. Introduction AR() Hand-based AR FingARtips AR1. 2. 2012/12/30 392 (123) 294294 294. Related Work Gordon et al. AR[Gordon et al., 2002] Walairacht et al. AR[Walairacht et al., 2002] Dorfmuller-Ulhaas & Schmalstieg [Dorfmuller-Ulhaas & Schmalstieg, 2001] DiZio & Lackner [DiZio & Lackner, 2002]2012/12/30 392 (123) 295 295. FingARtips - The Urban PlanningWorkspace The Uran Planning WorkspaceFingARtips (Grabbing)(Pointing)(Navigating)(Command gestures) 2012/12/30 392 (123) 296 296. FingARtips - The Urban Planning Workspace Grabbing PointingPointing Grabbing 2012/12/30 392 (123) 297 297. FingARtips - The Urban Planning Workspace Pressing NavigationAR / immersive VR Pressing Navigation2012/12/30 392 (123) 298 298. FingARtips - The Urban Design Setup 115x60(cm2)2410x10Marker (AR120x70) 2x2Marker ARToolKitsMarker HMD 2012/12/30 392 (123) 299 299. FingARtips - The Urban Design Setup World Coordinate Tracking() MarkerMarker () Finger Tracking() ARToolKitmarker Hand Tracking() Gordon et al. [Gordon et al., 2002] Marker2012/12/30 392 (123) 300 300. FingARTips - The Hand Model 2012/12/30 392 (123) 301 301. FingARTips Haptic Feedback 400Hz 2012/12/30 392 (123) 302 302. Mobile AR Apple iPhone iPad Google G12012/12/30 392 (123) 303 303. AR Commercialization2012/12/30 392 (123) 304 304. Commercialization The Eye of Judgment2012/12/30 392 (123) 305 305. Commercialization The Eye of Judgment2012/12/30 392 (123) 306 306. Commercialization - ARis http://www.geishatokyo.com/jp/ar-figure/2012/12/30 392 (123) 307 307. Commercialization - ARis http://www.geishatokyo.com/jp/ar-figure/2012/12/30 392 (123) 308 308. Commercialization - ARis http://www.geishatokyo.com/jp/ar-figure/2012/12/30 392 (123) 309 309. 310 Digital Art and Interactive Design Lab.2012/12/30 392 (123) 310 310. AREVLSAugmented Reality English Vocabulary Learning System2012/12/30 392 (123) 311 311. D nserHornecker (2007)2012/12/30 392 (123) 312 312. Kimer et al. (2005)2012/12/30 392 (123) 313 313. 2012/12/30 392 (123) 314 314. ARToolKit3DSketchUp + 3D Warehouse Pentium IV 3.4GHz CPULogitech QuickCam Pro 4000640480frame15604.552012/12/30 392 (123) 315 315. 1. 2. 2012/12/30 392 (123) 316 316. Unit 1 CD 2012/12/30 392 (123) 317 317. 2012/12/30 392 (123) 318 318. 2012/12/30 392 (123) 319 319. 2012/12/30 392 (123) 320 320. HsiehLee(2008)2012/12/30 392 (123) 321 321. 2012/12/30 392 (123) 322 322. non_feature[10][2] D1~D6 framefeature[10][2] frameD1~D6if( D3 ) { if( D6 ) Happy else Disgust } else if( D1 ) { if( D2 ) Surprise else Anger } else if( D3 & D4 ) { if( D5 ) Fear else Sadness2012/12/30 } 392 (123) 323 323. 2012/12/30 392 (123) 324 324. 2012/12/30 392 (123) 325 325. Affective Computing(MIT Media Lab of Affective Computing Group) Context-Awareness2012/12/30 392 (123) 326 326. RID 2012/12/30 392 (123) 327 327. IBM (Ark , 1999) Microsoft Samsung Kodak 2012/12/30 392 (123) 328 328. Picard AboutFace or KlausR. SchererEmotion Group & & 2012/12/30 392 (123) 329 329. - 2008 2012/12/30 392 (123) 330 330. 2012/12/30 392 (123) 331 331. IBM(Blue Eyes) mail mail 2012/12/30 392 (123) 332 332. () Bing 2009-6-262012/12/30 392 (123) 333 333. CEATAC 2009NTT DOCOMO2012/12/30 392 (123) 334 334. 335. Affective Computing + Interactive Arts 2012/12/30 392 (123) 336 336. WordNet WordNet Awesome amazing, awe-inspiring,aweful, awing Synonyms set OMCSNet2012/12/30 392 (123) 337 337. Partial Parsing Sometimes we can skipinner sub-sentence ifthe adverb/adjective strongly suggest the emotion in this sentence. Dominating Term Ex: I delightedly told her that I live in thegarbage pit ever since. 2012/12/30 392 (123) 338 338. Emotion CalculusBased on OMCSnet Chinese Sentence Translator Tagger (or Parser) Keyword Filter (v, n, adv, adj) OMCSnet Computation Emotions2012/12/30 392 (123) 339 339. DEASM (ASM) IMM Face Database 40()*6= 240 TimCootesam_tools 68 2012/12/30 392 (123) 340 340. Start webcam While(1) { Image = read_from_camera; // webcam frames Detect face; // Viola_jones_haarlike detector Initial ize shape from detected box; //shape Do image alignment; //frame Show image; For(int k = 0; k