DESMA 9Art + Science + Technology

Spring 2012Professor Victoria Vesna

Section 1C

Title:

[Special Contact Lens]

Name: [Shuhanhui Zhuang]

ABSTRACT“I love you but … we do not match”

In a relationship, boys and girls often think in different ways toward a same thing. Such difference is unavoidable because male and female are two different kinds of human beings. Sadly, Countless romances finally break up with regrets because of a random small quarrel and this makes the couple reconsider the maintenance of their relationship. However, if the two people still mentally and deeply love each other, their love should not be bothered by the natural differences of thinking. This project is designed to assist young couples to understand each other better by wearing a special contact lens with the use of the technologies of facial expression recognition, OHMD and “big data”.

CONCEPT / TOPICI am interested in helping boys to know what his girlfriend is actually thinking in a relationship. To achieve this goal, I want to design a contact lens which is a technological combination of facial expression recognition and big data, and OHMD.

The concept “big data”: A collection of data sets so large and complex that it becomes difficult to process using on-hand data base management tools or traditional data processing applications. The technologies include capture, curation, storage, search, sharing, transfer, analysis, and visualization.

Facial expression recognition: A various facial motions and behaviors are based on muscle actions and they moves in a certain patterns to represent various expressions. By reading these specific “code”, people’s emotions could be identified based on their facial changes.

OHMD: An optical head-mounted display is a wearable display that has the capability of reflecting projected images as well as allowing the user to see through it.

CONTEXT & PRECEDENTS

IBM uses big data technology to enhance the view of its customers. Extend existing customer views by incorporating additional internal and external information sources. Gain a full understanding of customers—what makes them tick, why they buy, how they prefer to shop, why they switch, what they’ll buy next, and what factors lead them to recommend a company to others.

Google Glass is a wearable computer with an optical head-mounted display that is being developed by Google in the Project Glass research and development project, with a mission of producing a mass-market ubiquitous computer.

FG 2011 Facial Expression Recognition and Analysis Challenge(FERA 2011) is held in conjunction with the IEEE International conference in Santa Barbara. And the accuracy of facial expression recognition is about 0.45 nowadays

PROJECT PROPOSAL

2. The contact lens have a backstage functioning as a cloud storage and cloud computing with huge amount of data such as facial expression recognition and tone identification.

3. The contact lens could identify the context at the moments it receives any kinds of information since all the analysis and decision-making are based on the context.

1. The contact lens are able to receive and record audio and image, and also display images and words in front of the head of users as well as allowing the user to see through it.

The contact lens “Love Assistant” is actually a nanometre computer, and its CPU is supposed to have three major characteristics.

1

2

PROJECT PROPOSAL

Words Facial Expression Context

Contact lens[ nanometre computer ]

Cloud Storage[ Data in past ]

——————————

——————————

1. Case: [In a certain context, the girl says something with certain emotions.]

2. Step 1. The words said by the girl, her facial expression and the context at the moment are projected and recorded into the contact lens.

3. Step 2. The contact lens is a nanometre computer. After gathering the current information, it begins to upload the words, facial

expression as well as the girl’s feedbacks to the backstage.Step 3. *The backstage begins to analyze the data, compares them to the past

ones. And then the backstage projects a feedback on the contact lens of what the girl really wants to mean beyond the words’ literal

meanings.Step 4. *The boy says the words given by the backstage to the girl. Step 5. *The contact lens continue to record the girls feed backs with emotions.

1. 2.

3.4.

Project Proposal (cont.)

As the process happens more times, the backstage has more data of the girls words and emotions to analyze, and then according to the context at the moment, it will provide more accurate suggestions for the boy. As the boy become more able to understand his girlfriend, the relationship will be more smooth. And more importantly, the boy does not have to be struggled as before when he is trying to figure out what he should really reply.

3

4

5

Conclusion

Communication is the major contributor to affect a romantic relationship. If the couple can understand each other better, their romance might more possibly grows to a marriage.

This project is designed to achieve this goal by using technological method to assist and improve communications between couples. On the one hand, emotions are the most true language of human beings, and facial expression recognition technology is a use of science to explore the art of emotions. On the other hand, thoughts are the most random flows in minds, and with the use of “big data”, the thoughts could be analyzed more and more clear according to the contexts. Furthermore, love is the most beautiful art in the world and now we might possibly use technology to read it and assist it. Hope in future, there is no “but” after “I love you”.

References1. <http://spie.org/x88964.xml>2. <http://www.dgp.toronto.edu/~victorng/research.html>3. <http://www.greenbookblog.org/2012/03/21/big-data-opportunity-or-threat-for-market-research/>4. <http://www.socialliteracytoday.com/?page_id=74>5. <http://www.cloudstoragebest.com/cloud-storage-risks-vs-cloud-storage-benefits/>6. FG 2011 Facial Expression Recognition and Analysis Challenge (FERA2011) <http://sspnet.eu/fera2011/>7. “Google Glass” http://en.wikipedia.org/wiki/Google_Glass8. “5 Game changing big data use cases.” IBM. 2013 <http://www-01.ibm.com/software/data/bigdata/use-cases.html>

Bibliography / Links1. “Big Data: The Next Frontier for Innovation, Competition and Productivity.” McKinsey & Company. 2011-5-4 <http://www.mckinsey.com/insights/business_technology/big_data_the_next_frontier_for_innovation>2. “5 Game changing big data use cases.” IBM. 2013 http://www-01.ibm.com/software/data/bigdata/use-cases.html>“How Cloud Storage Works.” Jonathan Strickland. 2012 <http://computer.howstuffworks.com/cloud-computing/cloud-storage.htm> 3. “Big Data Transforms Business” EMC2. 2013 <http://www.emc.com/campaign/bigdata/index.htm>4. “Analytics: The Real-world use of big data” IBM <http://www-935.ibm.com/services/us/gbs/thoughtleadership/ibv-big-data-at-work.html>5. “Big Data study Reveals Enterprise Attitudes, Engagement, and Challenges.” James E. Powell, 2013-10-22 <http://tdwi.org/articles/2013/10/22/big-data-study.aspx>6. “Big Data Study – The 10 Key Findings” TSC, 2013 http://sites.tcs.com/big-data-study/big-data-study-key-findings/7. “Webinar Replay: What You Can Do With Hadoop: Building Big Data Applications with Hadoop & Spring.” Nikesh Shah, Mark Fisher, James Williams, 2013 <http://spring.io/blog/2013/10/29/webinar-replay-what-you-can-do-with-hadoop-building-big-data-applications-with-hadoop-spring> 8. “'Big data' applications bring new database choices, challenges.” Andy Hayler 2012 <http://www.computerweekly.com/feature/Big-data-applications-bring-new-database-choices-challenges>9. ” 2014, the year of Big Data applications | #BigDataNYC 2013” Valentia Craft, 2013-10-31 <http://siliconangle.com/blog/2013/10/29/2014-the-year-of-big-data-applications-bigdatanyc-2013/>10. “Abhi Mehta on Big Data apps | #BigDataNYC 2013” Maria Deutscher, 2013-10-31 <http://siliconangle.com/blog/2013/10/31/abhi-mehta-on-big-data-apps-bigdatanyc-2013/>11. “Facial expression recognition based on Local Binary Patterns: A comprehensive study.“ Caifeng Shan, Shaogang Gong, Peter W, McOwan. 2009-4-4 <http://www.sciencedirect.com/science/article/pii/S0262885608001844>12. “Is there universal recognition of emotion from facial expressions?” Russell, James A. Psychological Bulletin, Vol 115(1), Jan 1994, 102-141. doi: 10.1037/0033-2909.115.1.10213. “Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron” Zhengyou Zhang ; Inst. Nat. de Recherche en Inf. et Autom., Sophia Antipolis, France ; Lyons, M. ; Schuster, M. ; Akamatsu, S. 14-16 Apr 1998. 10.1109/AFGR.1998.67099014. “Comprehensive database for facial expression analysis ” Robotics Inst., Carnegie Mellon Univ., 2000, 10.1109/AFGR.2000.84061115. “Emotion recognition via facial expression and affective prosody in schizophrenia: A methodological review.” Jane Edwards, Henry J Jackson, Philippa E Pattison, 2002, <http://www.sciencedirect.com/science/article/pii/S0272735802001307>16. “Understanding the recognition of facial identity and facial expression.” Andrew J. Calde, Andrew W. Young, 2005-8 <http://www.nature.com/nrn/journal/v6/n8/abs/nrn1724.html>17. “Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala” R. Adolphs, D. Tranel, H. Damasio & A. Damasio, 1994 <http://www.nature.com/nature/journal/v372/n6507/abs/372669a0.html>18. “Google Glass: what you need to know” By James Rivington, August 8th, <http://www.techradar.com/us/news/video/google-glass-what-you-need-to-know-1078114>19. “Stigma and expressed emotion: a study of people with schizophrenia and their family members in China.” Michael R. P., Veronica Pearson, 2012, <http://bjp.rcpsych.org/content/181/6/488.short>20. “SAP Developer Lead: HANA Is Ready To Code Big Data Apps” Adrian Bridgwater, October 24, 2013 <http://www.drdobbs.com/tools/sap-developer-lead-hana-is-ready-to-code/240163087>21. ^ "Google Glasses Sound As Crazy As Smartphones And Tablets Once Did". Forbes. 5 April 2012. Retrieved 5 April 2012.