Oh!

Helping your child to learn Facial Expressions

http://oh.cloudapp.net/oh

Our Team members

Justin > Kinect Development > main idea

Zong > Kinect Development

David > Audio input > Kinect Development

Marion > Social Media

Tebo > Reporting loop for Therapy and Parent Monitoring

Kelesy > Asset creation > UI Layout

Aimee Maree > Gamification > Team Strategy

Nick > Start-up strategy > Team Mentoring

Our Mission

Help Teach Facial Expression

Key Areas

Aimed at Children 3 > 5

Early Intervention

Help them recognise facial expressions

Provide meta-data capture in order to create reports that can be shared between parents, therapists and teachers

Adding interactivity to a proven method

In the past therapists, teachers and parents have used Flash Cards to teach Autistic Children facial expressions

There are now tablet applications that enable the Flash Card model to be used on a tablet to enable some touch interaction

We want to take that proven method and add some new features that suit todays modern immersive methods of education

Show that immersive technologies such as the Kinect can help foster new learning environments

What are we doing that is different

Adding a new level of interaction with the Kinect motion detection

Adding in a new level of reward systems

Allowing for a digital report to be captured and shared between selected parties to monitor the child’s progress

Allowing for a level of customisation to allow Therapists, Parents and Teachers a way to make the application personalised

To enable to Child to have a one on one relationship with the subject matter by way of seeing their own face as well as having rewards that they are interested in (aka Cars Video, MineCraft videos etc)

Why customisation is important?

At recent SXSW “Apps for Autism” presentation the main feedback from therapists and Parents was “We Want to Customise our applications”

At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of”

Customisation enables the application to grow with the child and for them to see their own facial expressions

Rewards are customised through the selection of “You Tube” videos that the child relates to > For example “Steve’s” Child likes the Cars movie he can select a “You Tube” video of Cars

Meta-Data collection and Reporting

Reports are collected at points through-out the apps

The reports are sent to the “Cloud”

At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of”

Customisation enables the application to grow with the child and for them to see their own facial expressions

Cognitive Aspects

Enabling a child to see their own Face making a facial expression

Enabling a child to understand the shape that represents an expression

Fostering neural paths between shapes and expression

Allowing for the child to categorise expressions and related shapes

Allowing a child to not just see a picture of a Smile but to see themselves Smiling to enable further pathway building and strengthing

Main Technologies

Kinect SDK > To provide an interactive interface for learning

HTML / CSS / JS > to provide animations and UI layout

Azure > to provide a centralised place for reporting and to enable Parent / Teacher / Therapist login

Windows Desktop Application > First prototype to run on a desktop, future builds can run in Metro 8 UI and Xbox Live

High level view of WorkFlow

• Three levels

• Animation Reward

• Game progression through levels

• Capture meta-data for therapists and parents to enable monitoring of a child's progression

Our Prototype

Resources

What makes a Good Autism App http://momswithapps.com/2010/08/04/c

haracteristics-of-great-apps-for-kids-with-autism/

http://bridgingapps.org/2013/03/apps-for-autism-presentation-at-sxsw-13/

http://www.iidc.indiana.edu/?pageId=601

Autism Expert Bodies http://bridgingapps.org

http://www.autismspeaks.org/

http://www.autismspectrum.org.au

http://globalautismawareness.blogspot.com

http://www.templegrandin.com/