Interaction Interface for illiterate and semi-illiterate mobile users

Prepared by: Ronald J Februarie

SupervisorProf. Henry O. Nyongesa

CONTENT

• Literacy• Health literacy• Interface design• Interaction design

LITERACY

• Illiteracy is not a human condition but merely a literacy indicator

• Literacy has traditionally been described as the ability to read and write

• reading ability is measured by the accuracy, fluency and understanding comprehension -[Fountas & Pinnell]

• written content can be measure and grade at a level that correspond to schooling levels

literacy

• National Literacy Act of 1991 in the USA– PROSE LITERACY :

Read, write and speak – NUMERIC LITERACY :

Compute and solve problems

– FUNCTIONAL LITERACY :» Function on the job and

in society » Achieve one’s goals» Develop one’s

knowledge and potential

Functional literacy

• Functional literacy are being define as being able to use printed and written information, to achieve one’s goals and to develop one knowledge and potential.

• allow the individual to continue their function; assist them to achieve their goals and to develop within a specific application area.

LITERATELITERATE

HEALTH LITERACY

Functional Space

MAISHA

HEALTH LITERACY

Functional Space

MAISHA

ILLITERATEILLITERATE

Healthy literacy [Application Area]

• Wikipedia define health literacy as an individual's ability to read, understand and use healthcare information to make decisions and follow instructions for treatment.

• WHO• the achievement of a

level of knowledge, personal skills and confidence to take action to improve personal and community health by changing personal lifestyles and living conditions

Healthy literacy [Application Area]

• Complex text is very common in health information

• Healthy literacy should not communicate medical facts but these interactions should be focused on behavioral information.

THE BRIDGE

• A communication bridge must be build that will assist prose and numeric illiterate patients to understand information [text to speech]

• influence action and behavior of patients

• emphasis that learning is part of treatment

• help patient understand change

• help them recall and enforce action

• Enable functional literacy

Interface design

• Interface design focus on the detailed look-and-feel of the product

• structures, classifications, presentation, navigation, context of the access medium, device speed and latency as well as user experience

• should assist users to make the most of their interaction with the system

• Text-free Interface• These are more

acceptable for illiterate and semi-illiterate users

• Speech recognition seen as a key to universal access to information

Interface Usability Guidelines• right balance between user

needs and application purpose• Anthropomorphic Approach: a

user interface to possess human-like qualities

• Cognitive Approach: considers the abilities of the human brain and sensory-perception in order to develop a user interface that will support the end user

• Predictive Modeling Approach:Goals, Operators, Methods, and Selection Rules (Card, Moran, & Newell, 1983)

• The GOMS model is based on human information processing theory, and certain measurements of human performance are used to calculate the time it takes to complete a goal.

Current Research

• Microsoft research lab, Bangalore India

• to understand the optimal audio-visual representation for illustrating concepts for illiterate and semi-illiterate users

• text, static drawings, static photographs, hand-drawn animations, and video, each with and without audio

• how comprehensible these representation types were for an illiterate audience

Current Research

• voice annotation generally helps in speed of comprehension

• bimodal audio-visual information can be confusing for the target population

• richer information• is not necessarily better

understood overall

• relative value of dynamic imagery versus static imagery depends on various factors

Quantitative Results

Qualitative Results

• Richer information is not necessarily better understood overall

• Unrelated context laying activity changes value of static versus dynamic imagery

• Unrelated context laying activity changes value of static versus dynamic imagery

• Socio-economic conditions correlated with cognition

Representations

RESEARCH AREA

• concerned with the implementation of different representational techniques

• comparing these techniques to establish an even better communication

• effectiveness of interfaces for information communication using contextual design methods to develop a mobile UI for the specific target group

Interaction design

• the process that helps to make sense of things (Dakstra & Erickson )

• constructing the interspaces in which people live, rather than the interface with which they interact

• Interaction is contextual; it solves problems under a particular set of circumstances

• need to understanding the goals people want to achieve and for what purpose

Interaction design

• create a blueprint for the new service that can support users’ everyday and extraordinary needs.

• need to understand user’s capabilities and limitation, details of their lives and things they do and use

• from the data structure design to screen layout

• the needs in terms of functionality, how its access, how content is presented, help and feedback information, to system state and integration

• Evaluating what has been built is very much at the heart of interaction design

Interaction design• Interaction design outlines usability goals;• Effectiveness:

How good the system is at what it’s supposed to do?

• Efficiency: How well does the system support users in carrying out their tasks?

• Safety: How does well does the system handle unwanted accidentally actions?

• Utility: IS the right kind of functionality implemented?

• Learnability: How easy is it for a new user to learn?

• Memorability: How easy is it for user to remember once they have learned to use the system?

Set user experience goals;• Satisfying• Enjoyable• Fun• Entertaining• Helpful• Motivating, and Usability principals• These principals are not intended to specify how

to design an interface; but act more as a set of reminders to ensure that the interface provide for certain things.

• • Visibility• Feedback• Constraints• Mappings• Consistency• Affordance

MAISHIA APPLICATION OBJECTIVES

• to assist illiterate patients in processing, and understand the basic health information and services they need to make appropriate health decisions

• Greater adherence to treatment regimens

• Engagement in appropriate self-care

• Improved health status• Understanding/make sense of

clinicians instructions• Provide appropriate material• Encourage desirable behavior• Medication identification, storage,

and administering support• Motivation• Self assessment information• Drug literacy

Reference:

• Smith, Sandra A. (2001). Patient Education and Literacy in Labus, A. & Lauber, A. (Eds.) Preventive Medicine and Patient Education. Philadelphia: WB Saunders, 266-290.

• Text-Free User Interfaces for Illiterate and Semi-Literate Users. Indrani Medhi, Aman Sagar, and Kentaro Toyama

• Health Literacy: A Prescription to End Confusion, Institute of Medicine,• Rethinking Health Literacy - Sandra Smith• SAM Suitability Assessment of Materials, Doak, Doak, Root 1996• Indrani Medhi, Archana Prasad, kentaro Toyama. Optimal Audio-Visual

Representations for illiterate users of computers.• Marcel Goetze and Thomas Strothotee. An approach to help functional

illiterate people with graphical reading Aids. Department of Simulation and Graphics, University of Magdeburg.

THANK YOU