an interdisciplinary approach to alternative representations for images

17
Bruno Splendiani, Mireia Ribera, Roberto García, Marina Salse ICCHP Conference 2012 – ULD track An interdisciplinary approach to alternative representations for images

Upload: brusplen

Post on 04-Jul-2015

286 views

Category:

Education


2 download

TRANSCRIPT

Page 1: An interdisciplinary approach to alternative representations for images

Bruno Splendiani, Mireia Ribera, Roberto García, Marina Salse

ICCHP Conference 2012 – ULD track

An interdisciplinary approach to

alternative representations for images

Page 2: An interdisciplinary approach to alternative representations for images

Overview

• Introduction

• Proposal

• Scenario

• Conclusions

2 Bruno Splendiani (2012)

Page 3: An interdisciplinary approach to alternative representations for images

Introduction (1)

Basic Recommendation in Accessibility

“Provide text alternatives for any non-text content”

[Source: WCAG 2.0]

But

Accessibility guidelines only offer general recommendations

No standards defining:

• the analysis and creation of visual content

□ Relevant exceptions

• the process of image description in publishing workflow

□ Relevant exception

Bruno Splendiani (2012) 3

Page 4: An interdisciplinary approach to alternative representations for images

Introduction(2)

So, we have to offer a text alternative, but HOW?

• How to improve the accessibility to visual content

and the retrieval of images?

• How to make easier the creation of alternative

representations?

• How to adapt visual information to specific contexts

of use?

Bruno Splendiani (2012) 4

Page 5: An interdisciplinary approach to alternative representations for images

Proposal

Interdisciplinary approach

Accessibility

Information Visualization (InfoVis)

Library and Information Science (LIS)

Semantic Web

Computer Vision

How can the cross-fertilization of these disciplines help us

to improve accessibility and retrieval of images?

Let’s see an example!

5 Bruno Splendiani (2012)

Page 6: An interdisciplinary approach to alternative representations for images

Scenario /Biomedical image

We have an image A digital, visual representation that convey data

and information with the intention “to describe,

explain, inform or instruct” [Source: Engelhardt]

Biomedical image

“Magnetic resonance imaging of a brain with a probable case of white epidermoid cyst”

Bruno Splendiani (2012) 6

Page 7: An interdisciplinary approach to alternative representations for images

Scenario /Life cycle (1)

The image in a life cycle

Created by an author

Managed, manipulated and archived

by an information specialist

Used in a scientific publication

according to a publisher

Accessed and searched

by an end-user Bruno Splendiani (2012) 7

Page 8: An interdisciplinary approach to alternative representations for images

Scenario / Life cycle (2)

In the “image lifecycle”

many actors are involved

in different steps of the process,

with different roles,

specific information needs

and contexts of use.

In every step a different discipline could contribute to

the improvement of the image description and retrieval

8 Bruno Splendiani (2012)

Page 9: An interdisciplinary approach to alternative representations for images

Scenario / Step 1

From data to visual representation

Disciplines involved

• LIS : Embedded metadata

i.e. DICOM headers: modality type, equipment

number, acquisition parameters, image resolution….

9 Bruno Splendiani (2012)

Page 10: An interdisciplinary approach to alternative representations for images

Scenario / Step 2

Image Manipulation

• Computer Vision: object recognition

Bruno Splendiani (2012) 10

Page 11: An interdisciplinary approach to alternative representations for images

Scenario / Step 3

Image Management

• LIS: controlled vocabularies: UMLS, Mesh, ICD9…

• InfoVis: visual variables and rules of construction

• Semantic Web:

Ontologies i.e.: Bioontology /DBPediaBrain

Metadata schemas: i.e.: Schema.orgBrain Structure

11 Bruno Splendiani (2012)

Page 12: An interdisciplinary approach to alternative representations for images

Scenario / Step 4

From management to publication

• LIS: techniques to associate metadata to the image

• Semantic Web: models of relation to different parts of the

article

• Accessibility: demands requirements, offers specific

techniques to include alternative information (i.e. alt-text,

longdesc, etc.)

12 Bruno Splendiani (2012)

Page 13: An interdisciplinary approach to alternative representations for images

Scenario / Step 5

Access to publication by end-user

• Information Retrieval (LIS and Semantic Web)

• Accessibility: allow multimodal access by assistive

technologies

• InfoVis: adaptation of the image in different contexts of

access

13 Bruno Splendiani (2012)

Page 14: An interdisciplinary approach to alternative representations for images

Scenario / Process

The “image life cycle”

14

Page 15: An interdisciplinary approach to alternative representations for images

Scenario / Example

Bruno Splendiani (2012) 15

Page 16: An interdisciplinary approach to alternative representations for images

Conclusions

The interdisciplinary approach

could improve

access to images for people

with disabilities

image’s retrieval

adaptation to different

contexts of use

16 Bruno Splendiani (2012)

Page 17: An interdisciplinary approach to alternative representations for images

Thanks!

Any questions?

Bruno Splendiani

[email protected]

Bruno Splendiani (2012) 17