taxonomy tools: collaboration, creation & integration dow jones … · 2007. 9. 14. ·...

Taxonomy Tools: Collaboration, Creation & Integration – iKMS Workshop, Singapore

Taxonomy Tools:

Collaboration, Creation &

Integration

Dave Clarke

Global Taxonomy Director

[email protected]

Dow Jones & Company


Introduction

1. Collaboration 2. Creation 3. Integration

Software Tools for Taxonomy


– Handle massive volumes of data 24x7 every day:

• Over 500,000 documents per day

• 10,000+ Sources

• 22 languages

– Expertise to create and maintain a robust taxonomy including:

• 310,000+ company codes

• 820+ industries

• 520+ subjects

• 340+ regions

60

Terra Byte

Content Server

3.6 Million

Documents/Month

700

Feeds

152

Countries

Dow Jones


Taxonomy Tools


Collaboration

• WHO needs to get involved?

• WHAT do they need to do?

• HOW do they work together?


WHO

• Categorization

• Content Management

• Information Technology

• Knowledge Management

• Knowledge Workers

• Library

• Metadata

• Ontology

• Search

• Subject Matter Expertise

• Taxonomy

Cross-functional

Team


WHAT

Assess

Business Goals

Content

IT

Metadata

Taxonomy

Standards & Best

Practices

Users

Design

Audience

Segmentation &

Definition

Facet Analysis

Information

Architecture

Editorial

Guidelines &

Workflow

Build

Entity Extraction

(machine and/or

human)

Content Tagging

Rules (machine

and/or human)

Taxonomy

Construction &

Mapping

Maintain

Continuous

Work-in-progress

Engage end-

users (query log

analysis, focus

groups,

folksonomy)

Governance

Process


HOW

• Web workspace

• Task-oriented

• Role-based

• Workflow

• Governance alerts


HOW

• Web workspace

• Task-oriented

• Role-based

• Workflow


Location independent

access for in-house

stakeholders and very

often external

consultants and SMEs


HOW

• Web workspace

• Task-oriented

• Role-based

• Workflow

• Governance alertsWork-oriented views for

teams of people

performing different

tasks…

…the flip side of the

collaboration coin is

compartmentalization


HOW

• Web workspace

• Task-oriented

• Role-based

• Workflow


Multiple levels of

functional permission for

fine-tuning what users

can do to particular sets

of terms


HOW

• Web workspace

• Task-oriented

• Role-based

• Workflow


New Candidates

Deactivated / Deleted

Rejected for Rework

Withdrawn &

Replaced By

Primary Review

Secondary

QC

Approved &

Published


HOW

• Web workspace

• Task-oriented

• Role-based

• Workflow


Design “need-to-know”

reports for each

stakeholder group /

stage in the workflow


HOW

• Web workspace

• Task-oriented

• Role-based

• Workflow

• Governance alerts Schedule the reports to

be generated

automatically

And to email alerts to

designated recipients


Creation(models, methods and trends for building taxonomies)

• Folksonomies

• Taxonomies

• Semantic webs


Classic Taxonomy

Classification based

Web portals

Navigation aids

File-folder metaphor

Ad-hoc groupings

2-dimensional


Faceted Taxonomy

Separate taxonomies for

individual attributes

Content tagged

to facets

separately

not

pre-

-coordinated

Used as orthogonal

search filters

n-Dimensional


Faceted Taxonomy in Action


Folksonomy

Web 2.0Folksonomy

Social tagging

Wikis

Blogs

User participation

Un-controlled Un-structured

Tag

Clouds

Collaboration


Pros & Cons

Folksonomy lets

users create (and

adopt) terminology

that is meaningful to

themselves but does

so at the expense

of precision and

recall for the

general user (meta

noise).

Controlled

vocabularies

solve the

precision-recall

trade off but their

insistence on “preferred

terminology” imposes one-

size-fits-all order on a

heterogeneous user community.


A Middle Path

Audience-Centric Taxonomy

1. Segment a user community into “Audiences”

2. Develop a core-taxonomy but append

extensions to it which store the terminology

and hierarchy preferences of each audience

3. Leverage folksonomy and social tagging

systems to help inform the evolution of the

audience-centric taxonomies


Audience-Centric ViewsThe world of your content

Conceptual

representation of

the content as a

semantic web

Audience-centric

views provide

access and

navigation

orientated for

different user

perspectives


Semantic Webs & Ontologies

sem

antic

web

Formally defined

relationships

Concept-oriented rather

than terminology-

oriented

Extensible concept

types & extensible

relationship types

Resource Description

Framework (RDF)


Integration

• Components

• Talking to each other

• RDF Files & Web Service

Calls


Components

Taxonomy

Content

Categorization

Search


Taxonomy

Categorization

Content Search

Open

Standards

• n Components

• 1 Common integration

W3C RDF-based Open

Standards (SKOS & OWL)

Web Services – ad hoc

transactions and small

data sets

XML File Libraries –

published versions and

large data sets

Talking to Each Other


EXAMPLE

From Idea to

Published Output


John Doe

ABC Corporation

New York

Employed

By

Employer

Of

Located

In

Location

Of

Manufacturer

Of

Vendor

To

WidgetsManufactured

By

PQR Corporation

XYZ Corporation

Client

Of

Client

Of

Vendor

To

whiteboard your entities and

relationships


Step 1

Design the

conceptual

structure

•Concept types

•Data elements

•Relationship types

•Semantic rules


Step 2

Input entities and

build relationships

•Key data via GUI

•Import Excel files

•Import XML files


Step 3

Publish

•HTML Browser

•CSV Download

•XML/RDF Export

HTML

CSV

XML

From

whiteboard to

published RDF

in 30 minutes


[email protected]

Thank

YouQuestions

Comments