natural language processing frank bergman mike gallagher jason firestone barcelona, october 19th,...

Natural Language ProcessingFrank BergmanMike GallagherJason Firestone

Barcelona, October 19th, 2001

Stacked Layers of Language

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Person A Person B

Infrastructure

VoiceRecognition

SyntaxParsing

SemanticAnalysis

Translation/Processing

VoiceGeneration

Generation

Philips Genie

IBM Via Voice

SAM,AT&T Synthesizer

BabelFish, Systran, other translators

Verbmobil, Train Information Systems

Ramona

Verbmobil: Speech2Speech Translation

Verbmobil Video http://verbmobil.dfki.de/overview-us.html

Speech: Audio signals

Person A Person B

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

“I am hungry”

„I am hungry“

Audio Signals

Syntax: Sentence structure

Pragmatics

Semantics

„Thoughts“

Speech

Pragmatics

Semantics

„Thoughts“

Speech

Person A Person Btext=„I am hungry“type=noun_phrase;

verb=

text=„am“ type=verb;time=pres;pers=1st;infinitive=„be“;

subject =

adverb =

text=„hungry“type=adjective;case=nom;pers=1st;

text=„I“ type=pronoun;case=nom;pers=1st;

Syntax Syntax

Grammar Formalisms: DCG, HPSG, …

Semantics: „Meaning“ and Logics

Pragmatics

„Thoughts“

Syntax

Speech

Pragmatics

„Thoughts“

Syntax

Speech

Person A Person B

x.self(x) hungry(x)

Semantics Semantics

Logic Formalisms: FOL, Lambda Calculus, …

Pragmatics: The „world“ around us

Semantics

„Thoughts“

Syntax

Speech

Semantics

„Thoughts“

Syntax

Speech

Person A Person BI

State

FoodBody

Body

Person

empty

desire

has_value

has_property

State

has_valuehas_property

instance

instance

has_part

eatfullPragmatics Pragmatics

Frames, Semantic Networks, Description Logics, …

„Thoughts“: What we „feel“

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Person A Person B

„I am hungry“

Markets

AutomaticTranslation

SpeechInput

DialogSystems

Players• Philips• IBM• Lernout & Hauspie• AT&T

Market Conditions• High entrance

barriers• Low margin products

Commercial Impact

The generated value is very lowThe technology doesn‘t work yet

The Future

Current:Low margin add-on to operating systemsAutomatic translations have bad quality

Next 5 Years:Low margin add-on for mobile devicesTranslation quality will slightly enhanceDialog systems becoming more common

Next 20 Years:Speech processing will become ubiquous in public life, but no „real intelligence“Translation quality will slightly enhance

Links

Verbmobil: http://verbmobil.dfki.de/AT&T Demo: http://www.naturalvoices.att.com/demos/Philips Speech Processing: http://www.philipsspeechprocessing.com/ Babelfish http://www.babelfish.com/ Lernout & Hauspie http://www.lhsl.com/ Ray Kurzweil AI Net: http://www.kurzweilai.net/ ALICE: http://www.alicebot.org