alexander gelbukh moscow, russia
DESCRIPTION
Alexander Gelbukh Moscow, Russia. Mexico. Computing Research Center (CIC), Mexico. Chung-Ang University, Korea Electronic Commerce and Internet Application Lab. Natural Language Processing. Alexander Gelbukh www.Gelbukh.com. What language is. Better communication with computers. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/1.jpg)
1
Alexander GelbukhMoscow, Russia
![Page 2: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/2.jpg)
2
Mexico
![Page 3: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/3.jpg)
3
Computing Research Center (CIC), Computing Research Center (CIC), MexicoMexico
![Page 4: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/4.jpg)
4
Chung-Ang University, KoreaChung-Ang University, KoreaElectronic Commerce andElectronic Commerce andInternet Application LabInternet Application Lab
![Page 5: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/5.jpg)
Natural Language Natural Language ProcessingProcessing
Alexander Gelbukh
www.Gelbukh.com
![Page 6: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/6.jpg)
6
What language isWhat language is
Linguistic
module
Sentido
This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is an example of the output text of the system. This is the output text of the
Texto
Lan- guage
Expert System experto
Linguistic
module
Voice, OCR
![Page 7: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/7.jpg)
7
Better communication with computersBetter communication with computers
0101011101010001101010111o101001011
VS.
Persons are more productive when speaking their own language
![Page 8: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/8.jpg)
8
Accessibility of computers for allAccessibility of computers for all
vs.
It’s easier to teach one computer how to speak than teach generations of people how to use computers
![Page 9: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/9.jpg)
9
Better knowledge managementBetter knowledge management
vs.
Computers are better than people at managing information
![Page 10: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/10.jpg)
10
Solution:Solution:Language understanding by Language understanding by
computerscomputers
![Page 11: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/11.jpg)
11
ApplicationsApplications
Information retrieval (Internet search. Google) Question Answering (Internet) Information extraction (Fill a DB from newspapers) Automatic translation OCR, speech recognition Natural Language Interfaces (robots, computers) Interaction of agents
Thinking computers? Think = speak
![Page 12: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/12.jpg)
12
Source of language complexity: 1-DSource of language complexity: 1-D
This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the
Language
Text (speech)
Meaning Meaning
........Text Text.......
Bra
in 1
Brain 2
![Page 13: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/13.jpg)
13
Knowledge Knowledge
Lan-guage
Lan-guage
This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture. This is a text that represents the meaning shown in the right part of the picture.
Text
Source of language complexity: 1-DSource of language complexity: 1-D
![Page 14: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/14.jpg)
14
Linguistic processorLinguistic processortranslates between representationstranslates between representations
Linguisticmodule
Meanings
This is an example of the output text ofthe system. This is an example of theoutput text of the system. This is anexample of the output text of thesystem. This is an example of the outputtext of the system. This is an example ofthe output text of the system. This is anexample of the output text of thesystem. This is an example of the outputtext of the system. This is an example ofthe output text of the system. This is anexample of the output text of thesystem. This is an example of the outputtext of the system. This is an example ofthe output text of the system. This is anexample of the output text of thesystem. This is an example of the outputtext of the system. This is an example ofthe output text of the system. This is anexample of the output text of thesystem. This is an example of the outputtext of the system. This is an example ofthe output text of the system. This is an
Texts
Linguisticmodule
Appliedsystem
![Page 15: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/15.jpg)
15
General scheme of text General scheme of text processingprocessing
L inguistic processor
Applied system
(e.g., Expert system)
Out-put
In-put
(Semantic) representation
Linguistic processor uses linguistic knowledge Applied system uses other types of knowledge
(e.g., Artificial Intelligence)
![Page 16: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/16.jpg)
16
Language levelsLanguage levels
Morphological: words Syntactic: sentences Semantic: meaning Pragmatic: intention ...?
![Page 17: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/17.jpg)
17
This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture. This is a text that represents themeaning shown in the right part of thepicture.
LanguageText Meaning
Morphologicalrepresentation
Syntacticrepresentation
Morpho-logicaltrans-former
Syntac-tic
trans-former
Seman-tic
trans-former
Semanitcrepresentation
Surfacerepresentation
Fine structure of linguistic processor
![Page 18: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/18.jpg)
18
Example of textExample of text
““Science is importantScience is importantfor our country.for our country.
The Government pays it The Government pays it much attention.”much attention.”
![Page 19: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/19.jpg)
19
Textual representationTextual representation
Text is a sequence of letters.
S c i e n c e i s S c i e n c e i s i m p o r t a n t i m p o r t a n t f o r o u r c f o r o u r c o u n t r y . T h e o u n t r y . T h e G o v e r n m e n G o v e r n m e n t p a y s i t t p a y s i t m u c h a t t e n m u c h a t t e n t i o n t i o n ..
![Page 20: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/20.jpg)
20
Linguistic processor
Morpho-logical
analyzer
Semantic analyzer
Syntactic parser
Morphologicalanalysis
Morfological analysisMorfological analysis
![Page 21: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/21.jpg)
21
Morphological Morphological representationrepresentation
A sequence of words.The THE article definite, plural/singular
science SCIENCE noun singular
is BE verb present, 3rd person, sing.
important IMPORTANT adjective
for FOR preposition
our WE pronoun possessive
country COUNTRY noun singular
![Page 22: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/22.jpg)
22
Linguistic processor
Morpho-logical
analyzer
Semantic analyzer
Syntactic parser
Syntacticparsing
Syntactic parsingSyntactic parsing
![Page 23: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/23.jpg)
23
Syntactic representation Syntactic representation
A sequence of syntactic trees.
BE
SCIENCE IMPORTANT
COUNTRY
WE
of
PAY
GOVERNMENT ATTENTION IT
MUCH
![Page 24: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/24.jpg)
24
Linguistic processor
Morpho-logical
analyzer
Semantic analyzer
Syntactic parser
Semanticanalysis
Semantic analysisSemantic analysis
![Page 25: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/25.jpg)
25
Semantic representationSemantic representation
Complex structure of whole text
SCIENCE
IMPORTANT
COUNTRY
WE
GOVERNMENT
ATTENTION
is
of
gives
for
of for
Funding
Organization
Sector
Money
is a main form
needs
is a
gives
is a implies
![Page 26: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/26.jpg)
26
The meaningThe meaning
““La ciencia es importante para La ciencia es importante para nuestro país.nuestro país.
El Gobierno le pone mucha El Gobierno le pone mucha atención.”atención.”
La LA articulo determinado, femeninociencia CIENCIA sustantivo feminino, singular
es SER verbo presente, 3ª persona, sing.importante IMPORTANTE adjetivo singular
para PARA preposicion ---nuestro NOSOTROS pronombre posesivo
pais PAIS sustantivo masculino, singular
SER
CIENCIA IMPORTANTE
PAIS
NOSOTROS
de
PONER
GOBIERNO ATENCION
LE MUCHA
Presupuesto
Organizacion
Sector
Dinero
es unForma
principal
nececita
es un
da
es un implica
CIENCIA
IMPORTANTE
PAIS
NOSOTROS
GOBIERNO
ATENCION
es
de
da
para
depara
““Science is important for our Science is important for our country. The Government pays it country. The Government pays it much attention.”much attention.”
There are good conditions for development of science in our country.
![Page 27: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/27.jpg)
27
Example: TranslationExample: Translation
?
Morphologicallevel
Syntacticlevel
Textlevel
Semanticlevel
The Meaning,yet unreachable
Language A Language B
![Page 28: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/28.jpg)
28
ProblemsProblems
Ambiguity of text I see a cat with a telescope
Knowledge needed Linguistic About the world and life
Good newsLearning from texts
Plenty of texts in Internet! Good statistical methods
![Page 29: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/29.jpg)
29
![Page 30: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/30.jpg)
30
![Page 31: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/31.jpg)
31
![Page 32: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/32.jpg)
32
![Page 33: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/33.jpg)
33
![Page 34: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/34.jpg)
34
Current stateCurrent state
Working...
![Page 35: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/35.jpg)
35
ConclusionesConclusiones
¿Is it necessary?¿Is it simple?¿Is it possible?¿Has been done something?¿Has been done all?¿Where are people working on it?
![Page 36: Alexander Gelbukh Moscow, Russia](https://reader035.vdocuments.mx/reader035/viewer/2022062222/56815156550346895dbf77d2/html5/thumbnails/36.jpg)
36
Thank you!www.Gelbukh.com