Scandsum Meeting

CognIT a.s: Document Analysis and

Summarizing with CORPORUM™

Skagen,September, 14th 2002

Till Christopher Lechtill@cognit.no

•Company info•CORPORUM™ technology•CORPORUM™ products (focus on summarizer)

•CognIT R&D

CognIT a.s

• Develops KM solutions for the Intra/internet• Built KBS solutions since 1983• Built KM solutions since 1994• Develops Technology and Know-How for:

– intelligent search by means of agents– text analysis and extraction– structuring and fusing data to build knowledge– knowledge bases and feedback of experience– data mining and text mining

• Focus on transparent work processes, “real communication” and business intelligence

• Established in Halden, Norway in 1996.

• 20 employees - 3 with PhD• offices in Halden and Oslo• Profit invested into product related R&D•R&D contracts with:

–Norwegian Research Council (NFR)–Norwegian Industrial and Regional Development Fund (SND)–European Union (EU): OnToKnowledge project (Semantic Web),

AmbieSense, AcKnowNet, VISION, misc. INTERREG projects

CognIT today

Some customers• Norsk Hydro (N)• Statoil (N)• Fortum Services (SF)• Ericsson Radar AS (N)• Scandpower PTI AS (N)• Kværner (N)• Norske Skog (N)• OM Technology AS (N)• WEPEX (USA)• TECOMAC AG (D)

– BMW (D)– DATEV (D)

• Aerospatiale (F)• Swiss Life AG (CH)

• Halden municipality (N) • DISTUM (S)• Aker Maritime (N)• MARINTEK (N)

– Brunvoll Shipping (N)• MaxiMedia GmbH (D)• BeeInformed (NL)

– SURF-diensten (NL)• AIdministrator (NL) • Communicate (N)

– Norwegian Hospitals (N)• IFE (N)• NorCom GmbH (D)• Orkla Foods/Stabburet (N)

Some partnersResellers, facilitators and R&D partners

• Oracle Norway (N)• PriceWaterhouseCoopers (N)• TietoEnator (N / S)• ECsoft (N)• PA Consulting (N)• Software Innovation (N)• ErgoGroup Ephorma (N)• Easy Access (N)• Maritime Logistics (N)• InCapta (N)• 1To1 Scandinavia (N)• Empir (S)• BeeInformed (NL)• MaxiMedia GmbH (D)• NorCom GmbH (D)• AIdministrator (NL)

• British Telecom (UK)• Swiss Life (CH)• Siemens AG (A)• Lonely Planet (D)• Yellow Map (D)• CIS Galicia (E)• Robert Gordon University (UK)• Univerisität Karlsruhe (D)• Vrije Univ. Amsterdam (NL)• DFKI Kaiserslautern (D)• Oslo University (N)• NTNU (N)• BI (N)• SIU Narvik (N)• HiØ (N)• Ostfold Research Foundation (N)

•Company info•CORPORUM™ technology•CORPORUM™ products•CognIT R&D

CognIT a.s

CORPORUMTM technology

• context based search, analysis and classification of information and the essence of a text

• handles large unstructured document and text archives

• uses intelligent agent technology

CORPORUM™ Functionality

• Concept extraction (“words” & generated concepts)

• Finds relations between such concepts• Generate Ontologies (semi-) automatically• Generate Semantic representations of

documents• Generate PartOfDocument annotations

(XML/RDF)

CORPORUM™ Functionality• User Specific Interest Models for

Document Retrieval (Augmenting “traditional” search scenarios)

• Summarising Document (evt, according to Interest Models )

• Visualisation of Semantic representationsand Knowledge Clusters

• Hook up visualisations and document bases

CORPORUM™ and Ontologies

• Mìmìr (CORPORUM-OntoBuild) as core for the Semantic Web

– learning of initial ontologies -> OntoEdit» propose networked structure

– refining ontologies -> add concepts» add concepts to existing onto’s

– refining ontologies -> cross taxonomic relations» add relations “across” boundaries

– instantiation of ontologies -> add facts» find instantiations, annotate with

“OnToKnowledge!”

INTRO

TECHNOLOGY

TOOLS

APPLICATIONS

OntoExtractbackground

knowledge

Domain Knowledgedomain knowledge

Corporum-OntoExtract• Clear architecture

(well-defined API, COM based C/S architecture)

• Export function for CCA(Central Concept Area)

• Text fragment annotations (semantic annotation)

• Information Retrieval Applications

(based on Mìmìr technology)

• OTK specific:– CCA viewer (with

Aidministrator)– Export of RDF metadata– Semantic annotation

according to ontologies

Ontology classClass refinements

Class instantiations

noise...

INTRO

TECHNOLOGY

TOOLS

APPLICATIONS

Cross-taxonomicrelations

Some examples generated byCORPORUM-OntoExtract-v0.1

Amsterdam History

Early settlement and growthAlthough modern historians do not exclude the possibility that during the Roman period some form of settlement existed at the mouth of the Amstel River, evidence of such has never been found. So far as is known, Amsterdam originated as a small fishing village in the 13th century AD. To protect themselves from floods, the early inhabitants had to build dikes on both sides of the river, and about 1270 they built a dam between these dikes.

Even then, merchant ships from Amsterdam sailed as far as the Baltic Sea and laid the foundation of the future trade centre, acting as a link between northern countries and Flanders (roughly modern Belgium). The city was under the jurisdiction of the counts of Holland, one of whom, Count Floris V, granted the homines manentes apud Amestelledamme ("people living near the Amsteldam") a toll privilege in 1275. In this document the name Amsterdam is mentioned for the first time, though a full charter was not granted until 1306. The city rapidly extended its business, and in 1489, as a sign of gratitude for the support given by the city to the Burgundian-Austrian monarchs, Emperor Maximilian I allowed Amsterdam to adorn its armorial bearings with the imperial crown. By then Holland's greatest commercial town and port, as well as the granary of the northern Netherlands, Amsterdam had become a centre of wealth and influence in Europe.

In the 16th century there was religious and political resistance in the Netherlands against Spanish oppression. Amsterdam hesitated to accept the leadership of William I the Silent, prince of Orange, but in 1578 there was a bloodless revolution. The magistrates, together with the majority of Roman Catholic priests, were deported, the religious communities were secularized, and the Roman Catholic Church underwent reform.

Amsterdam was still a small town with no more than about 30,000 inhabitants, but things changed quickly, especially when, in 1585, Antwerp (in modern Belgium) was recaptured by Spanish troops, and the Scheldt (Schelde) River was closed. Antwerp's fall led to a wholesale influx of mainly Protestant refugees into the towns of the northern Netherlands, principal among them Amsterdam. Their arrival enriched the city's intellectual, cultural, and commercial life. Banking and shipbuilding especially flourished. Much of the trade formerly concentrated in Antwerp then moved to Amsterdam, and with the Flemish merchantmen soon came hundreds of Jews expelled from Portugal, followed by their coreligionists from the area of modern Germany and eastern Europe. The city soon became a trading metropolis, whose population more than trebled between 1565 and 1618; merchant ships from Amsterdam not only sailed to the Baltic and the Mediterranean but also plied the long sea route to the East Indies and established colonies in South America and southern Africa.

At this time, the still outwardly medieval town developed into a big city, and in 1612 the City Council decided upon a new extension--the Three Canals Plan. Furthermore, the city needed a new and stately town hall, and the architect Jacob van Campen was commissioned to build one in the Dam square in the shadow of the New Church. In 1632 the Athenaeum Illustre(which became the University of Amsterdam in the 19th century) was erected. When, in 1648, the Treaty of Münster ended the Eighty Years' War (1568-1648) with Spain, Amsterdam was the financial, trading, and cultural centre of the world, lending money to foreign kings and emperors and thus exerting political influence internationally.

Conflict between the City Council and other political forces in the Dutch Republic was inevitable because the country was effectively no longer ruled by the States General in The Hague but by a small elite of burgomasters and merchants in Amsterdam. This situation led to political difficulties with William II, prince of Orange, who in 1650 planned to besiege the city. Amsterdam, nevertheless, maintained its dominant position for many years. Decline gradually came in the 18th century; London and Hamburg surpassed Amsterdam as trade centres, but the city remained the financial heart of Europe. Amsterdam was occupied in 1787 by the Prussians who backed the policy of William V, prince of Orange. The French, welcomed as liberators in 1795, brought freedom, but within a few years trade and shipping nearly stopped because of Napoleon's embargo on trade with Britain. In 1806 Napoleon proclaimed the Netherlands a kingdom, with Amsterdam as its capital, but by 1810 the country was incorporated into the French Empire. Russian Cossacks entered the town in 1813, and, on March 30, 1814, William VI, prince of Orange, was inaugurated as William I, king of The Netherlands, in Amsterdam's New Church.

<RELATION TYPE="SUBCLASS-OF"><CONCEPT>merchant ship</CONCEPT><STRENGTH>1.000</STRENGTH><CONCEPT>ship</CONCEPT>

</RELATION><RELATION TYPE="SUBCLASS-OF">

<CONCEPT>northern netherlands</CONCEPT><STRENGTH>1.000</STRENGTH><CONCEPT>netherlands</CONCEPT>

</RELATION>………………………..

Output of CORPORUM-OntoExtract v0.1

<?xml version="1.0"?><!DOCTYPE CONCEPTGRAPH []><CONCEPTGRAPH>

<CONCEPTLIST><CONCEPT>

<NAME>settlement</NAME></CONCEPT><CONCEPT>

<NAME>mouth</NAME></CONCEPT><CONCEPT>

<NAME>river</NAME></CONCEPT>

…………...</CONCEPTLIST>

<INSTANCELIST><INSTANCE>

<NAME>Amstel</NAME></INSTANCE><INSTANCE>

<NAME>Floris</NAME></INSTANCE><INSTANCE>

<NAME>Amestelledamme</NAME></INSTANCE><INSTANCE>

<NAME>Amsteldam</NAME></INSTANCE>

…………………..</isntancelist>

CLASSES

INSTANCES

RELATIONS

-subclassOf

-instanceOf

-univ-type

<RELATION TYPE="INSTANCE-OF"><INSTANCE>William</INSTANCE><STRENGTH>0.0263</STRENGTH><CONCEPT>political difficulty</CONCEPT>

</RELATION>

BUT: not yet perfect(or maybe CORPORUM knows more than we do?)

<RELATION TYPE=”UNIV"><INSTANCE>Amstel</INSTANCE><STRENGTH>0.0263</STRENGTH><CONCEPT>settlement</CONCEPT>

</RELATION>

OntoExtract v0.1 Beta

functionality CORPORUM (OntoExtract)• concept extraction • relations extraction • semantic discourse representation• <PartOfDocument> annotations• document retrieval• document summarising• knowledge clusters• navigation and browsing• ontology generation

Advantages context based search

• find relevant documents only

• find those parts most relevant

• find the essence of a text

• be able to classify documents

• be able to make summaries of documents

Applied to Intranet / Internet search

• drastic improvement of traditional search engines (from 35 to 80% relevancy)

• new generation search engines decrease search time, but do not increase relevancy - still too many hits

• active information service as an alternative to ”search here and now”

•Company info•CORPORUM™ technology•CORPORUM™ products•CognIT R&D

CognIT a.s

• CORPORUMTM Business Intelligence Portal

• CORPORUMTM Knowledge Server

• CORPORUM™ Summarizer

• CORPORUMTM Knowledge Factory

CORPORUM™ products

CORPORUMTM Business Intelligence Portal

• Agents are defined based on natural language description of interest model

• Agent targets are defined by specified URLs or by using traditional search engines as front ends

• Intelligent agents monitor their own interest model

• Information is filtered and ranked according to relevancy

• Agents inform about the most relevant hits

Treffet vises med karakteristiske nøkkelbregreper og det mest relevante tekstutdraget

Agenten katalogiserer selv og bygger en innholdsfortegnelse med enkel treffstatistikk per tema

• CORPORUMTM Business Intelligence Portal

• CORPORUMTM Knowledge Server

• CORPORUM™ Summarizer

• CORPORUMTM Knowledge Factory

CORPORUM™ products

CORPORUMTM Knowledge Server

• Agent server similar to CORPORUM™ Business Intelligence Portal

• Indexes and categorizes internal documents and information stored in document archives, on fileservers, intranet or extranet

• Automatic news feed

• Automatic hyperlinks to information sources relevant for agents interest model

• Automatic generation of content meta data

• Handles most file formats (Word, Lotus, PDF, Excel,…)

Agents on special assignments on the Web or Internet

Search

Creation and control of agents

Portal

Updates

Agents focused on free text content of document bases

Categorisedhits archive

• CORPORUMTM Business Intelligence Portal

• CORPORUMTM Knowledge Server

• CORPORUM™ Summarizer

• CORPORUMTM Knowledge Factory

CORPORUM™ products

CORPORUMTM Summarizer

• Analyses any unstructured text

• Builds semantic models of the text (concepts and relations)

• Extracts most relevant parts of the text

• Automatically provides the most relevant concepts

• Interest driven summaries based on user profile

• Component based tool with adaptable user interfaces (C/S or web based)

• Easily integrated into any business application, intranet application or web portal on the Internet

CorporumCorporumSummarizerSummarizerCognIT a.sCognIT a.s

Corporum Summarizer

Summarizer - Concept Extraction

Knowledge Representation

Underlying Underlying CorporumCorporum

TechnologyTechnology

Core Technology: Linguistic Analysis

• Extraction Technology based on

Mìmìr engine :– tokeniser– morphologic analysis– lexical analysis– syntactic/semantic

analysis– concept generation– relationships

• Corporum Suit:– applications with Mìmìr

core

Pointer from interest model

to part of document

Text expressing

user interest

Text expressing

user interest Interest

model

INTRO

TECHNOLOGY

TOOLS

APPLICATIONS

Summarizer - outlook

• Short term:– Handling of additional languages– Handling of norwegian variants

• Long term:– Abstraction instead of extraction

•Company info•CORPORUM™ technology•CORPORUM™ products•CognIT R&D

CognIT a.s

EUROPEAN PROJECTINVOLVEMENT

Information Society Technologies (IST)

Fifth framework - calls 4, 5 and 6

CognIT a.s involvement

• OntoKnowledge (OTK)• AcKnowNet• AmbieSense• VISION

OntoWeb - ESPRIT • Ontology-based information

exchange for knowledge management and electronic commerce

• funding for travelling, meetings,

• network of partners from all over Europe

• exposure through common marketing on conferences, web, articles.

• Effort: low, gains: high• Duration: 2001-2003

OntoKnowledge IST-1999-10132

• On-To-Knowledge: Content-driven Knowledge-Management through Evolving Ontologies

• The On-To-Knowledge project applies ontologies to electronically available information to improve the quality of knowledge management in large and distributed organisations.

• Impact: very high

• Partners: BT, SL, UvA, Uka, EnerSearch, CognIT

• Funding: 220 Keuro

• Duration: 1999 - 2002

AcKnowNet IST-2001-32533

• Active Knowledge Manager Using Dynamic Self-Modifying Knowledge Models

• Active knowledge networks: Active, Self-modifying, Extensible, Internally consistent, Diverse, Open and transparent, mobile

• Partners: DFKI, Tupai, CognIT• Form: Feasibility Study• Funding: 48 KEuro• Duration: 6 months

AmbieSense IST-2001-34244

• Ambient and Context-sensitive Information Systems for Mobile Users

• new bridges between citizens, information providers and technology businesses

• travellers and tourists• Partners: SINTEF, Reuters, LonelyPlanet, Siemens AG,

NTNU, Robert Gordon University, CognIT, YellowMap, OSL• Funding: 250K Euro/30mm• Duration: 30 months

LEOWEB IST-2001-34038

• FOLLOW-UP for OTK• GOAL: to tailor an open-source framework of NLE

components (implementing IE, lexical semantics, and NLG methods) to make them suitable for use in SW applications.

• To marry this framework with the last SW-motivated achievements of the knowledge management community: representation languages, ontology management and reasoning services, tools for ontology generation, mapping, evolving and populating.

• To apply the fruits of this union to three example SW applications:

– Knowledge management for corporate data.– B2B product catalogue classification and mapping.– Multilingual documentation of medical ontologies.

VISION IST-2002-2.1.2

• Road-map project, providing ground for future RTD-activities within organisational knowledge management.

• Integrating Ontologies and Semantic Web Technologies with Knowledge Discovery in KM

• Mobility and Knowledge Management

• Integrating Processes and Groupware in KM

• Partners: FZI(D), BT(UK), SIRMA(BG), CAS Software AG(D), NTUA(G), IDP(I)

• Duration: 12 months