conceptnet: a wonderful semantic world by bijoy arif

ConceptNet: A Wonderful Semantic World

By Bijoy Arif

The Development of the Space-Time View of Quantum Electrodynamics

“We have a habit in writing articles published in scientific journals to make the work as finished as possible, to cover all the tracks, to not worry about the blind alleys or to describe how you had the wrong idea first, and so on. So there isn't any place to publish, ...”

Richard P. Feynman, Noble Lecture

Presentation Plan

Part 1

1. Introduction

2. Background Knowledge

3. ConceptNet and Its Counterparts

Part 2

4. Building of ConceptNet

5. Structure of ConceptNet

6. Applications of ConceptNet

7. Present ConceptNet

Presentation Plan (cont...)

Part 3

8. ConceptNet in Windows

9. ConceptNet Modules

10. Demo of ConceptNet

11. Quick Review

12. My View of ConceptNet

Part 1

Introduction: What is ConceptNet?

> ConceptNet is a semantic network to give common sense knowledge(concept) to machine.

> Simply means a tool so that computers can understand daily usage English.

Features

> Python based SQL toolkit

> Maintain Semantic Network

> Acquire data from Open Mind Common Sense Corpus

> Till now Open Source

Origin and Creators

> Originated in MIT Media Lab

> First Appeared as The ConceptNet Project v2.1

>Introduced by

Hugo Liu

Push Singh

Ian Eslick

Background Knowledge: What is Semantic Network?

> A network represents semantic relation between concepts.

> Semantics is the meaning of something focuses on relation between signifiers like words, phrases, signs or symbols.

> Here Concepts means some abstract objects.

> In Computer Science terminology, It is a directed or undirected graph consisting of vertices, which represent concepts, and edges.

What is Open Mind Common Sense Corpus?

> Open Mind Common Sense (OMCS) is an artificial intelligence project based at the Massachusetts Institute of Technology (MIT) Media Lab whose goal is to build and utilize a large commonsense knowledge base from the contributions of many thousands of people across the Web.

> Unlike common corpus like British National Corpus, International Corpus of English

Relation between OMCS and ConcepNet

> The project is brainchild of Marvin Minsky, Push Singh, Catherine Havasi and others. Eventually they contributed to ConceptNet

> ConceptNet is a semantic network based on the information in the OMCS database.

Simply saying, OMCS is the core of ConceptNet.

ConceptNet and Its counterparts

> Two other popular Natural Language Processing toolkit like ConceptNet are:

WordNet

Cyc

> ConceptNet project is inspired by these two projects.

WordNet and Cyc

> WordNet is large lexical database, initiated in Princeton University in mid 1980s by George A. Miller, to provide meaning and relation of English words.

> Cyc is started by Cycorp Company in 1984 to create common sense knowledge in a formalized logical framework.

Similarity and Difference

> ConceptNet is the combination of WordNet like structure and Cyc like relation.

> Extended WordNet's notion of node and repertoire in semantic network.

> WordNet and Cyc are handcrafted by knowledge engineers but ConceptNet is OMCS corpus based, not manually handcrafting commonsense knowledge.

Similarity and Difference (cont...)

> WordNet has a lexical emphasis and employs a formal taxonomic approach.

> Cyc represents commonsense in a formalized logical framework means it excels in careful deductive reasoning.

> ConceptNet represents contextual common sense reasoning over real world texts.

Part 2

Building of ConceptNet

ConceptNet's extraction rules from semi-structured OMCS:

> Extraction Phase

> Normalization Phase

> Relaxation Phase

Building of ConceptNet (cont...)

> approximately fifty extraction rules are used to map OMCS's English sentences into ConceptNet binary relation assertion.

> Extracted Nodes are also normalized.

> Relaxation means to smooth over semantic gaps and improve the connectivity of network.

Structure of ConceptNet

> K Lines (1.25 million assertions)

> Things (52,000 assertions)

> Agents (104,000 assertions)

> Events (38,000 assertions)

> Spatial (36,000 assertions)

> Causal (17,000 assertions)

> Functional (115,000 assertions)

> Affective (34,000 assertions)

Structure of ConceptNet (cont...)

Overall semantic network contains:

> 1.6 millions assertions

> over 300,000 nodes

Applications of ConceptNet

> Commonsense ARIA

> Goose

> MakeBelieve

> GloBuddy

> AAA- a profiling and recommendation system

and many more

Present ConceptNet

> Originally initiated as ConceptNet 2

> It is no longer maintained

> Then ConceptNet 3 was introduced

> Now ConceptNet 5 is available

> Developed by

Rob Speer

Catherine Havasi and

Many others

Part 3

ConceptNet in Windows

> Using ConceptNet in Linux or Mac is very easy

> But in Windows, need bag of tricks

> Need a way to use others SQL database in Python

ConceptNet in Windows (cont...)

Need to download

> Any Python Machine

> ConceptNet.tar.gz

> csc-util.tar.gz

> Django.tar.gz

> Simplenlp.tar.gz

ConceptNet Modules

Http://csc.media.mit.edu/docs/conceptnet/conceptnet4.html

ConceptNet Demo

>>> It is time to visit wonderful world

Quick Review

> Initiated as ConceptNet 2

> MIT Media Lab is Place of Birth

> Use OMCS Corpus to create, maintain and develop ConceptNet

> Maintain a large database brilliantly

> Combination of WordNet like structure and Cyc like relation

> Now ConceptNet 5 is available

My View of ConceptNet

> OMCS should be open source as well.

> Must have a way to interact with OMCS to change, develop, acquire data.

> ConceptNet have a way to update its database directly from interactive OMCS.

> Overall it is a nice world.

Thank You

References

[1] ConceptNet-a practical commonsense reasoning toolkit by H Liu and P Singh

[2]Http://csc.media.mit.edu/docs/conceptnet/conceptnet4.html

Questions????