conceptnet 5

1

ConceptNet 5Jason Gaines

2Overview

• What Is ConceptNet 5?• History• Structure• Demonstration• Questions• Further Information

3

What Is ConceptNet5

• Semantic Network (Common-Sense Knowledge)• Concepts and Relations• Weights and Sources

4History

• Started by Marvin Minsky, Push Singh, and Catherine Havasi

• Open Mind Common Sense (OMCS) - MIT Media Lab Artificial Intelligence Project (1999)

• Website launched in 2000• By 2002, 700,000 English sentences from 14,000

contributors• Reorganized in 2007 ConceptNet 3• Over 1,000,000 facts from 15,000 contributors• 2013 ConceptNet 4 Takes I.Q. test

5Structure

•Hypergraph•Nodes • Edges

6

Structure - Hypergraph

• Generalization of a graph where an edge can connect many nodes

7Structure - Nodes

•Words•Word Senses• Short Phrases

8Structure - Edges

• Node to Node relationship• Data sets provide the link

9

Structure – Edge Fields

• license• dataset• context• features• surfaceText

• id• uri• rel• start• end• weight• sources

10Structure - URI

• /[OBJECT TYPE]/[LANG]/[CONCEPT]• Object Types /a/, /c/, /d/, /e/, /l/, /r/, /s/ ,/and and /or:

/c/en/toast

11

Structure - Relations

• RelatedTo• IsA• PartOf• MemberOf• HasA• UsedFor• CapableOf• AtLocation• Causes• HasSubevent• HasFirstSubevent• HasLastSubevent

• HasPrerequisite• HasProperty• MotivatedByGoal• ObstructedBy• Desires• CreateBy• Synonym• Antonym• DerivedFrom• TranslationOf• DefinedAs

12Structure - Edge

{ "endLemmas": "toast", "context": "/ctx/all", "end": "/c/en/toast", "features": [ "/c/en/bread /r/RelatedTo -", "/c/en/bread - /c/en/toast", "- /r/RelatedTo /c/en/toast" ], "license": "/l/CC/By-SA", "start": "/c/en/bread", "startLemmas": "bread", "text": [ "toast", "bread" ], "uri": "/a/[/r/RelatedTo/,/c/en/bread/,/c/en/toast/]", "weight": 8.650268, "dataset": "/d/conceptnet/5/combined-sa", "sources": [ "/or/[/and/[/s/activity/omcs/Verbosity/,/s/contributor/omcs/verbosity/]/,/s/site/verbosity/]" ], "score": 46.555122, "rel": "/r/RelatedTo", "timestamp": "2013-09-12T16:51:30.594Z", "nodes": [ "/r/RelatedTo", "/c/en/toast", "/c/en/bread" ], "id": "/e/3da69c641f2e786bd5f07043c2ef51d9f146b431", "surfaceText": "[[bread]] is related to [[toast]]" }

13

Structure – Data Sources

• ConceptNet 4 (OMCS)• Wikipedia (English)• DBPedia• ReVerb

• Wiktionary (English)• WordNet• “Game With A Purpose”• Verbosity (GWAP)• Nadya.jp (Japanese)

14Using ConceptNet

•Website - Web API• ConceptNet Module - Python• Dataset• Flat JSON• Solr JSON• CSV

15Web API

• Representational State Transfer (REST) API

URL: http://conceptnet5.media.mit.eduRequest: “web” or “data/5.2”

Lookup: “lookup” with “limit”, “offset” and “filter”Search: “search” with edge fieldsAssociation: “assoc” with “limit” and “filter”

URI: “c/en/toast”

http://conceptnet5.media.mit.edu/data/5.2/assoc/c/en/cat?filter=/c/en/dog&limit=1

16Demonstration

http://conceptnet5.media.mit.edu/web/c/en/toasthttp://conceptnet5.media.mit.edu/data/5.2/assoc/c/en/cat?filter=/c/en/dog&limit=1http://conceptnet5.media.mit.edu/data/5.2/assoc/list/en/happy,sad@-1?limit=20http://conceptnet5.media.mit.edu/data/5.2/assoc/list/en/happy,sad@-1?limit=20&filter=/c/enhttp://conceptnet5.media.mit.edu/data/5.1/c/en/off_hook

17Summary

•What Is ConceptNet5?• History• Structure• Demonstration

18Questions

19Additional Info

• http://csc.media.mit.edu/conceptnet• http://csc.media.mit.edu/docs/conceptnet/• http://github.com/commonsense/conceptnet5/wiki• https://github.com/commonsense/conceptnet5/wiki/_

pages• http://en.wikipedia.org/wiki/Hypergraph