1
1
Bettina Berendt
Humboldt-Universität zu Berlin – www.berendt.de
* mit vielen Ko-AutorInnen
** mit Roberto Navigli, Università “La Sapienza”, Roma, Italy
Semantic Web Mining*
Heute:Semantik für und aus Blogs**
2
2
Agenda
1. Motivation und Überblick
Warum Web? Warum Blogs?
Semantic Web Mining
2. Finding your way through blogspace:
Using semantics for cross-domain blog analysis
3
3
Agenda
1. Motivation und Überblick
Warum Web? Warum Blogs?
Semantic Web Mining
2. Finding your way through blogspace:
Using semantics for cross-domain blog analysis
4
4
Das Ziel
5
5
Das Wissen der Menschheit möglichst vielen Menschen effektiv zugänglich machen.
6
6“Makrokosmos World Wide Web”
7
7
“Mikrokosmos Blogosphere”
8
8
Konkrete Ziele(Bsp. für Teil 2 dieses Vortrags)
Klassifikation:„Dieser Blog behandeltInhalte aus Ernährungund Gastronomie.“ Vorschläge von Meta-Tags für den Blog Unterstützung vonBlog-Suchmaschinen
Klassifikation:„Dieser Blog behandeltInhalte aus Ernährungund Gastronomie.“ Vorschläge von Meta-Tags für den Blog Unterstützung vonBlog-Suchmaschinen
Empfehlungenmit Erklärung:„Wenn Sie diesen Bloginteressant fanden,dann wird Sie vielleichtauch Blog ... interessieren,und zwar weil ...“
Empfehlungenmit Erklärung:„Wenn Sie diesen Bloginteressant fanden,dann wird Sie vielleichtauch Blog ... interessieren,und zwar weil ...“
9
9
Das Potenzial
10
10
Sehr viel Wissen, für Menschen zugänglich.
11
11
Die Probleme
12
12
Sehr viel Wissen, für Menschen zugänglich.
13
13
Web Mining
14
14
Formen
Knowledge discovery (aka Data mining):
“the non-trivial process of identifying valid, novel, potentially useful, and ultimately understandable patterns in data.” 1
Web Mining: die Anwendung von Data-Mining-Techniken auf Inhalt, (Hyperlink-) Struktur und Nutzung von Webressourcen. Webmining-Gebiete:
Web content mining
Web structure mining
Web usage mining
1 Fayyad, U.M., Piatetsky-Shapiro, G., Smyth, P., & Uthurusamy, R. (Eds.) (1996). Advances in Knowledge Discovery and Data Mining. Boston, MA: AAAI/MIT Press
15
15
Webmining-Gebiete:
Web content mining
Web structure mining
Web usage mining
Web Mining:Beispiele
16
16
Das Hauptproblem des Web Mining
17
17
Syntax in, Syntax out.
18
18
19
19
Semi-automatisches Tagging: Tag-Empfehlung auf Basis von Syntax + existierenden Labels
20
20
Tagyu funktioniert auch (mit Einschränkungen) für Ressourcen in anderen Sprachen
21
21
Funktioniert das wirklich? (1)
22
22
Funktioniert das wirklich? (2)
23
23Das Wikipedia 300 Component Model, generiert mit diskreter PCA cosco.hiit.fi/search/H300.html/topic_list - common phrases of selected components
1. process; water; air; pressure; gas; body of water; natural gas; high pressure; hot water; fresh water;
2. Mark; Gospel; Matthew; Luke; Rose; Virgin; Virgin Mary; Gospel of John; Gospel of Mark; Gospel of Luke;
3. part; text; Britannica; entry; Encyclopedia Britannica; Encyclop~¦dia Britannica; Encyclopaedia Britannica; domain Encyclop~¦dia Britannica; public domain Encyclop~¦dia Britannica; public domain text;
4. property; theorem; elements; proof; subset; axioms; proposition; natural numbers; fundamental theorem; mathematical logic;
5. Dove; AMD; Dove Streptopelia; imperial crown; Imperial army; imperial court; imperial family; Collared Dove Streptopelia; Imperial Russia;
6. side; feet; long time; long period; right side; left side; long distances; different types; short distance; opposite side;
7. David; bill; Bob; Jim; Allen; Dave; Current stars; former members; Bill Clinton; former President;
8. magazine; newspaper; political parties; public domain text; public opinion; political career; public schools; own right; political life; public service;
9. way; things; boy; cat; long time; same way; same thing; only way; different ways; good thing;
10. problems; zero; sum; digits; ~~; natural numbers; positive integer; mathematical analysis; decimal digits; natural logarithm;
11. population density; couples; races; total area; makeup; Demographics; median age; income; density; housing units;
175. Torres; Iraqi KASUMI KHAZAD Khufu; Granada; Spa; Fra; General information; General Public License; General Bernardo; New Granada; Torres Strait;
176. love; Me; Rolling Stones; love songs; Rolling Stone magazine; Love Me; Fall in Love; Meet Me; love story; professional wrestler;
Zusammenfassend – Schwächen rein statistischer Ansätze:
Interpretation der Resultate?
Existenz von Resultaten?
Korrektheit?
Inferenzen?
Zusammenfassend – Schwächen rein statistischer Ansätze:
Interpretation der Resultate?
Existenz von Resultaten?
Korrektheit?
Inferenzen?
24
24
Semantic Web
25
25
Das Semantic Web
“The Semantic Web is an extension of the current web in which information is given well-defined meaning, better enabling computers and people to work in co-operation.” 1
“The Semantic Web provides a common framework that allows data to be shared and reused across application, enterprise, and community boundaries. It is a collaborative effort led by W3C with participation from a large number of researchers and industrial partners. It is based on the Resource Description Framework (RDF), which integrates a variety of applications using XML for syntax and URIs for naming.” 2
1 Berners-Lee, T., Hendler, J., & Lassila, O. (2001). The Semantic Web. Sci. American, May.
2 http://www.w3.org/2001/sw/3 Berners-Lee, T. (2000). Semantic Web XML2000.
www.w3.org/2000/Talks/1206-xml2k-tbl/
26
26Category structure:<RDF xmlns:r="http://www.w3.org/TR/RDF/" xmlns:d="http://purl.org/dc/elements/1.0/" xmlns="http://directory.mozilla.org/rdf"><Topic r:id="Top"> <tag catid="1"/> <d:Title>Top</d:Title> <narrow r:resource="Top/Arts"/> ....</Topic><Topic r:id="Top/Arts"> <tag catid="2"/> <d:Title>Arts</d:Title> <narrow r:resource="Top/Arts/Books"/> ... <narrow r:resource="Top/Arts/Artists"/> <symbolic r:resource="Typography:Top/Computers/Fonts"/></Topic>....</RDF>
Category structure:<RDF xmlns:r="http://www.w3.org/TR/RDF/" xmlns:d="http://purl.org/dc/elements/1.0/" xmlns="http://directory.mozilla.org/rdf"><Topic r:id="Top"> <tag catid="1"/> <d:Title>Top</d:Title> <narrow r:resource="Top/Arts"/> ....</Topic><Topic r:id="Top/Arts"> <tag catid="2"/> <d:Title>Arts</d:Title> <narrow r:resource="Top/Arts/Books"/> ... <narrow r:resource="Top/Arts/Artists"/> <symbolic r:resource="Typography:Top/Computers/Fonts"/></Topic>....</RDF>
Resources:<RDF xmlns:r="http://www.w3.org/TR/RDF/" xmlns:d="http://purl.org/dc/elements/1.0/" xmlns="http://directory.mozilla.org/rdf"> ...<Topic r:id="Top/Arts"> <tag catid="2"/> <d:Title>Arts</d:Title> <link r:resource="http://www3...ca/…./file.html"/></Topic><ExternalPage about="http://www…ca/file .html"> <d:Title>John phillips Blown glass</d:Title> <d:Description>A small display of glass by John Phillips</d:Description></ExternalPage><Topic r:id="Top/Computers"> <tag catid="4"/> <d:Title>Computers</d:Title> <link r:resource="http://www.cs.tcd.ie/FME/"/> <link r:resource=”http://foo.asdfsa….."/></Topic></RDF>
Resources:<RDF xmlns:r="http://www.w3.org/TR/RDF/" xmlns:d="http://purl.org/dc/elements/1.0/" xmlns="http://directory.mozilla.org/rdf"> ...<Topic r:id="Top/Arts"> <tag catid="2"/> <d:Title>Arts</d:Title> <link r:resource="http://www3...ca/…./file.html"/></Topic><ExternalPage about="http://www…ca/file .html"> <d:Title>John phillips Blown glass</d:Title> <d:Description>A small display of glass by John Phillips</d:Description></ExternalPage><Topic r:id="Top/Computers"> <tag catid="4"/> <d:Title>Computers</d:Title> <link r:resource="http://www.cs.tcd.ie/FME/"/> <link r:resource=”http://foo.asdfsa….."/></Topic></RDF>
Semantic Web:Beispiel
27
27
Warum Semantic Web?Bsp. strukturierte Suche
– Metadaten gemäß Dublin Core (DC)
28
28
Semantische Suche: Bsp. 2 – Metadaten
gemäß DC + Domänenontologie
29
29
Das Hauptproblem des Semantic Web
30
30
Wer soll das alles machen?
31
31
Der Ansatz
32
32
Web Mining: Maschinelles Lernen extrahiert aus Daten Wissen
Das Semantic Webmacht Wissen maschinen-verständlich
Semantic Web Mining• nutze Semantik zur Verbesserung v. Mining • nutze Mining zur Generierung v. Semantik
Semantic Web Mining• nutze Semantik zur Verbesserung v. Mining • nutze Mining zur Generierung v. Semantik
33
33
34
34
Web Mining
Semantic Web
Web Mining
Semantic Web
...p3ee24304.dip.t-dialin.net - - [19/Mar/2002:12:03:51 +0100]"GET /search.html?t=jane%20austen&SID=023785&ord=asc HTTP/1.0" 200 1759 p3ee24304.dip.t-dialin.net - - [19/Mar/2002:12:05:06 +0100] "GET /search.html?t=jane%20austen&m=video&SID=023785&ord=desc HTTP/1.0" 200 8450p3ee24304.dip.t-dialin.net - - [19/Mar/2002:12:06:41 +0100] "GET /view.asp?id=3456&SID=023785 HTTP/1.0" 200 3478...
Ver-stehen
35
35
Web Mining
Semantic Web
...<BIBLIOGRAPHY><FLOAT><PAGENUMBER>136</PAGENUMBER></FLOAT><HEAD>Literaturverzeichnis</HEAD>
<CITATION WORKTYPE="journal" PUBLISHED="PUBLISHED"><CUT ID="bib-15-">[1] </CUT><WORKAUTHOR>Agarwal, R.; Krueger, B. P.; Scholes, G. D.; Yang, M.; Yom, J.; Mets, L.; Fleming, G. R.</WORKAUTHOR>U<ARTICLETITLE>ltrafast energy transfer in LHC-II revealed by three-pulse photon echo peak shift measurements</ARTICLETITLE>, <WORKTITLE>J. Phys. Chem. B</WORKTITLE>, <PUBDATE>2000</PUBDATE>, <NUMBER>104</NUMBER>, <PAGES>2908</PAGES>, </CITATION>
...
beitragen
36
36
Web Mining
Semantic Web
ordnen und
erklären
beitragen
37
37
Agenda
1. Motivation und Überblick
Warum Web? Warum Blogs?
Semantic Web Mining
2. Finding your way through blogspace:
Using semantics for cross-domain blog analysis
38
38
Context
Semi-automatic tagging
Blog recommendation
Semantics-enhanced text mining, word sense disambiguation
Exploratory analyses of blog contents
Computational Approaches to Analyzing Weblogs AAAI 2006 Spring Symposium
Read more in the paper:
http://www2.wiwi.hu-berlin.de/~berendt/Papers/SS0603BerendtB.pdf
39
39
Blog recommendation: collaborative + content-based filtering (www.iro.umontreal.ca/~aimeur/publications/Workshop20.pdf)
40
40
An example of exploratory blogs analysis (in which a syntax-based approach is sufficient): the run-up to the 2004 US presidential election (Adamic & Glance, 2005)
41
41
Our procedure
1. Take a set of blog corpora (= collection of blogs manually labelled as belonging to one topic)
2. In all of the following analyses:
what is blog corpus about?
to which other blog corpora is it related, and why?
3. syntactic analysis: keyphrases
4. semantic analysis I: domain labels
5. semantic analysis II: structural semantic interconnections
42
42
Data
43
43
Sample data: 4 blog corpora
Food and drink
Health and medicine
Law
Weblogs about blogging
Randomly sampled from the Yahoo! blog directory, 140-330 K words each
Available at
http://www.wiwi.hu-berlin.de/˜berendt/Blogs/Sample20050917/
44
44
Syntactic analysis
45
45
What is a blog about? Term Extraction
Domain relevance and domain consensus:
Keyphrases: DR ≥ 0.35, DC ≥ 0.23 (values from previous experiments)
t = term, = corpus (here: blog corpus), b = a blog (here: as an element of a corpus k)
46
46
What is shared by two blogs? Syntactic similarity: Jaccard coefficient
T(C) = keyphrases / “terminology“of corpus C
47
47
Semantic analysis I:WordNet and WordNet domains
48
48
WordNet
49
49
Hierarchical knowledge: Domain labels
50
50
Domain label statistics show that the blog corpora have clear thematic foci
frequency of domain D in corpus C = no. of keyphrases in C with a sense that maps to D
51
51
Blog foci: Top 5 Domains
Food Health Law Meta-blogs
1 Gastronomy Medicine Law Telecommunications
2 Alimentation Time period Quality Time period
3 Quality Quality Politics Person
4 Botany Biology Administration Publishing
5 Person Physics Economy Economy
52
52
Top-10 intersections
Law – meta-blogs
Law, politics, economy (+ 3 factotum)
Law – health
Law, psychology (+ 2 factotum)
Health – meta-blogs
Law (+ 2 factotum)
Food – law
Sociology (+ 2 factotum)
No overlap food – health, health – law
53
53
Semantic analysis II:Hierarchical and non-hierarchical knowledge: WordNet and SSI (Structural semantic interconnections)
54
54
The need for word sense disambiguation
“She sat by the bank and looked sentimentally at the last fish.“
„She sat by the bank and looked sentimentally at the last coins.““She sat by the bank and looked sentimentally at the last coins.“
55
55
WordNet semantic relations
56
56
Structural semantic interconnections: bank – fish
Details of SSI‘s enhanced lexcial database(extending WordNet) and of SSI‘s word sense disambiguation are described in
R. Navigli & P. Velardi. Structural Semantic Interconnections: a knowledge-based approach to word sense disambiguation. IEEE Transactions on Pattern Analysis and Machine Intelligence (27-7), July, 2005.
57
57
Structural semantic interconnections: bank – coin
58
58
Knowledge-based similarity between blogs
Example:
connection between two terms from the domain computer science
path weights: 0.33; 0.25; 0.25 = 1 / path length in no. of edges)
Procedure: For each blog pair
1. find all SSI paths between all pairs of a term (keyphrase) from blog 1 and a term from blog 2
(in all conditions but the baseline: choose only terms that map to senses in the top domain(s), and choose only those senses)
2. Measure of blog pair similarity = sum over the weights of all these paths
59
59
Experi-mental settings
60
60
Results (Quantitative view)
61
61
Results: Qualitative view
Baseline: Spurious connections between law – metablogs: via computer science terms filtered out in domain-label conditions
Correct connections throughout: Food – health: greasy food (cream cheese, chocolate sauce, ...) – other fats, or health food
1/3-relatedness reveals important connections: Expected: law – metablogs: enterprise (related to law) – computer science
(related to telecommunications), publishing, politics: law firms, news organizations, news story, political party
Unexpected: law – food: local government – town planning (including parking lots, the main drag)
Single-term expressions particularly visible in food – health (eggs, onions, ... – health food; disease – beef) lexicalization effect, depends on domains (also related domains in law – metablogs)
3-relatedness: topic drift, many highly generic single-word terms (activity, life, computer, area, food) establish many generic paths to a 2nd corpus (these terms are „related to“ nearly everything else) topic drift
62
62
Restricting path grammar to find valid interconnections
Starting from 3-relatedness
≤ 1 related-to link filters out 88.8% of the paths
≤ 2 types of links filters out 53.4% of the path
Results:
Mostly, “meaningful“ paths were retained.
But further research is needed.
63
63
Questions / future work
Evaluation Standard datasets („senseval for blogs“): try the following ?!
– http://www.blogpulse.com/www2006-workshop/
– 10 M posts from 1 M weblogs from three weeks in July 2005.
– This data set has been selected as it spans a period of time during which an event of global significance occurred, namely the London bombings.
Compare syntax- and semantics-based approaches
– Assuming that the semi-automatic approaches of Semantic Web Mining give qualitatively better results:
How can the quality gains be weigthed against the additional costs of manual post-processing?
Improve path grammars
Ontology learning
64
64
… für Ihre Aufmerksamkeit!
Danke …