solbrille : bringing back the time
DESCRIPTION
Solbrille : Bringing Back the Time. Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig TDT4215 “Web-Intelligence”, Spring 2009. Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig. System Architecture. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/1.jpg)
1
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
Solbrille : Bringing Back the Time
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
TDT4215 “Web-Intelligence”, Spring 2009
![Page 2: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/2.jpg)
2
System Architecture
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 3: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/3.jpg)
3
Components
• Preprocessing– Stemming, tokenizing, html and punctuation remover
• Index structures: Occurrence (Inverted), Statistics, Content • Modular query pipeline
– Matcher: produces documents which matches query
– Scoring: Ranks documents, Cosine and OkapiBM25 implemented
– Filtering: Phrase search filter implemented
– Snippets
– Clustering
• Console application and web front-end
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 4: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/4.jpg)
4
Inverted File
• It’s in binary.
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 5: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/5.jpg)
5
Inverted file - syntax
![Page 6: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/6.jpg)
6
Query Language
• AND/OR/NAND single terms– ’kari bremnes’, ’+kari +bremnes’, ’+bremnes –kari’, etc
• AND/NAND Phrases– ’”kari bremnes”’, ’bremnes -”kari bremnes”’, ’kari +”kari bremnes”’
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 7: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/7.jpg)
7
Proximity
• No direct implementation, but can be implemented by a scorer.
• Indirect implementation: sniplets are based on max occurrence windows (proximity), clusters in the extended system are generated based on supplied sniplets.
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 8: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/8.jpg)
8
Ranking Algorithms• System has result ranking implemented as a
pluggable module• It is possible to write custom scorers (Cosine, Okapi,
PageRank*, ProximityScorer*, etc) and combine score values from these
• Current System implementation uses Cosine and Okapi scorers.
• Top endpage# results are kept in a queue, endpage#-startpage# of which are returned to a user
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 9: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/9.jpg)
9
Clustering
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 10: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/10.jpg)
10
Demonstrations
• <Ola says something funny>
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 11: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/11.jpg)
11
Evaluation of Basic System
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
![Page 12: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/12.jpg)
12
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
Cosine
![Page 13: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/13.jpg)
13
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig
Okapi BM-25
![Page 14: Solbrille : Bringing Back the Time](https://reader031.vdocuments.mx/reader031/viewer/2022032804/56812a80550346895d8e0f6a/html5/thumbnails/14.jpg)
14
Evaluation of Extended System
Arne Bergene Fossaa, Simon Jonassen, Jan Maximilian W. Kristiansen, Ola Natvig