p2p web search: make it light, make it fly · 2011-09-16 · matthias bender p2p web search: make...
TRANSCRIPT
![Page 1: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/1.jpg)
Motivation MINERVA System Model Demo
P2P Web Search: Make It Light, Make It Fly
Matthias Bender, Tom Crecelius,Sebastian Michel, Josiane Xavier Parreira
Max-Planck-Institut fur InformatikSaarbrucken, Germany
Jan 8, 2007
Matthias Bender P2P Web Search: Make It Light, Make It Fly 1 / 16
![Page 2: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/2.jpg)
Motivation MINERVA System Model Demo
Outline
1 Motivation
2 MINERVA System Model
3 Demo
Matthias Bender P2P Web Search: Make It Light, Make It Fly 2 / 16
![Page 3: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/3.jpg)
Motivation MINERVA System Model Demo
Motivation
Potential of peer-to-peer (P2P) systems
scalable
efficient
resilient to failures and dynamics
P2P Web Search
benefit from intellectual input of user community
prevent information-resource monopolies
Key Challenge: Make it usable
Bingo! (Focused Web crawler), MINERVA (P2P Web Search),Cloudscape (Database Backend)⇒ Easy user deployment, common GUI
Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16
![Page 4: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/4.jpg)
Motivation MINERVA System Model Demo
Architectural Model
Peers autonomously and independently crawl the webbuild local indexescan execute queries on local indexes
Matthias Bender P2P Web Search: Make It Light, Make It Fly 4 / 16
![Page 5: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/5.jpg)
Motivation MINERVA System Model Demo
Architectural Model
share per-key statistics about local indexesform conceptually global directoryEach directory peer responsible for randomized subset of keys
Matthias Bender P2P Web Search: Make It Light, Make It Fly 5 / 16
![Page 6: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/6.jpg)
Motivation MINERVA System Model Demo
Architectural Model
use directory to identify promising peers (Query Routing)send query to selected peersmerge results appropriately
Matthias Bender P2P Web Search: Make It Light, Make It Fly 6 / 16
![Page 7: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/7.jpg)
Motivation MINERVA System Model Demo
1. Step: Import Bookmark File
Click Startbutton toimportbookmark file
Matthias Bender P2P Web Search: Make It Light, Make It Fly 7 / 16
![Page 8: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/8.jpg)
Motivation MINERVA System Model Demo
2. Step: Crawl the Web
BINGO! fetchesbookmarkdocuments,builds classifier
Web crawlstartsautomatically,can be stoppedanytime
Start Minerva
Matthias Bender P2P Web Search: Make It Light, Make It Fly 8 / 16
![Page 9: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/9.jpg)
Motivation MINERVA System Model Demo
3. Step: Instantiate Minerva
Enter nickname,network settings
Click CreateRing (or JoinRing, if exists)
Matthias Bender P2P Web Search: Make It Light, Make It Fly 9 / 16
![Page 10: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/10.jpg)
Motivation MINERVA System Model Demo
4. Step: Update Minerva Index
Update Indeximports currentdata fromBingo!,computesmetadata
Matthias Bender P2P Web Search: Make It Light, Make It Fly 10 / 16
![Page 11: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/11.jpg)
Motivation MINERVA System Model Demo
5. Step: Publish Metadata to directory
Use ShowWidgets menuto openReceived-Postspanel
Click Post Allbutton
Click Refreshbutton toinspectdirectory
Matthias Bender P2P Web Search: Make It Light, Make It Fly 11 / 16
![Page 12: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/12.jpg)
Motivation MINERVA System Model Demo
6. Step: Execute Query
Enter Query,click Executequery
Inspect Results
Matthias Bender P2P Web Search: Make It Light, Make It Fly 12 / 16
![Page 13: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/13.jpg)
Motivation MINERVA System Model Demo
7. Step: Tag Documents
Right-click ondocument, AddNew Tag forURL
Add desiredtag(s)
Matthias Bender P2P Web Search: Make It Light, Make It Fly 13 / 16
![Page 14: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/14.jpg)
Motivation MINERVA System Model Demo
8. Step: Retrieve Annotations for Document
Right-click ondocument,Retrieve allTags for URL
Inspectedsubmitted tags
Matthias Bender P2P Web Search: Make It Light, Make It Fly 14 / 16
![Page 15: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/15.jpg)
Motivation MINERVA System Model Demo
9. Step: Query for Annotated Documents
Enter query astag=value,possiblycombine withkeywords
Inspect results
Matthias Bender P2P Web Search: Make It Light, Make It Fly 15 / 16
![Page 16: P2P Web Search: Make It Light, Make It Fly · 2011-09-16 · Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16. Motivation MINERVA System Model Demo Architectural](https://reader033.vdocuments.mx/reader033/viewer/2022042406/5f20f55e1af47d5cda7d55fa/html5/thumbnails/16.jpg)
Motivation MINERVA System Model Demo
Thank you for your attention
Download and more details available at:
http://www.minerva-project.org
Matthias Bender P2P Web Search: Make It Light, Make It Fly 16 / 16