Stop Searching and Start FINDINStop Searching and Start FINDING: Strategies for Effective Web RG: Strategies for Effective Web R

esearchesearch

The Biggest MistakeThe Biggest Mistake

Typing search terms in the wrong boxTyping search terms in the wrong box

The Second Biggest MistakeThe Second Biggest Mistake

Using the wrong tool at the wrong timUsing the wrong tool at the wrong timee

How do search tools work?How do search tools work? Different search tools use different methods and criteria for Different search tools use different methods and criteria for

searchingsearching No one search tool can search the whole WebNo one search tool can search the whole Web Knowing the type and strengths of each tool is important for Knowing the type and strengths of each tool is important for

effective searchingeffective searching

How do How do Search Engines Search Engines work?work?

1.1. A spider (also called a "crawler" or a "bot") that A spider (also called a "crawler" or a "bot") that searches the Web to index in the search engine’s searches the Web to index in the search engine’s database of linksdatabase of links

2.2. A program that creates a huge index from the pages thA program that creates a huge index from the pages that have been read. at have been read.

3.3. A program that receives your search request, compareA program that receives your search request, compares it to the entries in the index, and returns results to yos it to the entries in the index, and returns results to you. u.

– So you are not actually searching the Web in real timeSo you are not actually searching the Web in real time

Directories v Search EnginesDirectories v Search Engines

Directories are human-compiled and hav are human-compiled and have a small number of pages in their databe a small number of pages in their databases (usually in the low millions)ases (usually in the low millions)

Directories v Search EnginesDirectories v Search Engines

Search engines are machine-compiled are machine-compiled and have a and have a HUGE number of pages in th number of pages in their databases (usually in the hundreds of eir databases (usually in the hundreds of millions or even the billions)millions or even the billions)

Directories v Search EnginesDirectories v Search Engines

Search engines Search engines cannot differentiate cannot differentiate contextcontext– It cannot tell the difference between an It cannot tell the difference between an

Apple computer or the fruitApple computer or the fruit– You need to be specific as possible by You need to be specific as possible by

entering key wordsentering key words– Use Boolean expressions, (discuss later)Use Boolean expressions, (discuss later)– Also use Advanced Search (e.g.,to the Also use Advanced Search (e.g.,to the

right of the Google search box)right of the Google search box)

The Second Biggest Mistake -The Second Biggest Mistake -- Restated- Restated

Using a directory as if it was a search Using a directory as if it was a search engine ... and then not understanding engine ... and then not understanding

why you can’t find anything!why you can’t find anything!

Top search sites – January 200Top search sites – January 20088

1.1. GoogleGoogle

2.2. YahooYahoo

3.3. MSNMSN

4.4. AOLAOL

5.5. Ask JeevesAsk Jeeves

6.6. LookSmartLookSmart

7.7. InfospaceInfospace

8.8. OvertureOverture

9.9. NetscapeNetscape

10.10.AltaVistaAltaVista

-- Courtesy Jupiter Media Metrix

Which ones are directories?Which ones are directories?

1.1. MSNMSN

2.2. YahooYahoo

3.3. GoogleGoogle

4.4. AOLAOL

5.5. Ask JeevesAsk Jeeves

6.6. LookSmartLookSmart

7.7. InfospaceInfospace

8.8. OvertureOverture

9.9. Netscape ODPNetscape ODP

10.10.AltaVistaAltaVista

How the sites stack upHow the sites stack up

Most directories (like Most directories (like MSN and AOL) link to MSN and AOL) link to a few million pages.a few million pages.

Most search engines Most search engines (like AltaVista and Go(like AltaVista and Google) link to ogle) link to more more than 12 billionthan 12 billion pages. pages.

-- Courtesy searchenginewatch.com

What are Meta-search Engines?What are Meta-search Engines?

•Access several search engines or directories simultaneously. • Operate on the premise that the Web is too large for any one search engine to index it all• Pay a fee to engines and directories to access their databases• Examples to look at

• dogpile - metacrawler

How to choose best search How to choose best search tool?tool?

Interactive NoodleQuest Tool help you Interactive NoodleQuest Tool help you decide on the best search tooldecide on the best search tool– http://www.noodletools.com/noodlequest/http://www.noodletools.com/noodlequest/

Understanding Google search Understanding Google search resultsresults

Cached linkCached link– Saved copy of Web page that may not be on the Web Saved copy of Web page that may not be on the Web

anymore anymore – Google saves for 60 daysGoogle saves for 60 days– For older pages not on the net (page not found/404 error) For older pages not on the net (page not found/404 error)

go to Way Back Machine at the Internet Archivego to Way Back Machine at the Internet Archive– http://www.archive.org/web/web.php http://www.archive.org/web/web.php

Similar linkSimilar link– Similar sitesSimilar sites

List across the top List across the top – Limits type or categories of sitesLimits type or categories of sites

How do you make the most of How do you make the most of your searches?your searches?

Use keywordsUse keywords For example, searching for planets will give you over For example, searching for planets will give you over

300 million hits300 million hits Add the keywords - planet Jupiter atmosphere - will Add the keywords - planet Jupiter atmosphere - will

give you considerably lessgive you considerably less Explore this strategyExplore this strategy

– You might find this chart helpfulYou might find this chart helpful– E.g., search for dolphinsE.g., search for dolphins dolphins “sea mammals”

PorpoisesFootballFishMiami

Search Engine Rule #3Search Engine Rule #3

Use the - sign to exclude.Use the - sign to exclude. Powerful toolPowerful tool Not helpful with most DirectoriesNot helpful with most Directories Remember the Must – Might - Mustn’t chart?Remember the Must – Might - Mustn’t chart?

vikingsvikings –football–football

Virus –computer -movieVirus –computer -movie

A video overview of keywords A video overview of keywords and operatorsand operators

http://www.youtube.com/watch?http://www.youtube.com/watch?v=sTNEo04OIMU v=sTNEo04OIMU

The The six six rulesrules

1.1. Be specific ... because if you aren’t specific, you’ll Be specific ... because if you aren’t specific, you’ll end up with a bunch of garbage!end up with a bunch of garbage!

2.2. Use quotes to search for phrases.Use quotes to search for phrases.

3.3. Use the + sign to require.Use the + sign to require.

4.4. Use the - sign to exclude.Use the - sign to exclude.

5.5. Use ORUse OR

6.6. Use synonymsUse synonyms

What is I’m feeling lucky button?What is I’m feeling lucky button? If you want to go directly to the top of the If you want to go directly to the top of the

search result hitsearch result hit Click I’m feeling lucky buttonClick I’m feeling lucky button

Title searches at GoogleTitle searches at Google

Lets you search for paLets you search for pages that have a particuges that have a particular word or phrase in thlar word or phrase in their title.eir title.

Great way to “cast a nGreat way to “cast a narrow net.”arrow net.”

What is the Invisible Web?What is the Invisible Web?

Invisible Web or Deep Web is not searchable directly by Invisible Web or Deep Web is not searchable directly by search toolssearch tools

Often this information is held in databasesOften this information is held in databases– One database (like a search engine) cannot search another databaseOne database (like a search engine) cannot search another database

Special search tools like Beaucoup, Deepdyve, Special search tools like Beaucoup, Deepdyve, DeepPeep help find Invisible Web contentDeepPeep help find Invisible Web content

For example let’s look at BeaucoupFor example let’s look at Beaucoup

For example let’s look at BeaucoupFor example let’s look at Beaucoup

Provides categories of databasesProvides categories of databases For example, if click on Health & For example, if click on Health &

Fitness > now you see databases > Fitness > now you see databases > If you select one of these databases If you select one of these databases > you will be able to search them for > you will be able to search them for articles. articles.

You can also do a search for You can also do a search for “searchable database” +topic in a “searchable database” +topic in a search enginesearch engine

What are visual search What are visual search tools?tools?

Use concept maps or picturesUse concept maps or pictures More engaging More engaging Makes more sense for some studentsMakes more sense for some students

What are visual search What are visual search tools?tools? On Google, e.g., first do a regular On Google, e.g., first do a regular

search search – Look on the left for Wonder Wheel*Look on the left for Wonder Wheel*

* to get it back, go to Google > click search settings on upper right > scroll down and disable Instant.

What are visual search What are visual search tools?tools? Also on the Google Search Window Also on the Google Search Window

on the left is Timelineon the left is Timeline Displays search results in Displays search results in

chronological visual formatchronological visual format

More ExamplesMore Examples Search CubeSearch Cube KartOO is a visual search engine that employs several KartOO is a visual search engine that employs several

different visualization methods. different visualization methods. This is an example of the future of Internet searching. This is an example of the future of Internet searching.

What are clustering search engines?What are clustering search engines? Clusty is one exampleClusty is one example

– Organizes search results into clustersOrganizes search results into clusters– For example, searching for “space shuttle” gives For example, searching for “space shuttle” gives

you the results in a directory on the leftyou the results in a directory on the left– So if you just want the Discovery shuttle, click on it So if you just want the Discovery shuttle, click on it

in the left listin the left list

Another example is carrot2.orgAnother example is carrot2.org– Similar to ClustySimilar to Clusty– Also has visual option link on the top leftAlso has visual option link on the top left

Why use Google?Why use Google?

Largest database of sitesLargest database of sites Does not take money for rankingDoes not take money for ranking

– So edu and gov sites have a fair opportunity to So edu and gov sites have a fair opportunity to be listed at the top of a searchbe listed at the top of a search

Simple interfaceSimple interface Many search toolsMany search tools