mining the “deep web” - mebs.files.wordpress.com · reluctant-entrepreneur.com the “deep...

Reluctant-Entrepreneur.com

Mining the “DeepWeb”

Mary Ellen BatesReluctant–Entrepreneur.comAugust 16, 2017


What’s the “Dark Web”?

Accessible only through anonymousnetworks

Black-market content (drugs, hackingsoftware, porn)Free-speech forumsDrop-sites for leaks

6


Search engines are blocked by…

8


The “Deep Web” is…

Info that search engines can’t easilyfind, get into or read

DatabasesImages, multimedia, statisticsBooks, articlesFacebook and other social media*

*tomorrow at 10:15

9


Deep Web strategies

Look for the next lead, not The Answer

Treat it as a treasure huntWatch for clues, lists of resources

Build your own “library” of sources

10


Horticultural resources

plants.usda.gov

garden.org

catalog.extension.org

11


Business resources

SCORE.org

SBA.gov

inc.com/grow

Pixabay.com (free images)

13


Finding deep web content

Use search engines for leads:Keywords (database OR dataset ORarchive)Keywords (portal OR resources OR“online tool”)

15


Finding deep web content

Start with one known source (ass’n,agency, non-profit, library, etc.)

Then find their links to other resources

Look for mentions OF that sitee.g. “consumerhort.org”

16


Find “similar” sites

SimilarSites.comBased on content, link analysis, userbehavior, etc.Use to find other good sites

17


We librarians

Librarians build “libguides”Road map for better research on a topicLoaded with deep web links

inurl:libguides ("garden center" ORgardening OR horticulture)

19


Libraries have deep web!

Stick around for “HiddenDatabases: Accessing PricelessMarket Research… WithoutSpending a Dime”

21


Insights from other shows

ID relevant conferences("garden show" OR "horticulturalshow") trends

Be sure to limit the search to this yearThen….

22


Insights from other shows

Find the web site for that showScan workshops, keynotesLook up those speakers, see theirweb pages

23


Insights from expen$ive reports

ID the title of a useful report

Google mentions of that report andthe word trends

"according to the 2017 NationalGardening Survey" trends

24


Has a page disappeared?

Try the Wayback Machine(archive.org)

Copies of the page over time

25


Has a page disappeared?

Try the Google cached copyCopy the URL into Google’s search boxClick the next to the link

27


The Deep Web = 2nd pageof Google search results

Go deeper!

Change your settings to 100 results

30


“Hidden” search results

Use Millionshort.com to see otherresults

“Long-tail” search engineEliminates the most popular sitesFind obscure and less-commercialsites

32


Slide deck is at

Reluctant–Entrepreneur.com/extras(or just text me)

Mary Ellen Bates+1 303 772 [email protected]: @mebs

34

mining the “deep web” - mebs.files.wordpress.com · reluctant-entrepreneur.com the “deep...

Documents