This link has been bookmarked by 478 people . It was first bookmarked on 02 Mar 2006, by someone privately.
-
26 Feb 16
-
26 Aug 15
Heath SawyerWhat is the "Invisible Web", a.k.a. the "Deep Web"? The "visible web" is what you can find using general web search engines. It's also what you see in almost all subject directories. The "invisible web" is what you cannot find using these types of t…
-
28 Jul 15
srasponeProvides a definition for the "Invisible Web" and explains why all content on the Internet isn't readily visible to search engine crawlers.
week 5 invisibleweb research searching middle school high school
-
29 Jun 15
-
23 Oct 14
-
18 Oct 14
-
17 Oct 14
-
- Pages in non-HTML formats (pdf, Word, Excel, PowerPoint), now converted into HTML.
- Script-based pages, whose URLs contain a ? or other script coding.
- Pages generated dynamically by other types of database software (e.g., Active Server Pages, Cold Fusion).
These types of pages used to be invisible but can now be found in most search engine results:
-
-
13 Jun 14
-
18 Apr 14
-
19 Mar 14
-
13 Mar 14
-
05 Jan 14
-
19 Oct 13
Frank SutcliffeWhy database contents arent visible to the surface web crawlers or search tools
-
Because the crawler programs cannot type or think, they cannot enter passwords on a login screen or keywords in a search box. Thus, these databases must be searched separately.
-
The Contents of Searchable Databases. When you search in a library catalog, article database, statistical database, etc., the results are generated "on the fly" in answer to your search.
-
Dynamically generated pages of little value beyond single use
-
-
14 Sep 13
-
11 Jun 13
-
26 Feb 13
-
15 Jan 13
Erin GibsonWhat it is, Why it exists, How to find it, and Its inherent ambiguity
-
19 Oct 12
-
18 Oct 12
-
12 Oct 12
-
07 Oct 12
-
21 Sep 12
The invisible web is the hidden area of the Internet that is not searched automatically by search engines. This page gives you an introduction on how to find and use it.
reference research search engines learning place Learn: ICT facts computers information literacy invisible web
-
02 Sep 12
-
27 Jun 12
-
15 May 12
victoria waddleHow to find articles in deep web.
UCBerkeley CAL research search_engine subject-directory resources invisibleweb
-
03 May 12
-
18 Apr 12
-
15 Apr 12
-
21 Mar 12
-
21 Feb 12
-
14 Feb 12
-
13 Feb 12
-
02 Feb 12
-
08 Jan 12
-
eb page was written in 2000, when this topic was new and baffling to many web searchers. Since then, search engine
-
-
20 Dec 11
Gonzalo San Gil, PhD.[What is the "Invisible Web", a.k.a. the "Deep Web"?
The "visible web" is what you can find using general web search engines. It's also what you see in almost all subject directories. The "invisible web" is what you cannot find using these types of tools.
The first version of this web page was written in 2000, when this topic was new and baffling to many web searchers. Since then, search engines' crawlers and indexing programs have overcome many of the technical barriers that made it impossible for them to find "invisible" web pages.
These types of pages used to be invisible but can now be found in most search engine results:
Pages in non-HTML formats (pdf, Word, Excel, PowerPoint), now converted into HTML.
Script-based pages, whose URLs contain a ? or other script coding.
Pages generated dynamically by other types of database software (e.g., Active Server Pages, Cold Fusion). These can be indexed if there is a stable URL somewhere that search engine crawlers can find. ]invisibleweb deepweb Deep Web invisible deep web search resources reference
-
18 Nov 11
-
16 Nov 11
-
13 Oct 11
-
06 Oct 11
-
05 Oct 11
-
04 Oct 11
-
28 Sep 11
-
05 Sep 11
-
22 Aug 11
-
18 Aug 11
-
06 Aug 11
-
17 Jul 11
xs ruminationWhat it is, Why it exists, How to find it, and Its inherent ambiguity
search invisibleweb research web deepweb reference searching resources
-
11 Jul 11
-
05 Jul 11
-
01 Jul 11
-
23 Jun 11
-
20 Jun 11
-
Excluded Pages. Search engine companies exclude some types of pages by policy, to avoid cluttering their databases with unwanted content.
-
-
19 Jun 11
-
13 Jun 11
-
09 Jun 11
-
06 Jun 11
-
26 May 11
Emma CraggWhat it is, Why it exists, How to find it, and Its inherent ambiguity
-
17 May 11
-
21 Apr 11
-
20 Apr 11
-
12 Apr 11
-
-
Remember that the Invisible Web exists. In addition to what you find in search engine results (including Google Scholar) and most web directories, there are other gold mines you have to search directly. This includes all of the licensed article, magazine, reference, news archives, and other research resources that libraries and some industries buy for those authorized to use them.
As part of your web search strategy, spend a little time looking for databases in your field or topic of study or research. The contents of these may not be freely available: libraries and corporations buy the rights for their authorized users to view the contents. If they appear free, it's because you are somehow authorized to search and read the contents (library card holder, company employee, etc.).
-
-
21 Mar 11
-
20 Mar 11
-
17 Mar 11
-
07 Mar 11
-
23 Feb 11
-
20 Feb 11
-
14 Feb 11
-
12 Feb 11
-
11 Feb 11
-
07 Feb 11
-
22 Jan 11
-
20 Jan 11
-
18 Jan 11
-
17 Jan 11
-
05 Jan 11
-
04 Jan 11
-
03 Jan 11
-
27 Dec 10
-
26 Dec 10
-
The "visible web" is what you can find using general web search engines. It's also what you see in almost all subject directories. The "invisible web" is what you cannot find using these types of tools.
-
How to Find the Invisible Web
Simply think "databases" and keep your eyes open
-
Search engine companies exclude some types of pages by policy, to avoid cluttering their databases with unwanted content.
-
search engines' crawlers and indexing programs have overcome many of the technical barriers that made it impossible for them to find "invisible" web pages.
-
These types of pages used to be invisible but can now be found in most search engine results
-
Use Google and other search engines to locate searchable databases by searching a subject term and the word "database". If the database uses the word database in its own pages, you are likely to find it in Google. The word "database" is also useful in searching a topic in the Google Directory or the Yahoo! directory, because they sometimes use the term to describe searchable databases in their listings.
-
Pages in non-HTML formats
-
Script-based pages, whose URLs contain a ?
-
Pages generated dynamically by other types of database software
-
Here are some examples of material that remains hidden from general search engines
-
The Contents of Searchable Databases. When you search in a library catalog, article database, statistical database, etc., the results are generated "on the fly"
-
they cannot enter passwords on a login screen or keywords in a search box. Thus, these databases must be searched separately
-
is part of the public or visible web. It contains citations to journal articles and other publications, with links to publishers or other sources where one can try to access the full text of the items. This is convenient, but results in Google Scholar are only a small fraction of all the scholarly publications that exist online
-
Much more
-
is available through article databases that are part of the invisible web
-
web page creator who does not want his/her page showing up in search engines can insert special "meta tags" that will not display on the screen, but will cause most search engines' crawlers to avoid the page.
-
Of particular value in academic research are:
-
Remember that the Invisible Web exists. In addition to what you find in search engine results (including Google Scholar) and most web directories, there are other gold mines you have to search directly. This includes all of the licensed article, magazine, reference, news archives, and other research resources that libraries and some industries buy for those authorized to use them.
-
-
15 Dec 10
-
07 Dec 10
-
03 Dec 10
-
20 Nov 10
-
09 Nov 10
-
20 Oct 10
-
15 Oct 10
-
13 Oct 10
-
12 Oct 10
-
11 Oct 10
-
27 Sep 10
-
24 Sep 10
-
21 Sep 10
Page Comments
Would you like to comment?
Join Diigo for a free account, or sign in if you are already a member.