Google Only Sees 2% Of The Internet: An Intro To The Deep Web

Cliff Makanda Avatar

When most us use the internet to search for something we naturally use Google’s search engine. What if Google doesn’t give us what we want ?

The amount of information Google can provide is surely immense but it’s not everything out there.It is estimated that people only use about 2 % of the internet. This means that every time you use Google you might miss about 98% of the information that you might use. Google does not have access to  all content on the internet that is not yet indexed.

When you send a request for information on ‘networks’, it gives you links to on articles on networks. These articles are arranged on Google according to reliability, citation, number of reads among other factors.

But Google is only able to provide you those articles about networks that are indexed. Google only has access to these indexed  files on the web.

What about all the other millions of files about networks that are not indexed ? Those files are found in what we call The Deep Web.

To access the deep web you have to use other search platforms  to find information. All you have to do is do some good digging to find these platforms. If you are a scholar, you can ask fellow scholars for some of these platforms or even Google about them .

Some people who are familiar with the deep web sometimes write articles about sites in the dark web. Using the surface web to look for these posts can help you obtain the urls of  some deep web sites.You can obtain  access to multiple databases and academic journals that you would not normally find on surface of the web.

Some websites, for various reasons,  can only be accessed through the use of special browsers such as TOR. Downloading the necessary tools to use them will allow you to access these websites in the deep web.These tools are often  offered for free.

,

8 comments

  1. Peter Raeth

    Many many thanks for this article, and the link it contains. At Chinhoyi University of Technology we have a project, with proof of concept, to search the search engines for open access literature. This is our way of making quality literature available while legally bypassing commercial publishers. Our hope is to open the flood gates for students, researchers, and entrepreneurs.

  2. SoTypMe

    That statistic just blew my mind. 2%, you guys! Anyway, got curious about the “Dark Web” when that Silk Road guy got arrested. I googled it up and the only impression I got was that its a place for questionable and illegal activities only. Thanks for the article, cleared up a few things for me.

    But now I’m even more curious: Why is 98% of the internet not indexed? Who does the indexing and why are they leaving out almost everything? How do I easily access it. Can I paste a ‘dark web’ url in my regular browser and open the site?

    1. Peter Raeth

      Be sure to carefully read the article linked from the first article. It gives a good description of what is available. These are specialty sites containing information that the general public would likely have no interest in. It is true that some of the sites mentioned in the linked article do redistribute copyrighted material illegally. The article is very clear about that. But that material is a low percentage compared to the rest of the available material. It is worth mentioning that CUT’s initiative in open-access does its best to avoid material that is illegally redistributed.

  3. Mr Apache

    While the Deep Web contains a wealth of valuable information, especially for scholars, it’s also a dark and dangerous place. The Deep Web’s anonymity attracts criminal activity ranging from the sales of illegal drugs and weapons and even the hiring of contract killers. The Deep Web even has an illicit version of eBay, known as The Silk Road, where all manner of illegal goods and services can be purchased. The Deep Web also contains information hidden behind the paywalls and security measures of some companies. Guess one could make money through selling bronco/codein

    1. Peter Raeth

      What is said here is very true. But, with good judgement one can avoid the trash and pick up the golden nuggets. Just be sure your curiosity does not get the better of you regarding the trash. Organizations such as Interpol and Mossad know about the trash and keep a close eye on those who visit the junk yard. You don’t want to get on their radar. CUT’s project reviews each search engine before including it in the search of search engines.

      1. Anonymous

        Silkroad was shut down. Very few (indexed) sites left worth visiting on the deep web. Everywhere you go there is child pornography. Even the imageboards/forums have been infiltrated. I strongly advise against browsing .onion sites

  4. Sinclair

    I think it should be pointed out that the TOR network has been essential for whistleblowers (Snowden as an example) and for human rights activists in many countries. It is not only a place for criminals, porn or whatever. Here a quote from Wikipedia: “Using free software, Tor has enabled roughly 36 million people around the world to experience freedom of access and expression on the Internet while keeping them in control of their privacy and anonymity. Its network has proved pivotal in dissident movements in both Iran and more recently Egypt.”[36]

  5. GONDO

    Cliff, you have been watching CSI – Cyber?

Join Waitlist We will inform you when the product arrives in stock. Please leave your valid email address below.