Deep web Seminar
- 2. CONTENTS 1. INTRODUCTION 2. LIMITATION OF GOOGLE 3. INTRODUCING DEEP WEB 4. EVOLUTION OF DEEP WEB 5. SIZE OF DEEP WEB 6. HOW TO ACCESS DEEP WEB 7. EXPLORING TOR 8. SOME DEEP WEB SITES 9. CONCLUSION 10.REFERENCES
- 3. INTRODUCTION • Modern Internet: Most effective source of information. • Most popular search engine: Google • In 2008, Google added Trillionth (10^¹²) web link to their index database! • Stores several billion documents! • Many times we are not satisfied with the search results. HOW SEARCH ENGINES WORK Spiders or web crawlers Indexed database • Search engines construct a database of the Web by using programs called spiders or Web crawlers • The spiders will collects in formations, keywords, data, URLs from the web and store it on to the search engine’s indexed database.
- 4. THEN WHY GOOGLE FAILS? • Most of the Web's information is buried far down on dynamically generated sites. • Traditional web crawler cannot reach there. • Large portion of data are literally ‘un-explored’ • Need for more specific information stored in databases • Can only be obtained if we have access to the database containing the information. THE SOLUTION IS….
- 5. DEEP WEB • The Deep Web is World Wide Web content that is not part of the Surface Web, which is indexed by standard search engines. • It is also called the Deep Net, Invisible Web or Hidden Web. • Largest growing category of new information on the Internet. • 400-550 more public information than the Surface Web. • Total quality 1000-2000 greater than the quality of the Surface Web.
- 6. The deep Web is just any page that you can't get to from a search engine. Your bank account page is the deep Web. It was created by your bank. Your Facebook “edit profile” page is the deep Web. It was created by Facebook. WHY DEEP WEB NOT INDEXABLE • Dynamic Web Pages – returns in response to a query or accessed only through a form. • Unlinked Contents – Pages without any backlinks. • Private Web – sites requiring registration and login (password-protected resources). • Limited Access web – Sites with CAPTCHAs. • Scripted Pages – Page produced by JavaScript, Flash, AJAX etc. • Non HTML contents – Multimedia files e.g. images or videos.
- 8. EVOLUTION OF DARK WEB • Early Days: static html pages, crawlers can easily reach • In mid-90’s: Introduction of dynamic pages, that are generated as a result of a query. • In 1994: The term “Invisible Web” used to refer to these websites. • In 2001, it is known as “Deep Web”
- 9. SIZE OF DEEPWEB • Deep Web about 7500 Terabytes. • Surface Web about 19 terabytes. • Deep Web has between 400 and 550 times more public information than the Surface Web. • 95% of the Deep Web is publically accessible • More than 200,000 Deep Web sites currently exist. • 550 billion documents on Deep Web • 1 billion documents on Surface Web
- 10. HOW TO ACCESS DEEP WEB 1. GET A VPN – A VPN, which is short for virtual private network, hides your computer’s physical IP address by routing it through a virtual IP address at a different location. 2. UNDERSTANDING .onion – You can’t access the deep web using a browser like Chrome because it’s unable to connect to .onion websites. A .onion address is a special top-level domain suffix for anonymous websites. e.g. :: http://xhyj24jhb5tf3bvi.onion 3. Download Tor – Originally developed with help from the U.S. Navy to allow people to read the internet anonymously.
- 12. EXPLORING TOR • In TOR there is 3 nodes are present. Each node has a unique session key. • 1st , 2nd and 3rd node have its own IP Address. • 2nd node knows only the 1st node’s IP Address • 3rd node knows only the 2st node’s IP Address • 3rd node provide security by encrypting the data • 3rs node has no idea about the traffic originated from.
- 13. Facebook’s .onion site SOME DEEPWEB SITES
- 14. Sci-Hub -the world’s scientific database
- 15. The Hidden Wiki on .onion
- 21. The Deep Web is the largest part of the internet, yet the majority of the population does not even know about it, or even access it. It can be used for good and for bad, legal and illegal activity. it is important to understand that it is not all bad. There is plenty good about the Deep Web, which includes the right of privacy when surfing the Internet. The understanding of the Deep Web and its capabilities is vital to the future of the Internet CONCLUSION
- 22. REFERENCES 1) www.youtube.com 2) www.digitaltrends.com 3) www.deepweb-sites.com 4) www.quora.com 5) thehiddenwiki.org 6) grams7enufi7jmdl.onion.cab
Editor's Notes
- #4: INDEX.HTML ROBOT.TXT