the Deep Web - the technical truth
if you try to google "deep web" you'll get tons of results, most, unfortunately interesting conspiracies and "bad" stuff. What's in it? but the truth is that the 1st main portion of the deep web is just a lot of data that is just out there, that anyone can get there, and google just cant index it for 1 of 3 main reasons - 1 - its API format data - i.e. JSON, XML, numbers ect. 2 - its form query based data, meaning its in a database and you need to send a query to get results. 3 - its logon based (facebook, ect.) the crawlers knows how to handle web pages, today even with JS and AJAX, but still only web pages. there are of course more reasons, for example google, and when i say google i mean search engines, will not index illegal stuff, heavy gore, copy-rights (more relevant on youtube), and commercial reasons. so ye, most of the deep web is just data, yet for specific people, such as NASA's API's, and here is a list of 60 de...