AshTheGamer Posted October 30, 2008 Share Posted October 30, 2008 Hey their,This is how to Become a Google BotWhat you'll need:Firefox,The Modify Headers extension for firefox.What you can do:Many sites allow google to look into their forums, in order to get more traffic by getting more google search results. By pretending to be the google search indexer (aka spider, bot) we can access parts of these sites off limits to guests.Example URL:http://www.tuts4you.com/forum/index.php?showtopic=9959I found this address today doing a google search, and noticed that although I didn't have access, google had a cached version. Head over to this url, and you should get the same error as me.First, head over to google and type in 'browser headers'. The first link should take you to a page which gives you all the information your browser sends to web servers. This information, specifically the User-Agent field, is how the google bot tells web servers what it is. Go back to the google search, and click on the 'cached' link.Notice in the 'User-Agent' field, where it once showed your browser info, now it says:Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)Download the Modify Headers extension.(http://modifyheaders.mozdev.org/)And open it up. Next you need to make a rule, modifying the 'User-Agent' header to say 'Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)'Once you're done, make sure it's enabled, and browse over to the example url. Even though you're not logged in, you should be able to browse their forums. Link to comment Share on other sites More sharing options...
... Posted December 11, 2008 Share Posted December 11, 2008 Cool, you can also do this w/ this proxy website I found, open-proxy.com..I saw the settings and remembered this topic.. so thanks.:PBut I changed my bot to Mozilla/5.0 (compatible; ...Bot/1.1; +http://www.....com/bot.html) Link to comment Share on other sites More sharing options...
AshTheGamer Posted April 7, 2009 Author Share Posted April 7, 2009 Oh ok cool. Link to comment Share on other sites More sharing options...
Bizarre™ Posted April 7, 2009 Share Posted April 7, 2009 Try opening about:config, and create a new string called general.useragent.override then set to Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Link to comment Share on other sites More sharing options...
AshTheGamer Posted April 14, 2009 Author Share Posted April 14, 2009 Thanks for that add post Bizarre™ Link to comment Share on other sites More sharing options...
Marik Posted April 19, 2009 Share Posted April 19, 2009 Link to comment Share on other sites More sharing options...
Bizarre™ Posted April 19, 2009 Share Posted April 19, 2009 Nice plug-in <_< Link to comment Share on other sites More sharing options...
Marik Posted April 19, 2009 Share Posted April 19, 2009 Nice plug-in :blink::yes: Link to comment Share on other sites More sharing options...
sakai99 Posted November 23, 2009 Share Posted November 23, 2009 thanks... working!!! Link to comment Share on other sites More sharing options...
spootnack Posted December 4, 2009 Share Posted December 4, 2009 NICE !!!!!!!Thank you ! Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.