Graphic Bar
Veltx
Panel
Graphic Bar
Honeypot & Baidu

12.22.2012

For my friends that are web developers. I advise you to not trust the Baidu Bot. Baidu is the most popular search engine in China. However, I recently caught Baidu with my own honeypot trap. I told no website to crawl a certain page on my website with a robots.txt file. I also didn't link to the page anywhere else. However, Baidu not only visited the page, and they must have got the link to the page via the robots.txt file that was denying them access to it (or guessed the page name, which is unlikely). Extremely shady I think. Why crawl if they are not indexing also.

Also, be on the look out for referrer spam, as many bots are roaming the net lately with fake referrer information. I guess in hopes of increasing backlinks on sites that have referrers public, or getting traffic from administrators.



My works are covered under Veltx Works



Comments


Name

Website

Email (Not public.)
Comment


Online
Website Design & Implementation By D3xt3r
1,666,179 Hits
8 Users Online
Load 0.144 Secs
Powered with SQL & X.D.D
veltx veltix d3xt3r d3x dex dexter