ผมจะเปิด bot ใน robots-txt ยังงัยคั้บ
Hello,
I have granted restricted access to your IP address ddddddddd at this time. Please work to reduce the resource usage that we've outlined and let us know when you are ready to have your site re-evaluated. If you require any assistance or have any questions please let us know.
One item I noticed is you are getting a fair amount of bot traffic to the sites which, if reduced, can reduce some of the usage occurring due to those hits. Below is a snapshot of the bot activity on the account:
=========/home/apachelogs/กกกกกกกกก/กกกกกกกก.com-Aug-2012.gz==========
836 Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
921 Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)
975 OSS-bot/0.02 (see
http://michaelnielsen.org/blog/oss-bot/ 
or contact Michael Nielsen,
[email protected])
1084 Mozilla/5.0 (compatible; MJ12bot/v1.4.3;
http://www.majestic12.co.uk/bot.php?+ )
5408 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
7954 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
10691 Googlebot-Image/1.0
18526 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
32891 Mozilla/5.0 (en-us) AppleWebKit/534.14 (KHTML, like Gecko; Google Wireless Transcoder) Chrome/9.0.597 Safari/534.14
54323 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
=========/home/apachelogs/กกกกกกกl/กกกกกกก.com-Aug-2012.gz==========
34 Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/)
37 Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
49 OSS-bot/0.02 (see
http://michaelnielsen.org/blog/oss-bot/ or contact Michael Nielsen,
[email protected])
68 Mozilla/5.0 (compatible; AhrefsBot/3.1; +http://ahrefs.com/robot/)
68 Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/536.8 (KHTML, like Gecko; Google Web Preview) Chrome/19.0.1084.36 Safari/536.8
122 msnbot/2.0b (+http://search.msn.com/msnbot.htm)
1226 Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
2343 Mozilla/5.0 (en-us) AppleWebKit/534.14 (KHTML, like Gecko; Google Wireless Transcoder) Chrome/9.0.597 Safari/534.14
5613 Googlebot-Image/1.0
7426 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
In many cases, you can resolve a crawler issue by creating a robots.txt file, which provides information to crawlers on how to crawl your site, such as what directories are not allowed and the crawl rate. You can read more about the robots.txt in our Knowledge Base article titled "How to use robots.txt", which can be found at
http://support.hostgator.com/a...-started/how-to-use-robots-txt I apologize for the confusion. Unfortunately, Googlebot does not work with the normal robots.txt file. You will need to login to their WebMaster Tools and make the changes to the crawl rate there. You can find information and instructions on modifying Googlebot's crawl rate at
http://support.google.com/webm...swer.py?hl=en&answer=48620 
ความรู้ทั่วไป
