The Robots Exclusion Standard (web spider)

http://www.searchengineworld.com/robots/robots_tutorial.htm

http://www.searchengineworld.com/cgi-bin/robotcheck.cgi

Getting more hits count for a web sites.

http://tom.gilki.org/programming/other/121104/

and set the meta tag of the main page. (check thestar.com.my)


Comments

Popular posts from this blog

Outlook : "operation failed, object could not be found. " when trying to close a PST.

Troubleshooting Outlook Express (IMAP, POP3, HTTP, NEWS) with the log file

MSSQL GROUP_CONCAT