The Robots Exclusion Standard (web spider)

http://www.searchengineworld.com/robots/robots_tutorial.htm

http://www.searchengineworld.com/cgi-bin/robotcheck.cgi

Getting more hits count for a web sites.

http://tom.gilki.org/programming/other/121104/

and set the meta tag of the main page. (check thestar.com.my)


Comments

Popular posts from this blog

Clearcase check in/uncheck out all the checked out files script

MSSQL GROUP_CONCAT

Duplicating a local copy of project from TFS and making web software client factory to work