The Robots Exclusion Standard (web spider)
http://www.searchengineworld.com/robots/robots_tutorial.htm
http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
Getting more hits count for a web sites.
http://tom.gilki.org/programming/other/121104/
and set the meta tag of the main page. (check thestar.com.my)
http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
Getting more hits count for a web sites.
http://tom.gilki.org/programming/other/121104/
and set the meta tag of the main page. (check thestar.com.my)
Comments