Amusing
This may or may not work for you at first, but try it:
type http://your-user-name.blogspot.com/robots.txt
This should bring up the bit of code included with your site files that tells search engine crawlers what they can do. If you have your own web space that you can upload files to, you can create a robots.txt file to tell Google, Yahoo and other search bots not to crawl your site, keeping your content from being listed. I've done this to keep the RCB minutes from being crawled in the past.
Notice which search engine Blogspot (owned by Google) has chosen to block from crawling its sites?
However, if you're really (un)lucky, you might find your robots.txt file not only blocks that engine but, for some odd reason, also blocks Google. Go figure.
0 Comments:
Post a Comment
<< Home