Wednesday, January 26, 2011

Craigs Directory - Clean-up Update II

The webbot I wrote last week has now been running against Craigs Directory for 5 days and so far has checked ±39,000 of the ±55,000 websites. This check basically ensures that the website submitted to the web directory is still available, and if not, removes it from the index. No point linking to websites that no longer exist?

So far, of the ±39,000 websites checked, over 2,000 websites have been removed!

I find this trend quite worrying. People get these great ideas (or are sold lemons) and setup a website using free ISP's, blogs, wordpress, etc. They give it a few months and then give up, letting the website die.

Keep trying, be persistent, it will work.

Regards,
Craig

No comments:

Post a Comment