I have been trying to figure out why I am getting webcrawl errors. It has been driving me crazy!
So far, I have found two things.
1. Under the sitemap page, one site did not have sitemap content checked to be included in the site map.
2. For both sites that have this problem, I had the plugin that was automatically included in the WPD initial process - WordPress Duplicate Content.
I have a third site that does not have the WP Duplicate Content plugin, and that sitemap is correct. Google Webmaster tools has found no 404 errors. But, the two sites with the webcrawl errors did have that plugin activated.
I have deactivated that plugin and rebuilt the site map. Now, I can see that my categories are included in the site URLs. I will watch google over the next few days to see if the 404 errors are dropped.
Carmen
__________________
Imagination is more important than knowledge.
-Albert Einstein
Carmen's Friend Feed
|