For some time now I have noticed errors happening on a number of websites Clydesdale Software host’s. The errors all involve .axd pages. After some investigation and looking up the ip addresses that were causing the errors I found they were robots crawling the site.
To fix the issue quickly I disallowed the .axd pages the crawlers were hitting by adding to the Robots.txt:
Disallow: /WebResource.axd
Disallow: /DXR.axd
Disallow: /ScriptResource.axd
This cleared up the errors and now i can see through the forest so any real errors can be detected.