While validating a web page with many internal links, I soon noticed that my web server slowly but surely became unreachable.
Upon further investigation, I discovered that CSE was going wild with link checking, thereby flooding my poor apache setup with tons of GET-requests, whereby my server started swapping wildly.
Perhaps it would be a good idea to set a (configurable) limit on the number of outstanding link checks before continuing with the others.
Curious what you think.



