Page 1 of 1

Multi Core CPUs

PostPosted: Mon Jan 30, 2012 7:36 pm
by roedygr
I am just trying out a 6-core CPU I got for Christmas. I was frustrated to discover that HTMLValidation is not that much faster.

I thought perhaps if Batch might get perhaps 4 threads going, each one decidated to validating one file and putting the result in a file, they could run independently. As soon as a thread finished, it could pick the next one out of the queue. At the end you create a summary document with links to all the result documents.

I know that multithreading is much more difficult in C++ than Java. Perahaps a watered down version would simply read ahead the next file while you are validating the previous one. That way you would at least get overlap of i/o and computation.

Re: Multi Core CPUs

PostPosted: Mon Jan 30, 2012 8:27 pm
by Albert Wiersch
Hi Roedy,

The validation engine is not currently designed for more than one validation at a time. I have thought about working on this, and may do so for a future version. It would be great to put more cores to use, but doing so would be time-consuming and complex, and take away from other features like improving the validation.

CSE HTML Validator does, however, use multiple threads to do other work, like link checking in the background. The Batch Wizard, since version 10.02, is also significantly faster than it was before 10.02, so progress has been made.

Perhaps more beneficial would be a way to not re-validate documents that have been checked before and have no errors or warnings, as discussed in another topic.