Batch wizard hangs at around 90%

[Louis]

Hi,

I'm having problems with the batch wizard hanging, usually at about 90%.
When it hangs, the processor is idle (and I can hear the fan slowing down, I'm validating an ASP.Net site running on localhost).
Sometimes it just remains idle without hanging directly, allowing me to click on pause, resume and stop, but not long after that it hangs and Windows grey's it out (Not responding), even after leaving it like that for an hour, it does not recover.

Is there any way I can turn on logging? Or would you like a stack trace (I could get one out of process explorer if it would be useful).

PROGRAM NAME: CSE HTML Validator Professional
VERSIONSTRING: 11.02
VERSIONINTERNALSTRING: 11.0211
DLLVERSIONSTRING: 11.0211
CSECFGVERSION: 201204110
EXPIRES: NO
DATE: donderdag 19 april 2012
TIME: 23:39:47
REGISTERABLE: YES
REGISTERED: YES
DLL REGISTERED: YES
EUREKALOG: NO
PORTABLE MODE: false
TAdvTaskDialog: v1.7.2.2
Addict: v4.30.2074 Pro

[Albert Wiersch]

Unfortunately this may be a hard one to diagnose.

Some possibilities:
1. Try turning off anti-virus and other anti-malware products as they could be interfering.
2. What is your memory situation? Are you able to pull up Task Manager to see how much memory CSE HTML Validator is using, especially at the point where is hangs?
3. Are you able to split the job into smaller sections? Perhaps it would work then or it would help isolate the issue.
4. If you turn off link checking, does it run to completion?

[Louis]

After closing all instances of Visual studio running on my machine (which is quite a memory hog) it successfully did a complete run. The batch did give some errors (listed at the end of this post).

I did notice some peculiar behavior while looking at the graph in ProcessMonitor while the batch was running, it builds up memory quite fast while processing smaller pages (~8k) but doesn't seem to build up any memory at all when processing larger pages (~40K). The smaller pages tend do have more links though.

My machine has 4 Gig of internal memory (it is running SQL Server Express (memory throttled) and IIS while testing the website). After running the batch, when everything is idle again, I have about 1 gig of free physical memory.

I'll do another run later today (or tonight) with link checking turned off and let you know what the effect is.

Cheers,
Louis

---- errors displayed in batchreport_imsgs.html after running the batch ----
Important Messages/Errors From Job Run (6)

An error occurred for the request "http://localhost/english/branham/julius-stadsclev". Failed Count: 1, Error: 0, Status: 404, Reason: Not Found. This target will not be processed (tried 1 time). The parent target is "http://localhost/english/branham".
*** An exception occurred (2011033101) in ProcessTargetValidate(). jobconfig: ptr:105302272. Exception: *** An exception occurred (2011041111). Exception: *** An exception occurred (2011041129). Exception: *** An exception occurred (2011041128). Exception: *** An exception occurred (2011062801). Exception: *** An exception occurred (2011041179). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "AWCheckURI". Exception: *** An exception occurred (2011041239). Exception: *** An exception occurred (2011041240). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "checkStringEx". Exception: *** An exception occurred (2011041225). EAccessViolation: Access violation at address 067069A2 in module 'csevalidatorV110.dll'. Read of address 00000023. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***
*** An exception occurred (2011033002) in ProcessTargetValidate(). jobconfig: ptr:105302272. Exception: *** An exception occurred (2011041111). Exception: *** An exception occurred (2011041129). Exception: *** An exception occurred (2011041128). Exception: *** An exception occurred (2011062801). Exception: *** An exception occurred (2011041179). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "AWCheckURI". Exception: *** An exception occurred (2011041239). Exception: *** An exception occurred (2011041240). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "checkStringEx". Exception: *** An exception occurred (2011041225). EAccessViolation: Access violation at address 067069A2 in module 'csevalidatorV110.dll'. Read of address 00000023. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***
*** An exception occurred (2011032404) in ProcessTargetValidate(). jobconfig: ptr:105302272. Exception: *** An exception occurred (2011041111). Exception: *** An exception occurred (2011041129). Exception: *** An exception occurred (2011041128). Exception: *** An exception occurred (2011062801). Exception: *** An exception occurred (2011041179). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "AWCheckURI". Exception: *** An exception occurred (2011041239). Exception: *** An exception occurred (2011041240). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "checkStringEx". Exception: *** An exception occurred (2011041225). EAccessViolation: Access violation at address 067069A2 in module 'csevalidatorV110.dll'. Read of address 00000023. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***
*** An exception occurred (2011020701). Exception: *** An exception occurred (2011041111). Exception: *** An exception occurred (2011041129). Exception: *** An exception occurred (2011041128). Exception: *** An exception occurred (2011062801). Exception: *** An exception occurred (2011041179). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "AWCheckURI". Exception: *** An exception occurred (2011041239). Exception: *** An exception occurred (2011041240). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "{". Exception: *** An exception occurred (2011041180). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "if". Exception: *** An exception occurred (2011041248). Exception: *** An exception occurred (2011041181). Exception: *** An exception occurred (2011041301) in InterpreterW::getInteger(). Token is "checkStringEx". Exception: *** An exception occurred (2011041225). EAccessViolation: Access violation at address 067069A2 in module 'csevalidatorV110.dll'. Read of address 00000023. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. ***. Please report this to support@htmlvalidator.com. ***
*** A problem occurred processing the target "http://localhost/Bible/SVV?bk=49&ch=6". ***

[Louis]

Here are the results without link checking (and after repairing about 3000 Html errors on the tested site, which may also have contributed to more memory usage).

No program errors were reported this time. There is about 100 Mb difference in peak memory usage.

Cheers,
Louis

[Albert Wiersch]

Hi Louis,

Thanks for the screenshots and errors.

I think the most likely cause of this is a memory issue. The memory usage per document can vary widely depending on the validator settings and how many messages it generates per document. The enterprise edition of CSE HTML Validator has features to allow for larger jobs, so you may want to look into that. Otherwise you might want to try to split up the job into smaller pieces and run them separately.

If you are able to isolate any issues and find a way to reproduce them reliably, then I would like to try to reproduce it here. In this case, please send me directions on how to reproduce the problem. However, I suspect it's a memory limitation given the size of the jobs you are running and the other programs you are running in the background that may be using a lot of memory. Link checking will also require more memory, and the more links, the more memory is needed.