Please try the new release and see if you still have the same problems.
I've tried it out on my data and it is certainly much better. But there are still some connections left after a run of 1646 urls.
I'll take another look at the code later tonight and see if I can discover anything. Also, I'll send along my run data in a separate email to interested parties.
Cheers, Chris Dean