It indeed used to not evaluate it's spec (which explains the silly comment, there was also a with-connection* which did), but now it does, since this makes using it much easier -- you'll usually want to pass such a spec around as a list, and it's clumsy to have to unpack it every time you use the macro:
(with-connection ((car spec) (cadr spec) (caddr spec)) ...)
So in version 1.1 (I think) I dropped the old non-evaluating version, and made only this one available. I'll change the docstring.
Best, Marijn