100 ms overhead for a tiny query sounds very wrong. I just tried this out as well -- (time (query (:select 1))) -- and am seeing about .8 milliseconds average. If such a query from another tool is also taking 120ms, I think you should look for the problem in your server, since this shouldn't be taking that long, not even on 1990-era hardware.
Best, Marijn