Is the http method using a different algorithm compared to the fast local
repository? A big part of the problem is how many connections it has to make to
the server, especially since we are using easy-to-set-up CGI.

Maybe it could simply do a better job combining some of the ?pairs= or ?nodes=
requests into a single request when it already knows it has to fetch more than one.