Must be your end too, Jaap, I get them (at least partially) in under three seconds - that's on an ISDN connection 13 hops away from the server (only one of them being any bottleneck at all). Try tracerouting and see if the problem ain't more on your end.
Yes, the server does a fair deal of work for each page request, but I can't complain. Since the move about half a year ago PM isn't any slower than the rest of the web for me and the limited bandwidth I have. Get a 56k and you won't be so spoiled.. :^)
Makeshifts last the longest.