I also feel on several occasions that tile loading is slow. I see this a lot in JOSM, where the display of tiles in the download box all of a sudden does not work anymore. If I then switch to a different tileset (e.g. cycling) then I get tiles immediately. Then switch back to the openstreetmap (mapnik) layer and no tiles, not even after waiting a minute or more.