I also found this frustrating, so I’ve proposed a change to iD’s code which allows the PageUp/PageDown/Home/End keys to be used for panning.
However, no one has reviewed those changes in 6 months so I assume it won’t be accepted…