The same problem occurs for me when josm slows and I apply too much zoom out. Luckily I discovered that the short cut ‘8’ goes to the previous view.
