When I have made a gpx track in Ridewithgps, I drop it in JOSM to fine-tune it.
You dont need to move all points to the other road. Just cut it and remove that unwanted part.
And draw some new points, for a track it does not have to be so accurate anyway, just four new points will do.
For small adjustments this works fine: