To answer the question: given that you’ve established that offset is a) real, b) can be corrected. There is no reason to not correct the positions of the objects, outside of it potentially being a lot of work.