Microscope users: do your eye orbits not get sore after working?

Since unlike loupes, there is nothing to keep your eyes at a set distance, I would imagine there’s bumping around a lot?

I don’t understand the question to try answering it. What do you mean by there is nothing keeping your eyes at a set distance? Microscope eyepieces are adjustable like binoculars.