Wow, a similar thing happened to me in one of my first jobs as a junior. We moved office and could choose our seats. Because I hate having people behind me (mentioned above) I chose a seat with my back to the wall.

The managers clicked on to what had happened on the first day and moved me. Infuriating! I am much more confident now but I just accepted it at that time.