How close would they be coming to you?
I'm one to be a little bit cavalier with the transmission risk (a very little bit). Like, I don't think people walking around nearby is a special risk so long as no one is hacking and sneezing everywhere, or being gross about lack of handwashing, or things like that.
So, if people are brushing the back of your chair all day on their way to the kitchen ... then, yeah, move. But if people are passing and staying several feet away from you, no problem.
However, really I would just advise to trust your gut. If you feel better moving, then by all means move. Sounds like floorspace availability is not a problem.