As much as i hate what Trump is doing, I don't expect any enlisted man to refuse orders to go somewhere. The legality of that order is debatable, but following it does not cause any immediate harm. It's not a good risk to take.
Refusal to follow orders will come when the order is so clearly illegal that there can be no question, and when following that order is something that can't be undone. An order to fire into the crowd, for example.
Of course, no such order will be given. I assume we have all seen Andor, yes?
Would you be willing to risk ten years in prison that a military judge will agree that an order to go stand somewhere is illegal?