When using a regular bar smartphone or a foldable phone (e.g. Galaxy Fold 5) when closed, it is understandable that VRChat's menus rotate when used.
There is no need to rotate the screen when using a foldable phone in the unfolded state, if possible, as the horizontal length of the screen is sufficient.