Join a new instance with a non-1.0 scale, and existing players will see your avatar in a state as if your ScaleFactor was 1.0.
Adjusting your scale at any time resolves the issue for existing peers, and seems to immediately resync the parameter to the other players, but future late joiners will still see your avatar as if ScaleFactor was 1.0.