When I join a world and press the button to return to my home world before it finishes downloading, avatars are not loading any more. Even changing avatars doesn't work.

Rejoining the instance or restarting VRChat fixes it.

I also recorded a video of it.