I thought about the fact that it seems like avatars are still loaded in when you are not looking at them.

This seems useless to me and very easy to change, because avatars that are too far away are unloaded in VRChat already and when you are not looking at them seems like a good moment to hide them too.

So I would really like this to become a feature so we all can save performance that way as well.