I see there are previous reports of similar issues. I have a bit of a more unique situation that came up while working on a new follower prefab.

I want my follower to NOT scale with me when I scale. As such, I added a world scale constraint on the object above the follower. I then independently scale the follower inside of this object.

The follower requires many parent and position constraints to make it work correctly.

I found that even though I'm blocking avatar scale with a world scale constraint, the position offsets within parent constraints would still be scaled.

In my case, this means that as I scaled larger, the follower would get further and further away from the intended location.

I compensated for this by having an offset object inside of my constraint target and constraining to that, so there were no constraint based offsets... but this is not an ideal solution.