Currently, avatar particles can hit rigid bodies with particle collisions and make them move, but it's only if the object is synced to them. This occurs when the player was the last one to grab the object or they are the host of the world and no other player has grabbed the object yet.

My suggestion is to make it so that when a player's avatar fires a particle at an object, the object will sync to them like any other interaction would. This would allow for avatars to have a less clunky layer of interaction with worlds.