arm wiggles in MP when hand is empty and other player hits an entity or breaks a block

On multiplayer server, when another player hits an entity (tested with mobs & item frames) or breaks a block, it causes my hand to wiggle (only if hand is empty).
Also happens if the other player interacts with some blocks (tested with wooden door), presumably any interaction where the other player's hand moves.