Arm swings when right-clicking armor stand/item frame

Even when the hand is empty, it will swing when interacting with an armor stand or item frame.
Probably it should only swing when adding an item (or rotating the item in the frame).