I also am having this problem. Very irritating. Also see: https://bugs.mojang.com/browse/MC-52752
Ugh. I have this issue as well. Additionally, when my wife joined in on my LAN game her character's inventory wasn't the same anymore. This is frustrating.
@Zachary: According to the ticket information this bug is currently unassigned. As far as I know, that means nobody is actively working on the bug.
I wouldn't be surprised if none of the developers have even seen this bug.