Happens for me as well, I'm on Xbox One, version 1.5.3
Was experiencing this issue before and 1.5.3 has fixed it for me, thanks!
I have been affected by this bug as well, I had a legacy 360 edition world that I converted to the edition version of Xbox One and then converted to bedrock so my world's pretty old, hopefully this gets fixed soon...
Also happens sometimes after you exit the inventory
Happens to me as well on 1.6.1