Saturation goes down without doing anything

As said in the title, when I go afk sometimes (not always tho) the hunger bar will start to go down after a while. This is because my saturation goes down for no reason at all, since I'm not doing anything whatsoever. I'm not moving, not being pushed, not trying to break anything, and I always start with a full bar after eating golden carrots.