hotbar tools swap unexpectedly

While using a tool (like the Pick) the game will unexpectedly change the tool I am using.  Most of the wear on my swords have been from suddenly whacking rocks, while mining.  This happens without any warning, or input from me.