Inventory bar resets when opening chest

I will have my inventory bar set the way I like it, but when I open a chest and remove or put things in it, it is all different. I will have things that weren't in the active bar before, and multiple slots of the same item. Very annoying, as I have to reset so I have my tools where I need them, and not a bunch of cobblestone.