4 inventory slots inaccessible unless in chests

Whenever I try to select something from my four top and rightmost inventory slots, it will not let me select what is there. It only lets me select what is there if I am in a chest.