Can only close inventory with ESC if inventory bound to TAB

If inventory is bound to TAB button (with no other keys/features bound to TAB) you can open the inventory with the bound key. You can however not close it. Tried binding it to different buttons like the default "E" and also "I", that did work. Changing back to TAB however still didn't work.