Inventory key doesn't close inventory when set to tab

When inventory is set to e, the inventory will open and close when the key is pressed.

However, when tab is set to open/close inventory, it will open inventory, but won't close it.

This affects the inventory, crafting table, furnace, shulker box, ender chest, chest, minecart in chest, etc as well as the villager interface.

When pressing tab in any of the blocks + the survival inventory that have the crafting book, it highlights blue.

This is probably due to the ability to press tab to change trades with villagers.