If inventory is set to TAB pressing TAB doesnt close inventory

When I open my inventory with TAB it opens normally, if I press TAB to close it it will just highlight the little crafting recipe book in the GUI.

Suspecting it has something to do with the new accessibility controls since it wasn't present in older versions.