Can't close inventory when key is bound to tab

I use tab to open and close my inventory instead of E. I can use tab to open my inventory just fine but have to use escape instead of tab to close it