Cannot navigate inventory screens with keyboard until after mouse hover

Cannot navigate inventory screens with keyboard until after mouse hover.

How to reproduce:

1. Load a world

2. Open the inventory or any container screen

3. Use the arrow keys to navigate

4. Observe keyboard navigation not working

5. Hover your mouse over any slot

6. Observe keyboard navigation working