Scroll wheel doesn't react until I move it fast (macOS)

If I scroll slowly with my mouse (like I usually do) the game won't react until I scroll fast.

I can scroll slowly for as long as I want but it won't do anything. Scrolling fast works but can't reliably select items in my hotbar.