Items can't be removed from creative inventory unless using 1-9 keys

Whenever I click an item in the creative mode inventory and move my mouse towards the hotbar, the item I was holding disappears. I am not in touchscreen mode.