Sometimes takes 2 button presses to place a item back in the inventory

Summary:
Sometimes it takes 2 button presses to place a item back in the inventory in Creative and Survival using the controller cursor or keyboard and mouse.

Steps to reproduce:
1.Empty inventory
2.Use a controller (wired xbox one controller is used) or Keyboard and Mouse
3.Place a item (diamond sword for example) in one of the inventory slots
4.Drag the cursor over the screen to another slot
5.Drag the cursor back to the slot with the sword
6.Pickup and drop the item in the slot

Observed behavior:
It takes 1 button press to take the item out of the slot and 2 button presses to put the item back in the slot.

Expected behavior:
It takes 1 button press to take the item out of the slot and 1 button press to put the item back in the slot.

Video attached:

(Watch the green selection to see button presses)