Hovering over Upper right Craft inventory makes the game sluggish

Whenever I try to pick or drop an item in the upper right corner of the player inventory while using a craft table or similar, the game becomes so sluggish that I just can't use that slot.