If you open your inventory you can normally hover over an item and then press "Q", you drop it. The Problem is, this only works If you set your drop-key to "Q". If you set your drop-key to something different than "Q" hovering over an item in your inventory with your mouse and pressing this button doesn't drop the item.
Related issues
Comments

I have it set to Tab and use Windows 10.
I have my drop key set to G and am able to drop items from the inventory. What did you set your drop key to? What OS do you use?