Minecraft unable to change speakers

When I open up Minecraft and while using the speaker in-game, I switch onto my headset with a USB jack, and everything else switches the speakers to the headset, except the game itself, the game stays with the speaker that everyone can hear. I need to restart Minecraft every time.