Music isn't muting fully

Music isn't fully muted when you turn it off in the options menu. It continues playing very faintly in the background. Loud enough where you can still hear it though. Although when you start the game with the music volume off, it's fully muted.