I deleted a single player survival world and and created a new one. The Music from the world I deleted was still playing. It was even playing at the same different music in the new world was playing. This happened to me many times.
Environment
Mac, Java.
Duplicate of MC-35856, if you have not, please use the search function in the future to see if your issue has already been reported.