I have the same issue, I'm playing on normal difficulty, Java 1.20.4 I open my game, a track plays and right when it ends the same exact track plays over and over again endlessly no matter what i do in game. Only by going to the nether does it stop, but once I go back to the overworld and another track is ramdomly triggered, that one will then loop endlessly.
After some testing it seems like this bug is only reproducible in forge version 49.0.19. So it's a forge bug not a vanilla minecraft bug for me.