When hitting a wall while flying with elytra, the hit appears to be registered multiple times, resulting in multiple damage events. This can lead to the fall damage sound effect being played repeatedly. More importantly, it also means that at high velocity, totems don't protect from this kind of death.
Did you use firework rockets to increase your speed?