Switching to adventure while breaking in survival doesn't stop the breaking animation

If you start breaking a block in survival mode, but then switch to adventure mode, the swinging animation and crack animation is still there, but the border isn't and when it would break without adventure mode it would reset the cracking without breaking the block.