If you exit a horse (right-click) immediately after jumping that horse in water, the horse will stay in the upright position (bucking/jumping) and stays that way until it changes it's ai mode (example, to eating). You can push the horse out of the water and they stay upright.
Linked issues
Comments 4
This issue duplicates MC-97423?
can confirm this bug