So I'm not exactly sure what is causing this but it can be reliably recreated by following these steps:
switch to creative mode
spawn a horse using a spawn egg
give the horse hay or apples to speed up the taming process
click to ride the horse
It seems to never tame. After a few minutes it did buck me off though.
Note, I did have my world open to lan at the time but I do not see why that would make a difference. It also seems to be fixed by switching to survival and back to creative again
You need to have an empty hand to tame a horse, did you have an empty hand?