You cannot move horses after taming them.

I used a spawn egg and made a horse. Then I tried to move and couldn't. I tried again and got the same result. I also tried in survival mode.