can't direct horses while riding

I can mount a tamed horse but cannot direct movement while riding. Tried it with a donkey, mule, and skeleton horse as well but no luck.