Horses cannot be renamed with the Name Tag - they only go on their hind legs and ignore it.

MC-14525 name tag item doesn't work on entities with right click ability Resolved