When right clicing on a horse with something that cannot be used on it, the horse reacts accordingly, but a hand animation still plays when doing so. In line with MC-162036, this should be considerd an unsuccessful interaction and no hand animation should play.
Right clicking upsets them if you don't use an item they want, so it is intentional that the arm swings, since the action is still taking place