AngryAt NBT tag doesn't work for endermen

When I run /data modify entity @e[type=enderman,limit=1,sort=nearest] AngryAt set from entity @s UUID, the enderman doesn't aggro on me. Even if I am on survival mode, and even after modifying the AngerTime tag to a big number. And on top of that, when I summon a new enderman using F3+I with the exact same data as an enderman that is aggressive, the enderman still spawns as neutral. I can read the AngryAt tag, but modifying it seems impossible.