Enderman will either spawn or turn into their aggro skin without actually aggroing them.

I was using my Enderman farm, and noticed that several of them had the aggroed skin and were shaking, like I had aggroed them. I hadn't. They weren't attacking me, but they still looked like they were aggroed.