Illager Patrols attacking users in spectator mode

When I went into spectator mode, the illiger patrol following me did not lose agro

How to repeat: get illiger patrol to follow you than go into spectator mode