Vexes keep spawning even while far away from Evoker

While raiding the Woodland Mansion on hardcore mode, Vexes keep spawning from Evokers. After retreating a good 30+ blocks outside the mansion and shooting the existing Vexes, more keep spawning from the mansion and flying to the player, despite the player not being near enough to an Evoker to trigger their summoning spell.