Pillagers lose their AI when giving them a sword when spawning them with a command block

When spawning a Pillager with a sword using commands or a command block, they seem to lose their AI but not completely. They can still wander around, but they don't really react to anything. They also don't target players, villagers, but normal Pillagers with crossbows do just fine.

Video link demonstrating this: https://www.youtube.com/watch?v=i5nUvE67ql0

I found this bug making an adventure map and I wanted to use some Pillager swordsmen as one of the enemies, but then I discovered the bug. I also thought, huh since skeletons with swords work, why don't pillagers with swords work? They equip it and everything it's just the AI is kinda weird.

Command I used: /summon pillager ~ ~1 ~ {HandItems:[{id:"minecraft:iron_sword",Count:1b},{}]}