Raid starts but horn isn't called and pillagers wont spawn

So basically I killed a pillager captain and he gave me the bad omen affect, everything is good so far. But when I got into a village it did say a raid was about to happen but no horn (The raid bar is full at this point as well) no pillagers or anything spawn no horn either. I wait a day or two Minecraft days, nothing happens. I exit Minecraft, still, nothing happens. I don't have any clue to where the pillagers are or how I could fix this without cheating. Maybe just maybe they are hiding in a cave, I don't hear them or see them when I ring the bell. I checked close to ground caves and found nothing there so that sucks. Please help me I have no idea whats happening or how I can fix this but the one thing I do know is that my village project is at a halt considering the villagers are staying in their homes for eternity because of the "raid".

EDIT: Apparently unloading the village chunks and switching to peaceful for a second and going back to normal take away the "raid" Also I used a diamond enchanted sword with Fire Aspect II to kill the captain