In short, I had infinite raids and couldn't stop it without changing to peaceful.
What I expected to happen was...:
Not having infinite raids.
What actually happened was...:
Raids kept coming and coming every time I killed a leader during the raid and got Bad Omen.
Steps to Reproduce:
1. Make your own village.
2. Try to populate it by curing villagers.
3. Suddenly your village is valid and now can be raided.
4. Even if the said villager dies and now its only you, raids still happen.
5. After a raid, if you stray just a bit further the raid bar disappears and when you kill the captain you get bad omen and when you get home another raid starts, thus infinite raids.
6. Get killed because you don't have enough resources.
Hey! Mojang commented about this! Check it out MC-153936