Specifically, it seems like in some villages, all the villagers therein act identically; they all target the same house, they all try to go inside there at the same time, etc. They all have only one mind. New villagers who are born and grow up act autonomously, but all of the original villagers spawned by the game behave very strangely. If I destroy their one door, they will then immediately all target another door. All they do is crowd around it, opening and closing it, pushing each other out of the way, while the new villagers behave normally. In one village, after I destroyed all the doors, I tried pushing a villager around. When he fell into a cave, all 13 of the other villagers suddenly stampeded to the same location.
Breaking down the door of the building they are all crowding into causes them all to immediately target a different building, but they all target it together, almost like all the villagers are just one mind.