Villagers unable to choose one meeting spot by a bell

I have a village and the villagers don't meet by the bell, but rather talk to each other in their houses. Villagers just seem to have trouble locating bells.

Image:

red circle= group 1

orange circle= group 2

cyan circle= group 3

black circle= bell

As seen the villagers are just talking amongst each other, or even some not talking to anyone since they cant find them (like the red circle guy). This bug ruins the aesthetics of villages and also causes them to get lost sometimes.