Villagers Linking to the wrong work stations

Villagers are really annoying me lately. A MAJOR issue is that they link to workstations that are far away from them and not the closest one, and also sometimes switch workstations randomly. I have a villager trading hall and breeder somewhat close to each other on my realm and not only have the villagers in my villager breeder began to randomly link to the ones I use for my trading hall, but sometimes when I add a new villager into the trading hall before I trade with it, it will swap workstations with a villager in the breeder. There was a composter in the breeder (to give them jobs so they stop linking to other stations) and a lectern in my trading hall and the farmer in the breeder changed to the lectern for some reason which made the one in the trading hall switch to the composter at the breeder. This eventually made me accidentally break a wrong block in my breeder and now nothing is working and I am too stressed to play anymore survival right now. Please fix this bug as soon as possible I think other people have found similar issues to this one.