i also have had this issue! for me, if i have even 5 villagers in a village my game experiences the same issues as OP stated. block lag, being stuck waiting for a UI (chest, trading, inventory) to open for 30-60 seconds, etc. i dont know what the issue is but at this point i had to move my main storage away from my village area because of these lag issues.
xMeowster
i also have had this issue! for me, if i have even 5 villagers in a village my game experiences the same issues as OP stated. block lag, being stuck waiting for a UI (chest, trading, inventory) to open for 30-60 seconds, etc. i dont know what the issue is but at this point i had to move my main storage away from my village area because of these lag issues.