I'm also having this problem, also villagers that I had before 1.16 that were around level 3 upon reaching level 4 it would just reset to level 3 then be fine and now my villagers wont reset and breaking their work stations does nothing they never try to connect to them
Unfortunately I dont know how to upload a screenshot from my ps4 to here so I took a photo with my phone I freed the golem by removing the bush. But sorry if the quality is too bad
Happening to me as well in digital version