Farmer Villagers Stopped Farming

I made an a potato farm with farmer villagers to automate it, and they were supposed to throw the potatoes to another villager, for me to collect with hoppers. A simple potato farm. The hoppers work great, and if I give the villagers potatoes they will try to give them to the "hungry" villager.  The problem comes in when it comes time to harvest. 

My farmers won't work. At all. I spent hours trying to get them to work, to no avail. They just walk around, and stare at the walls or gossip with the villager they are supposed to be trading with. I tried giving them potatoes and breaking a plant to see if they would at least re-plant the potato, but they didn't do anything. 

I will provide more pictures if needed. The farms are 9x9 farmland with water and a composter in the center. I spawned them directly into the farm using spawn eggs, so there is no way they have picked up any other seeds, etc. The hoppers do pick up the potatoes before the "hungry" villager does, so its not that. I even "replaced" a farmer to see if that would work, but it didn't. Mob griefing is on, and there are enough beds for all the villagers. I even tried putting up doors even though I'm pretty sure that isn't needed anymore. I turned off DayNightCycle, would that be the case? I also turned off WeatherCycle. (I'm on a server.) And I took off TraderVillagerSpawn, but I doubt that effected the farm at all. The farms are encased with glass, can they see through and are they distracted? 

I ended up harvesting the potatoes myself..

Maybe this is a bug?