Happy ghast slows down my game

When tying happy ghast to a lead, the game periodically slows down when the happy ghasts are being loaded. I moved them away from my base and my game runs faster, I am certain it is the ghasts. Also I have deduced that it IS when tied to a fence because while flying them, the game ran perfectly fine.