Random dirt blocks

After backing up a world, I found that a build that I had made was littered with dirt blocks that were not their before. No matter how many I destroy or replace, the keep coming back and more seem to spawn. I should also mention that I destroyed a small hill where my build now lies.