Takes multiple tries to break every block

I have tested this on multiple worlds and I can't break blocks on the first try. It usually takes 4 or 7 tries to get them to break. I am not sure if anyone else is having this problem.