Ghast fireballs not always hitting back despite hitting them about 20 times

I try to hit fireballs back multiple times even moving back and sideways but the fireball doesn't always send back. I can see sharpness particles when i hit them back so it's quite annoying.