Having to swipe a lot after tapping the buttons before the crosshair actually moves on hand held devices

I have to swipe a lot after tapping on the interaction buttons before the crosshair actually starts moving. Touch controls have become very hard to control since if I want mine a block in front of me but I’m looking at (pointing the crosshair at) my feet and I tap on the attack button and try to swipe up to break the block, if i have a tool that break the block faster, it might break the block below me by the time the crosshair actually starts moving. This happened to me 2 times already and i died falling from a high place since it broke the block under me.