Button lag

Whenever I'm in a world, no matter if it's private or a server, whenever I press button 1 or 2 on the mouse, the game tends to either lag out the movement for the camera or the player, or freezes the whole game.