FPS drops and game is choppy when I look around, unless I hold down the right mouse button

I just got Java edition and whenever I look around my FPS drops under 30 unless I hold down right-click.