[MC-168904] FPS is drops unless i hold down a mouse button

I can get 200 FPS when I hold down a mouse button, but the second I let go my FPS drops under 30.

Environment

CPU

Intel Core i5-9400F 6-Core 2.9 GHz

Graphics

NVIDIA GeForce GTX 1660 Ti - MSI VENTUS XS 6G

RAM

Team T-FORCE Vulcan Z 16GB (2 x 8GB) 3000MHz

Do you use any overlays, such as the Discord overlay or NVIDIA experience? Does disabling the overlay solve the issue?

I use NVIDIA and discord overlay and disabling help a little, but the FPS still drops whenever a new chunk loads.