The issue seems to be resolved by now.
This issue occurs for me almost instantly when I enter a world.
Edit: setting "gfx_vsync" from 1 to 0 causes this issue to appear less frequently
I also have issues with V-Sync. With the latest update (1.16.220) and latest nVidia drivers (465.89), my FPS was tanked. I lost approx. 10FPS which is about 10-20% loss. I had to disable the in-game V-Sync in options.txt to fix it.
The issue seems to be fixed for me with the latest 1.19.70.20 Preview update.
Specs: RTX 3070 with 528.24 driver