I can also confirm Kilian's comment. The client's view distance must be higher than the server's.
Having a view_distance of 16 on the server, the client kept having a lot of problems loading chunks (with a view distance of 16). Changing the view distance to 17 and relogging completely solved the issue.
Very curious behavior. If you are reading this because you have this problem, this is a very good fix.
Still happens in 19w11a.