Using Playerheads decreasing FPS drastically

I got a server with a creative world where i allow players to use custom heads for decoration. 

Normally my PC has no Problem reaching 100fps+ on 4k in minecraft but near many Playerheads the fps drops drastically. As can be seen in the screenshot its down to about 30 fps.

For other players with other setups its even worse,