Client struggles when attempting to render players

I always enjoy using the latest and greatest versions of Minecraft, but one thing that isn't becoming greater with time is performance, granted this isn't entirely possible with all the new features, but I feel like there could be some sort of optimization done about lag with players and armor stands, especially the former, here's a screenshot showing how much lag is taken up by armor stands and players

there are a rather significant amount of armor stands, so I'm not sure if much can be done about that, but adding 80 players drops the framerate down by half

tldr: real situations on servers like hypixel have frame drops due to extra lag from player models/armor stands

I'm aware the server/my client are modded, but that doesn't affect how armor stands/player models affect fps