Every Resource pack reload causes more and more lag leading to a crash.

Every time I enable/disable or F3+T a resource pack the game slowly gets worse until the game stops. This happens in both singleplayer and multiplayer servers.