Removing obsidian/portal block from a lit portal crashes the game

I had two portals right next to each other (connected) to see it rendered the portal blocks. Then I removed a block of obsidian and the game crashed.

Edit: It crashes if you break one the portal blocks, too.