Other players get disconnected and can't reconnect after I join from same PC as server.

I'm not 100% sure this is the server and not my PC/network but figured I'd post here in case anyone else has had a similar issue or any idea how to resolve this.

I keep a Bedrock Dedicated Server running on my PC all day, my friends can be connected for 3+ hours with no issues, and I play from my phone for extended periods while not home. Whenever I connect with my client on the same PC as the BDS my friends get disconnected and can not rejoin until I restart the server (my phone can also not connect in this case).

I've got port forwarding set up through my router to the static IP I have set for the PC. I've also tried using the CheckNetIsolation.exe LoopbackExempt command provided in the how to document. This happens when I try to connect through either the local IP or public IP.