Signs can be broken with swords in Adventure mode

If you are in Adventure Mode with a sword, then you can attempt to break signs. The signs won't break though, but they act like they are being broken.