shovel getting enchants without being enchanted

when switching from my efficiency 4 diamond pickaxe to my unenchanted diamond shovel, my shovel gets the efficiency enchant for a couple seconds after switching, not like property swapping though because if i dont do anything with the shovel for a couple minutes but its still in my hand the next time i use it it gets efficiency effect but doesnt properly break the block