Skeletons jockeys dissapearing after their spider is killed

Faced three spider jockeys in my survival world today. Each time after if would kill the spider, the skeleton would disappear and keep shooting me.