Issue walking on soul sand

When I'm walking on soul sand and I jump up on a block of it I start getting pushed back and it won't let me walk forward.  I thought it might be a problem with my soul speed boots, but I took them off and it kept happening.