Problem with the rails and wagon

So, in my adventure world in solo, I placed rails that goes down.

I placed a wagon on it and sat in it but when I tried to go down, I was automatically rejected of it. Tho, if you place the rails on the same level, everything works.