Strange movement in game

This started with the update 2.0 I think. I am not sure if its the controller or the game so I would appreciate a response before I buy a new controller. When climbing a latter I randomly change directions up and down or back away from it all while not touching my controller. I also slowly go backwards while on the ground unless in my inventory. When in my inventory my cursor will randomly go down especially when I am trying to grab something and tends to split stacks of items. Finally I am constantly panning upwards especially while walking.