Villager trade experience changes based on what trade your looking at

When trading with a Fisherman, if the items from the 2nd trade are put in at the first tab, the trade bar visually goes up the same as if the first trade was done. If it is put in at the 2nd tab (the one where it is displayed) then the trade bar visually goes up only half as much.