the bar doesn't rest on your lats, it rests on your shoulders
you will have to keep somewhat of a forward lean, even when standing up, to keep the bar from wanting to slide down
but yea, i always hated that feeling of the bar wanting to slide down my back