Your gaze direction is not dependent upon the wall in front of you, but your tendency to throw your head back as you lift your chest. Make your stance wider. Point your toes out less. Find a point on the ground, or very low on the wall and stare at it. Keep your chin down. Drive your ass up. Start there and let's see if it cleans up some other issues along the way.