Another thread from the backlog. Never let it be said that I didn't care.
A low bar squat is not done with a vertical back. You are trying to keep your chest vertical through overextension of the lumbar spine. Embrace the forward lean. Widen your stance, keep your spine more neutral, lean over, and be balanced. All will be well. This will help to get you proper depth, too.