I believe all top end work sets should be done as heavy as possible with a belt. And yes, I believe that doing heavy belted work increases your "non-belted" strength.
I usually do all my Squat warm ups up to 405 without a belt. From 455 on up I wear a belt for warm ups or work sets.