When I first started lifting, I was under 130 lbs and could only bench the bar with 5's on both sides. I'm now 220 lbs and just put up a 320x5x3 squat, 345x5 deadlift, and 215x5x3 bench press--and that's with crappy genetics and little athletic ability (I do, however, play a mean game of chess).
You can do it, with a little determination, grit, and the understanding that sometimes you'll take a step back once in a while. The iron will teach you a lot about yourself, including things you never knew before...enjoy the ride!