My "older" kids (7yo and 5yo twins) aren't as much of a problem as the 1yo. They'll usually just bug me for a bit and then play around on my wife's elliptical or rower until they get bored and cause trouble elsewhere in the house. Sometimes they'll even count my reps.
I've come to appreciate the late-night sessions more and more though, no matter how exhausted I may be.