Hey QuinceTree,
From your description, it does sound nervy. The good news is, as you noted, most of the time these issues go away on there own. If you can find a way to press with the bands or do a pushup, that doesn't cause the symptoms, stick with that variation as the primary pushing exercise for a week or two. Which fingers do you feel the numbness and tingling in?