Although the topic has changed a bit, Spencer, I think if you want to go to school, you should go for it. 24 is not old at all and there are financing options, financial aid, scholarships, etc. that you can tap into to help out with costs. Go to night school or online or see if there is some flex time at your work. If you stick with it, at age 28-29, you won't be that far behind.
Truth be told, with everyone and their dog having a bachelor's degree, the bachelor's degree is the new high school diploma. Most people of our generation are figuring this out the hard way. The master's degree will be the new bachelor's degree and so on. Long story short, most of us are going to have to deal with continuing our education in order to remain competitive. Personally, I'm getting an MBA and then starting up an MS. So don't really feel too bad about being in your late 20s and still going to school as many of us will be. Hell, I wouldn't be too shocked if I have another decade or so of education ahead of me throughout my working years and I already have an engineering degree.
Just a thought. I don't think you should let your age hold you back and even if you are a filthy poor, you still have payment options. I think you should explore it if you want to leave, as opposed to just settling. Good luck.