Dan,
Not sure if you are refering mostly to component prices or press/die prices, but there are some good deals to be found.
Check out the Lee kits for maximum value. They work fine, though you obviously won't produce ammo as quickly as you would with, say, a Dillon 1050.
A low-priced starter kit that a lot of folks have gone with is the Lee Anniversary Kit:
http://www.cabelas.com/cabelas/en/templates/links/link.jsp;jsessionid=OX2UFCT0YRT1PLAQBBKCCN3MCAEFKIWE?id=0003080216577a&type=product&cmCat=froogle&cm_ven=data_feed&cm_cat=froogle&cm_pla=0370101&cm_ite=0003080216577a&_requestid=130207
I personally use the Lee Classic Turret Press, which allows me to load a good bit faster (but not as fast as a full-on progressive press). The thing I love most about the turret press is that I can accomplish a complete caliber change in about ten seconds!
Here's a link to the Classic Turret Press kit:
http://www.cabelas.com/cabelas/en/templates/product/standard-item.jsp?_DARGS=/cabelas/en/common/catalog/item-link.jsp_A&_DAV=froogle-cat20847&id=0044122216337a&navCount=1&podId=0044122&parentId=cat20847&masterpathid=&navAction=push&catalogCode=XJ&rid=&parentType=index&indexId=cat601233&hasJS=true
As far as component prices are concerned, consider your savings when compared with a comparable purchase of factory ammo!
My most recent box of .45 GAP ammunition was loaded with Speer 230 grain TMJ bullets, which I bought in a box of 100 from a local retailer (ie: not the best priced bullet choice out there).
To load a 50 round box of this retail-priced handloaded ammo would cost me about $12.23, whereas an equivalent box of factory loaded ammo would take me to about $26 per box of 50. That's a savings of $13.77 per box! Plus, my handloads always seem to out perform the similar factory loads!
Of course, that is talking in terms of small scale purchases there. If we were to buy loaded ammo or components in bulk we'd obviously save money. As such, I also looked at the price of bulk purchases:
Winchester white box in .45 GAP will run you $502/1,000rds through Midway right now. Remington UMC ammo would run you $452/1,000 rds.
If I purchased the components that were required to load that much ammo, and did so in bulk, I could produce 1,000 rounds for about $159.
That's a savings of $343 or $293 per case, respectively. You can pay off your reloading equipment fairly quickly that way!
