The FIRST thing you need to do is go to your local library and read the following books: Lee MODERN RELOADING 2nd ed (ignore all the BS about the Lee pot metal presses and warranty, both worthless in my experience), LYMAN #49 (new) or #48 (old), DBI METALLIC CARTRIDGE RELOADING 3ed ed. All use Lyman load data, but look at reloading differently. If the library doesn't have them, get them through the interlibrary loan system.
Next, a reloading "kit" generally has enough to get you started, but you will normally need dies, primers, powder, bullets, brass, etc. I do NOT recommend ANY low quality pot metal presses for ANY purpose, although many will tell you they have them and they are fine for THEIR use, which is undoubtly true. I actually USE my equipment and the older I get, the less money I have and the less I can afford junk. Low quality equipment might be cheap to start, but will need to be replaced quickly if used, turns out low quality reloads (I'm sure people will tell you their reloads are fine, and I'm sure for their uses they are, I just prefer my loads be more than "firecrackers" - "if it makes noise I'm happy"), and has no resale value. If a company has a so called "2 year warranty" (which they don't stand behind anyway), and every one else offers a LIFETIME warrany which they DO stand behind, that should be a tip off to you! Quality is remembered long aftter price is forgotten. I have never regretted buying quality!
A GOOD single stage press will last you a life time (I still have the RCBS ROCKCHUCKER I bought nearly 40 years ago) and will still be useful to you no matter what else you buy. I probably would nopt buy a progressive to start, but they can be used for "single stage" reloading if you want. Probably safer and easier to learn that way.
Good luck!