Get some tumbling media. For steel, that's aluminum oxide chips. This media lasts about three days past "forever," and will leave a uniform grey matte finish (not a shiny one). I have never seen a steel tank shiny inside, but aluminum will be shiny after being tumbled with the right (ceramic) media. Simple Green is a common household cleaner. You want the kind without added scent, which is called Crystal Simple Green. You can also get Global cleaner from, say, NESS, but Crystal Simple Green is probably less expensive.
If you have a clean tank hydroed, it should take 30-60 minutes to clean it up using the right media. If it's got more rust, you will have to tumble longer. Open it up, pour out the media, look inside, refill, retumble, repeat until cleaned up. After a while you'll get tired of that and just guess high on how long to tumble (some pretty rusty ones I have tumbled for 4-6 hours). After that, there will be lots of dust, rust, and steel particles, and the tank must be rinsed. If if will be used in oxygen service (including partial pressure blending) it must be O2-cleaned. In both cases, a gallon of rust inhibitor will last you a Long Time. If you follow the directions, using it should not allow flash rust to re-form in the time it takes to dry the tank using forced hot air or very dry (that is, breathing) air.
Don't forget to clean and rebuild the valve.
NESS's tumbling page is here:
Tank Cleaning