Funny thing is, if one looks at it as an unauthorized marking then the tank should be condemned since only the tank manufacturer and hydro shop are authorized to put markings on a tank. However, if you think of it as a scratch, it is probably legal since it (if really as trival as you describe it) isn't deep enough to condemn the tank since the limit for tank gouges is .020 to .030 (depending on material and manufacturer). If it is really as trivial as you say, it should be possible to polish it out using a not-to-aggressive abrasive, or just cover it up with a sticker. But if it is deeper, that could be dangerous!
I sure wouldn't take a grinder of similar power tool to it, because then you will be removing significant amount of metal, to say nothing of leaving a wavy surface that will be a dead giveaway that it was done.
Note that getting a dive shop's opinion will not be a totally satisfactory solution, as every dive shop it is ever taken to for a fill for the rest of its life will have its own opinion, some may fill it and others some won't, - and some will try to condemn it on the spot!