You can, but it's generally not necessary. If you get a fill from a compressor that's actually on a boat or a third world country, you may want to re-clean your tank. Otherwise, there's no good reason to worry about it.If the fill station is using banked EAN32 and also has air filtered as such:
"All air is Grade E Oxygen Compatible. This means you can fill up your Oxygen Clean Tank with air without worry of contamination!"
Can I use a hang tag or something to label it rather than Nitrox stickers if I want to go back and forth between the two?
If you REALLY want to do things "right" with regards to cleaning then you need to clean/inspect after every single fill. If you're not going to go that far then it's no longer a matter of keeping the tank clean but a matter of managing yours (or your fill operator's) anxiety. Really.
If the fill station you're normally using is filling with pre-mixed (banked) nitrox then you don't need oxygen clean tanks at all. That is only really needed if the shop is partial pressure blending inside your tank. That's because when PP blending, they start by putting some amount of 100% o2 into it. If the tank never sees oxygen levels above 40% then that's that.