The difference between the AL and SS plate is 5 lbs.
My opinion is that you'll need more than 5 lbs anyway, and the extra will be used as ditchable. I actually bought an AL plate for the reason you state, and have never used it! I like to take the extra weight off my belt and put it on my back. The trim for me is perfect horizontal (I wish I could look that good diving doubles and a drysuit!!!). I dive a shorty wetsuit and either use 6 lb in a keel weight, or on a weight belt. The keel weight is not ditchable, but I can easily swim up this rig with no problem at all. I also use a cannister light which I could ditch if I had to.
One of these days I'll sell the AL plate........