Provided your body shape doesn't prevent it, you can always where the weightbelt over the harness.
It may or may not be comfortable - my wife, for example, is very short and find the plate and the weightbelt interfere with each other. A "short" plate (e.g. DSS) may help, though it was easier...