It took a while to get my bp/w setup to what I consider optimal, but once it was right, it was right.
In terms of the way it felt, it felt exactly the same as my women's (ex. essentially back-inflate) BCD that I had for many years previously. Everything is in the same place. It is comfortable even with just a swimsuit. I initially had padding on the bp, but I took it off except the thin back pad.
If it's hard to get into or out of, it is way too tight and not adjusted properly for you. It should just fit comfortably, not be too tight.
I have 2 XS Scuba weight pockets on each tank cam band, so 4 all-together that hold up to 4 lbs comfortably each. I have a 1.8 lb AL bp. You could have a steel bp which is usually 5 or 6 lbs if you think you need more ballast. I prefer AL because it's perfect for travelling with and I don't use much weight here either with my HP steel tank (4 lbs total).
I also like storage space. I have 2 OMS compact (weight) pockets as well as EMT shears in a sheath that slide onto my waist belt webbing. One side is held on by the waist buckle and 1 pocket is held on by a weight holder clip. I can fit the stuff that I want to take on the dive like an dSMB and spool, and wetnotes, etc., but there are other bigger pockets if you want them.
So there you have it. For me personally, there aren't any negatives. If you're used to carrying stuff and don't have drysuit pockets, it takes a little creativity. But remember, a bp/w is intended to be a minimalist approach. You take only what you think you might need.
It would probably be helpful if you're able to try out a bp/w before you buy so you can confirm what it feels like to you. Some stores might let you try one that they have or maybe someone in your local community will. Good luck and have fun with your gear-itis!