I can only tell from my personal experience. I go to our local pool (olympic size, with 2 and 4 meters depth at one end) once or twice a week, with minimal scuba gear. That means a 2mm shortie, boots, fins, wing+harness and one 4 liter sidemounted cylinder, it is enough for 30 mins practice. I also use an ocean reef ffm, not a standard 2nd stage.
At the beginning, the pool administrator was a bit concerned from 2 reasons, one being that severals years ago, another diver, in the same pool, got in an OOA situation and remained on the bottom without regulator in mouth. Lifeguard noticed a bit too late this, got him out from the water with some serious effort and made cpr. The diver recovered eventually. How did he got in OOA in a 4 m pool, don't ask, it's beyond me. I don't know who he was, what level of training he had (if any), what equipment, etc. The second reason is with the lifeguard. They are not trained to rescue divers with heavy cilinders, operate their equipment (bcd inflator) nor trained to recongize when a diver is in difficulty. For examples, I sometime do some slow breathing exercise underwater, I stay completely still and exhale maybe once or twice a minute. I may look pretty much dead for some people. Anyway, after a conversation with the administrator, they allowed me to do my thing.
Some other issues to which I personally like to pay attention are in relation with other swimmers from the pool. This is because I like to minimise the chances to disturb them, I am after all an unusual intruder in the pool.
-at 2 meters I swim always between lanes, the water is pretty shallow, and some swimmers may hit me. I am not concerned about me being hitted, I am concerned about my metal cylinder causing serious pain to others. This is why I use a small cylinder sidemounted, but for some others, the cylinder may be big and back mounted.
-I stay well away from lanes with childrens. Some of them may be scared of me and some may be distracted by me. That FFM tend to make me some sort of Darth Vader freak.. Swimming instructors told me that, otherwise I would not realised it.
-I also stay away from people with mental disabilities, if I see them. This actually happened to me, one such swimmer told me that I scared the heck out of him. I tried to calm him down but in the water you never know how he would react...