I dive in poor vis and it's all right. I prefer good vis, but to me, anything over 20' is good vis. ;)
I've dived in like 6 inch vis, and though it doesn't scare me, there isn't a lot of point to it. I don't get clausterphobic unless I can't move my limbs or if my neck is compressed, so no...