How one "feels" is an exceedingly poor indicator of personal performance. You may "feel" just fine at whatever depth, but what matters is performance.
Back to our favorite narcosis analogy, drunk driving. The drunk person says things like "I'm fine, I've only had a few drinks! I feel fine to drive"...into a pole. Let's go ahead and dismiss "feeling" as a method of judging how narc'd one is.
Typically, with routine tasks that one performs regularly, there won't be too much loss in performance. Where it gets tricky is when a new situation is presented to you (some sort of emergency or problem underwater). Why stack the odds against you when a better alternative is available?
People have has real close calls and even lost their lives over this stuff. Its a foot on the banana peel that just isn't needed.