In broad strokes, I agree with the sentiments in this thread: you should incrementally gain experience with deeper depths, a little bit at a time, as you are ready for it. Deeper depths have much more serious concerns with respect to gas consumption and deco limits. And different people define limits differently -- make sure you are complying with local laws, and don't lie to your dive operator.
One thing I have not seen mentioned in this thread yet is cold water exposure.
@Wheeler925, are you diving in a wetsuit or a drysuit? If you are diving in a wetsuit, please understand that deeper depths will feel much colder than shallower depths. In some locations there will be a temperature gradient, where the ambient temp is colder at depth. And in all cases, neoprene wetsuits compress as you go deep, and as they compress they keep you warm less effectively. So you may find yourself feeling much colder at, say, 80 feet than at 50 feet.
If you are using a drysuit, then you don't have this problem, because you can compensate for the increased pressure by squirting more air into your suit. For me, I find that 55F is OK for an 8mm wetsuit with a hood, if I stay relatively shallow (say under 60 feet). But deeper than 60 feet, or 50F and below is drysuit territory for me. YMMV on the exact temperate range, but my point is that deeper divers are colder, plan accordingly.
Cheers