I'm going to take a bit of a different approach (I hope). Rather than answer the question posed in the title, I'm going to assert that it's unanswerable based on the information provided. We're all different. We all have different attitudes (as evidenced by the responses so far), aptitudes, and skill levels coming out of OW.
There was, however, a lot of missing information ... including your ability to guesstimate whether or not you were even carrying an adequate air supply to complete the dive as planned. Had anything gone wrong, all bets would be off as to how well you would have coped with the situation.
The potential problem with a dive like this is often less about what's lacking in your training, experience, or skill set than it is about what's going on inside your head. For a great many new divers the initial instinct is to head for the surface ... to resolve whatever difficulty arises once you get there. This is a lot less problematic on a shallower dive than it would be at 100+ feet. Regardless of how ideal the conditions were you still have to deal with pressure changes and what it would do to your body if you encountered something that resulted in a quick trip to the surface. Much of the reason why educators want their students to take it easy on depth increases is due to the fact that we all have a need to "rewire" our brains to respond in ways that are appropriate to the depth ... and a 100+ foot dive requires a bit more thought and circumspection than one that only takes us half that deep ... both out of concerns for pressure differentials and due to the amount of time it would take you to reach the surface in an emergency.
To sum up the concern in simple terms ... how well would you handle something unexpected like getting your mask kicked off, regulator freeflow, or accidentally inhaling a bit of water that momentarily interrupted your breathing pattern? None of those are particularly difficult problems for someone who's experienced them, or practiced how to respond to them ... they're no big whoop, really. But it's an unknown ... something that makes you believe the problem's bigger than it really is ... that can bite you.
That's all just to give you something to think about ... I'm not gonna tell you it was a right or wrong decision to go, only you can answer that question. My answer would be that as long as nothing went wrong, you're fine. If something did go wrong ... or simply unexpected ... ask yourself how would you have dealt with it? And keep in mind that there's a big difference between thinking about the problem from the safety of your keyboard and dealing with it on a spur of the moment 100+ feet below the surface. Chew on it for a while, and make your own decisions ... diving's all about personal responsibility, and in the end we all need to reach our own conclusions about what level of risk management's right for us.
Some years back I posted an article on my website for folks with similar questions of "should I stay or should I go" ... perhaps you'll find something in there that will help you find the answers you're looking for ...
NWGratefulDiver.com
... Bob (Grateful Diver)