There's no exact point. Once you have required decompression stops, it's much more dangerous to skip stops, but it's possible to do so without getting DCS, but your chances of serious injury or death increase with the more decompression obligation you skip.
Walter nailed it. There is no black and white line about decompression obligations. In fact, if you compare the output from a variety of decompression algorithms, they can vary quite a bit (as much as 10 minutes, if I recall correctly, at some depths) in what they consider the "No deco" time to be. You are not "safe" for ten minutes at 120 feet, and "unsafe" beyond that. Instead, there is a gradual increase in the likelihood of symptomatic DCS as you exceed your no-deco time. That risk can be controlled by controlling the ascent (making stops, as Walter describes). Although we use the word "stop" for this, in fact, swimming gently along at 20 feet is a 20 foot "stop". (For example, in cave diving, the profile of the cave will often give us a "stop" at a given depth, although we are progressing toward the exit throughout the time.)
At some point, the amount of nitrogen you have absorbed makes it essentially certain that, if you ascend without stopping, you will end up with symptoms. No one can put a finger on exactly what the combination of depth and time is that will get you there.
The best practice is not to push your no-deco limits, and to do some kind of "stops" to control your ascent rate. But in a lot of dives (as with the one I did yesterday) you can continue to swim and enjoy the terrain and the critters as you come up. Much better than hanging in blue water, in my opinion!