Personally, I bought gear reasonably quickly (after about 10 dives); a cheap BCD first, followed by good regs and a basic computer.
Prior to that, I had a couple of lousy rental regulator experiences (the clinching one sprayed a fine mist of water with each breath and I coughed for a week)...