I'm probably being overcautious. I'm doing the rescue diver course at the moment and it's improving my skills set and confidence heaps. Actually, the guides I dive with often give me more slack than others whom they haven't dived with. Since I've been diving with the local divepoint folks for 9 months now (including a whole bunch of specialty courses) I guess they have more confidence in my diving skills than I might have. I just feel humbled among experienced divers and there's plenty of those here on SB too.
Though I'll admit that at the familiar dive sites I sometimes feel like doing a buddy or solo dive just to see how I'll manage. Maybe once I reach 100 dives I'll discuss it with the divepoint guys.
I recognize this in alot of beginning divers... specially women. This is not to be sexist, just that women tend to be more cerebral about diving, think things through more, let ego play a much smaller role.
But is certain situations, like diving on your own with a buddy, you need to take a small leap of faith, be aware of your own limits of course but don't let them grow out of proportion. I'm sure since you dive locally and have done more then 50 dives you know some local dive-sites at which you've dived before. So you already know a bit about the local circumstances that affect that specific site (be it below or above the water). I suggest you just take an experienced buddy with you (not a DM) for the first couple of dives where you lead the dive. Make your buddy aware that you'll be the lead, but that he can intervene if something goes astray.
Most feel a bit overwhelmed in the beginning because it's alot to focus on: Safety, diveplan, underwater navigation, current, entry and exit, your dive-team (buddy), and others... and you might feel why the hassle, if I follow instead of lead the dive I only need to focus on my buddy (DM) who leads the dive instead of all the above stuff. However if you do a couple of those dives at that same location you'll start to notice that all the above points will become easier and will require less focus. It's a bit like learning to shift-drive a car... in the beginning you're focussing alot on the actual process of shifting a gear, after a while it's second nature and you don't think that much about it.
Trust me by doing this you'll become a much better diver... because you'll evaluate every dive in a different way, not as a "follow the DM" which is easy, but as a "dive-leader". After a while it's so 2nd nature that no matter if you are leading a dive or just following your buddy or a group with a DM, you'll still be attentive on all this ("have we already passed that underwater pinnacle that was shown during dive-briefing", "is the current NW as stated in briefing by DM or has it changed?", "this guy seems to lag behind let's keep him in view", "looking at the bubbles this diver seems stressed, let's see what's bothering him", "after the dive ended... is everbody back on the boat?")... So even if you're just following a guide or DM, you can take charge of your own dive at any moment because it's 2nd nature.
Diving is practice... not just on the first levels (beginning to dive and focussing on myself) but also after some experience... you just need to take the next step, you are ready.