heres my 2 cents...
decide carefully which category you prefer to be in - hardware (networks, infrastructure, etc.) or software (programming.)
If you like building things, then go into basic networking - get certified, whether its MS, Cisco, etc. From there you can choose to specialize or get a ton of other certs (some people say to specialize while others say its more marketable to be a generalist.)
I personally started tinkering with computers like you. I started my IT career with an MCSE (skipped the A+) and have since added many other technical and IT project management credentials. Unfortunately, the larger companies still equate ability with certifications - I dont agree with this mindset but thats the reality!
Initailly, I actually worked to free to gain the experience and feel comfortable resolving problems at different network environments - this worked out nicely, it gave me "hands on" experience AND allowed me to use them as references. As they say, the first IT position is the hardest to get, but once you're in you are in.
Take a cert. that will interest you and one that you can apply the theoretical knowledge to. Don't become "paper" certified because if you cannot answer a real life tech problem in the interview you end up looking the fool.