You might be out of luck. Renting kit is not very common, and guided dives is defined by a divemaster on land.
However, depending on where you are:
Oslo: Kits may be rented at Oslofjorden Dykkesenter, FUE.no, Divestore Gylte and ProDykk Svestad. These are all diveshops.
Oslofjorden Dykkesenter usually have divedays on sundays with shorediving and divemaster on land.
FUE.no doesn't do guiding.
Divestore.no Gylte has shorediving at the shop with guide on land, and ribtrips once in a while.
ProDykk Svestad has shorediving.
Drøbak Undervannsklubb does boatdives on Thursdays, Saturdays and Sundays. No guide in the water.
Sandefjord Dykkeklubb does ribtrips
Moss undervannsklubb does ribtrips
A-Dykk in Kristiansand runs divetrips to some of the famous wrecks (They can probably also provide gear)
Mandal Dykkeklubb has an amazing boat with a lift, and superkind members.
Flekkefjord Dykkeklubb does ribtrips
Stavanger Dykkeklubb often does boatdives. Don't know about gear, but Jæren Dykkesenter (if they still live can help you there)
Slettå Dykkeklubb in Haugesund is amazing. Lots of happy people. Lea Dykk kan probably fix gear.
Nemo in Bergen is one of Norways biggest diveshops.
Gulen Dive Resort a bit north of Bergen might be your best bet of where to get guided dives. Fully stocked divecenter with world renowned wrecks. They beat Lembeh in the Nudi-category in the CritterShootout in 2016, and can boast about 70 nudis on the house "reef"
In Ålesund you have Ålesund dykkeklubb. They can support both diving and lodging, but you need to fix gear on your own.
Trondheim has the famous Draugen Dykkeklubb. Very active people. Lots of diving.
In Mo I Rana, abit inland, you'll find Visit Plura. The only place where you can do caves easily in Norway. Ina and Jani have fixed a divecentre, so you can fly in, rent tanks, enjoy the cave and fly out again. Easy Peasy. (And they have amazing chocolate cake.
Bodø sports some of the best diving in Norway. Saltstraumen is famous as the worlds biggest maelstrom. And you can dive there. This is also one of very few places where you may have a proper guide. This is also one of the places where you just don't dive without one! (Wrong time, wrong place... you may die...) Saltstraumen Dykkecamp will take proper care of you.
Further north. On the west tip of Lofoten, in Reine, Runhild Olsen lives in Catogården (AirBnB) She can put you in touch with people who can fix proper diving for you.
Narvik is also worth a visit... however I have no info there.
The complete info about Norwegian dive clubs can be found at
www.ndf.no
Just remember... Norwegian waters are cold. Drysuit is recommended.