Agree the drive from Cabo to La Paz is a good trek and wouldn't (and didn't) do it more than once for the experience - and we were there for 2 weeks.
One interesting side trip we took on our way back from La Paz to Cabo was to stop in Todo Santo and grab a beer at the bar of the Hotel California™.