Great question! No experience, but don't let that prevent me from commenting! My bottom line is I doubt it is a problem if you are conservative, but let's see what others say. Some points of reference. At sea level air pressure is 14.7 psi and at 2500 ft it is 13.2 psi. The no-fly rules are based on the assumption that a commercial airliner is pressurized to 8000 ft or 10.4 psi. By doing your plan, the pressure differencefrom sea level is equivalent to about a 3.4 ft change in depth and the airplane is like 9.7 ft. After repetetive dives DAN suggests 18 hours of no fly.
So I guess if it were me, I would dive conservatively and take my time getting back up to 2500 feet. In any event, you are probably driving up (and not flying) so it will be gradual and not nearly as sudden as taking off in an airplane, meaning the off-gassing dynamics will be more gradual and I would think less worrisome.
Let's see if others accuse me of being reckless or trying to kill you, which I assure you I am not!