There's plenty of wreck diving out of Va Beach. There's two charters there that are each affiliated with their owning shop(Miss Lindsey to the Lynnhaven Dive Center and the other to Lynnhaven Dive Quarters).
The wrecks are mostly rubble piles, but there's some decent spearfishing and a few intact wrecks. The popular sites are the Tower/Tug/artificial reef(40-60') that's 12 miles out and the SS Morgan at 90' (I think 26 miles out). Va Beach is a pretty good drive from DC. I live in Quantico(1 hour SW of DC right on 95) and it takes up to 6 hours to get there during the summer due to the 4-6 mile traffic backup on the 64 bridge tunnel. There is another way in, though

and it should only take 3 hours from Quantico/4 from DC. If you're leaving before 6-6:30pm, count on another hour or two added for the southbound traffic between DC and Fredricksburg......
The same driving time away you've got the Outer Banks(mainly Hatteras) of North Carolina and Morehead City, NC as mentioned. They both have fantastic wreck diving and tons of marine life(primarily sharks are a big feature there). Hatteras is an end of the road, small village kind of place. The best way to describe it is think of the movie, "The Patriot." Remember the small village on the beach that Mel Gibson's family took refuge at? Hatteras Village is what grew out of that in the several hundred years...... Morehead City is a more typical beach town, so to say, with plenty of bars, restaurants and of course Atlantic beach along with Emerald Isle right down the road.
Also 6 hours away is the Jersey Shore. Great wreck diving. Best beaches anywhere. But of course I grew up in Jersey
I think there is only 1 charter operating out of OC maryland, called the OC Diver. I think he spends some of his time in NC too....
So, if you want ocean diving it's a drive. There's some quarries if that will quench your thirst for the time being. You could always go diving in the anacostia waterfront for dead bodies and what not. Don't get lost in DC. If a cop is giving you a strange look as "what the HELL are you doing in this neighborhood?" then you may want to kindly ask him to escort you to where you need to be.
Lake Rawlings is an awesome quarry and is just southwest of Richmond. Plan on a 3.5 hour+ drive from DC unless you're a slow driver. I think it's $22 to get in for the day. They close at 5 on sunday, so beware. The staff/owners are incredibly rude, keep in mind, though it really is a great quarry for diving. My buddy from Kansas couldn't believe a quarry would have such fantastic viz.......I guess they're all mudholes out there in the mid-west. Thinking of it, he has a t-shirt that says, "Mid-west Muck Diver" and has a guy splashing around in a old-west style bathtub thingy.
There's also Bainbridge Quarry is southern Pennsylvania. I think it's about 3 hours from DC, but I've never been.