Spectacular. And some people do dive wet, but you are right, dry suits are commonly worn in these waters.
Something to consider - if you dive dry and live in New Jersey, you have access to great diving year round, and not just when you can get away to the Caribbean. Your diving will progress so much more quickly if you love it and if it's a regular thing. Being comfortable makes all the difference. Plenty of people start diving dry early on in their diving careers, and you can often pick up a used dry suit pretty cheaply - check out the annual
scuba flea market in Tom's River in February.