Danbury, huh? I think that's an easy cut over to I-84....I've driven the Boston to Pawley's Island corridor more times than i can remember, and ive taken every route conceivable.
My advice is to go through PA. It's an extra 80 miles (btwn CT and DC), but saves a lot of time (no tolls, no cops, no potholes, just scranton and harrisburg)