I have no experience with any of these, but I've been doing some research on the very same thing--here are a couple of ideas I've had:
Blanche Double de Coubert - Rosa rugosa
Mockorange - Philadelphus spp.
Any number of Viburnums - V. X burkwoodii
Not a shrub, but might work: Any number of Ginger Lilies - Hedychium spp.

Evergreen? Edible? How tall, or do you want a mix? Any other desired characteristics?

Do you know the pH of your soil?

Clethra alnifolia - is blooming now, likes full sun, is fragrant and a butterfly magnet
Hydrangea paniculata grandiflora - is blooming now and is bombproof
Any of the hardy hybiscus
Brugmansias

The soil is a bit acidic - the hollies love it, of course. I'm all for a mix of heights and colors. I'd like some that are sweet smelling at different times of the year...

Is Clethra called Summersweet? I was thinking about that one!

A trellis with jasmine could add another fragrant touch.

There are also larger herbs like sage, lavender and rosemary which are evergreen (some of them). The rosemary isn't showy, but it will bloom in the winter.

Gardenia, Chas Grimaldi brug, oakleaf hydrangia, clerodenron bungeii (but in a pot in the ground), philadelphus virginalis,

a different kind of fragrance of foliage would be southern wax myrtle, myrica (now morella, i think) cerifera. it grows fast, is semi-evergreen and responds well to pruning. birds are fond of the berries produced by female plants. they are very easy to propagate from cuttings. i like them for natural areas but have seen some pruned into tree form with large, exposed trunks that are very attractive.
other hardy fragrant shrubs suited for sunny sites are witchhazel (hamamelis sp.), sweetshrub (calycanthus florida), glossy abelia (butterflies love it, blooms for along period) and winter honeysuckle (lonicera fragrantissima). quite a few of our native azaleas are very fragrant. some that may be marginally hardy in zone 7 would be banana shrub (magnolia figo) and sweet olive (osmanthus fragrans).