It might help if you list if this spot is sunny/ shady.

I kind of like Diablo Ninebark....

Here is a link that might be useful: Diablo Ninebark

I agree with Superdave and the Diable Ninebark.

You might also consider a Royal Purple Smoke Bush.
Various sites list it as hardy to zone 5, others to 4a.

Mine is very drought tollerant, and receives half day sun, and half day dabbled shade.

Julie

Here is a link that might be useful: Royal Purple Smoke Bush

There are hundreds of choices. Site restrictions, flower color, foliage color, seasonal interest, berries for ornamental & wildlife use, size, etc all are factors.
I'm partial to viburnums but there's numerous varieties of those. You need to get a few books on small trees & shrubs from the library & see what trips your trigger. Look at whats around the neighborhood. The arboretum in Madison, Boerner Botanical Gardens in Hales Corners, the Rotory Gardens in Janesville, the gardens in Green Bay (I'm sure I'm forgetting others) all have labeled selections so you can see what you like. There's so much great stuff out there to choose from. Enjoy the hunt for the perfect shrub.

A very unique little tree - medlar.

As usual, I agree with Bob about the virburnums. I have several varieties in my yard, and love them all.
Still, one more idea...Harry Lauders Walking Stick. I have one that is visible from the deck during winter, and it is so lovely. plus, I have a nice clematis that I trained to grow up one side of my HL bush to provide late season bloom.
Pondy

I love the dwarf crabapple; stays small, doesn't need pruning, pink/coral blossoms in the spring, and is still full of bright red berries (and hardy to Z3).