Those plants mentioned will lose their leaves.How about Evergreen Huckleberry or Lingonberry?
Both are evergreen,but also like the type of pH environment that Blueberries do.The Huckleberry will take some sun but will grow larger in a more shady area. Brady

Hello,

Have you considered pineapple guava? It is an evergreen shrub that has beautiful leaves. Another great evergreen edible is Chilean guava which have smaller leaves but are also very attractive, and the berries are amazing.

Galen

Here is a link that might be useful: Edible Garden Northwest

Being in Maryland,in zone 7a,might be cutting it close with cold temperatures for Pineapple Guava as it is recommended for zones 8-11.
Chilean Guava may very well work though and could be covered during an extremely cold winter.Brady

Another one,the Chilean Wintergreen is hardy to zone 6.A male and female plant are needed for fruit.Brady

Many thanks for your helpful replies. I don't know why it didn't occur to me previously that I need evergreen shrubs in these two spots! I've done some research on the suggested plants and, while they are all good ideas, I am particularly intrigued by the Chilean Guava. It sounds perfect except with the exception of the cold hardiness issue. It would be interested to hear from anyone that grows it in the mid-atlantic area. I could grow it in pots but would like to avoid this it possible.