I have two semi-dwarf apricots, Sungold and Moongold. They are only 3 years old and looks like I will have fruit for the first time this year so I can't say what the fruit tastes like. You need both to get fruit. Very nice ornamentals too even if they don't set a lot of fruit.

Oh, thank you for that suggestion! I hadn't thought of apricots. A friend suggested Harel Red and Honeycrisp semi-dwarf apples. Apparently there is more space than I thought, so I am looking for cherry and plum varieties now.