Pineapple guava is pretty and tasty.
Renee

I've seen dwarf pomegranates growing in my neighborhood, they are attractive, decorative plants. They are about 4 to 5 ft tall, no idea if they would get too large for you.

I've seen Kumquats grown as hedges. Those fruits also hang on for a very long time. I would suggest Meiwa Kumquat(or even better, a seedless variety if you can find it at your local nursery).

Barbados Cherry might also work; just keep it trimmed down.

Southern Highbush blueberries will do fine for you; Sharpblue, Misty, Oneal, Sunshine Blue all will fruit fine. However you must dig a hole for them and throw out the dirt you dug, and instead plant them in 1/3 peat moss, 1/3 miniature bark, 1/3 compost, with a big handful of soil sulphur and ammonium sulphate. Mulch them and put them on timed drip irrigation. They really like partial shade on the east and west side of the house also.

Applenut

You can do a 6' hedge thing with Loquats if you prune them aggressively. Pretty much a foolproof plant with very tasty fruit.

If you are looking for something less common but well adapted to a dry subtropical climate, I suggest Kei apple, Strawberry Guava - I particularly like Lemon Strawberry Guava or jujube.

Ryan

Natal Plums--yum yum!
I LOVE Natal Plums when they get really ripe--kind of a cross between raspberries and plums in flavor.

Carla in Sac