The berries you mentioned are mostly for northern climates. You may be able to grow blueberries depending which part of LA you are in. Blackberries are great. Some other fruit to try would be kiwi, banana, and grapes (all do well in small space if trellised (bananas don't need trellis)

maybe something like goji berry, if you go for a black berry go for rubus fruticosa '' thornless evergreen'' its a very vigoriious thornless blackberry that is a very heavy cropper. Japanese wineberry has thorns, lower yield but it is the most ornamental one with the best taste.

some lemon grass species (cymbopogon citratus) are also hardy in your zone and provide good taste and reliable crop. maybe get perilla which is also a fast grower.

some opuntia species are thornless and have edible fruits and pads. amaranthus species that have edibles.

some other tropical/subtropical stuff would be Feijoa sellowiana, Eriobotrya japonica, Citrofortunella microcarpa, Persea americana, pomegranate etc.

All trees take a while to produce a worthwhile crop so i would go for bushes, cultivars and shrubs/ climbers like kiwis and blackberries, goji berries etc.