It should be fine but you just have to keep it in check with yearly pruning. Some varieties of Poms grow larger than others but they can all be kept to a manageable size with pruning. I have poms planted only 3 feet from my driveway and I just keep pruning them into the shape I want.
Simon

Thanks for the feedback, Simon!
My plan is to keep it pruned into a bush, for more prolific fruit.

Do you have any tips on pruning? The branches seem very 'willowy,' so I'm not sure having had some experience pruning trees like apples will help me. Do you prune mostly for shape/size, or do you look for suckers, etc., too?