I have found that potting mixes work best for containers. I believe that it allows better root aeration. Hard to say how your horse manure/worm casting mixture would work, depending on age, but it sounds pretty rich to me.

For pots which are not self-watering, I like Miracle Gro Moisture Control potting soil. I usually try to put some extra little holes in the bottom or lower sides of the container for better aeration. For self-watering containers, use something less moisture-retentive to allow good air penetration. Lots of tropical passifloras come from areas of high rainfall where the soil drains very quickly and may have low nutrient value. I can't give you specifics on varieties.