I too grow African violets and have done so since college. What works for African violets will not work for herbs. I know some people grow herbs indoors but they won't do nearly as well as outdoor - in a pot or the ground. If you must try herbs indoors do NOT overwater them. They need the soil to dry out between watering. You also need to get a grow lamp because they require the full spectrum of sunlight (which you won't get even in a sunny window) for good growth. And, yes, those cute little pots are criminally too small for herbs. Don't used anything smaller than a 6-inch pot.

Here is a link that might be useful: The Herb 'n Cowgirl

Thanks for the response. Are there any herbs that do better indoors then others?