Two of my Cherokee Purple plants have tiny white and green bugs on the undersides of leaves...they look like lice (yuck!) Can someone tell me what they are?

I have also been mixing up a mild soap water solution and rubbing it on with my hands. It seems to be drastically reducing the number of them, and the plants still seem healthy (although are taking forever to set fruit). Should stronger measures be used? I hate the thought of pesticides. I don't want the health of those two plants to suffer though. I also don't want the little "bug party" spreading in my garden!

Hope this hasn't been asked already. I searched back through old threads and didn't see these particular bugs mentioned. Thanks for any help you all can give!

Jen