Hi, my favorite weapon for ants is diazinon, which you can still find on Ebay every once in a while. I got 50 pounds a few years ago so it should last a lifetime. As to if you should get rid of them, sort of depends on the ants. If you are able to follow the ants up the stems of your plants and you see them stroking up aphids, I would more be for using Neem or hydroblasting your plants to get the aphids off. No nectar source = no ants, if that is the problem.

If the ants are not causing any problems, I would be for leaving them alone unless of course you just don't like ants. Personally, I like an ant-free environment.

In fact, I just happen to have a web page dedicated to my friends the fire ants.

Here is a link that might be useful: No more ants