I too have had this problem and the solution i came up with was this:
Firstly, your going to have to re-pot.
Take the plant out of the pot and remove the ants, brush them off, use gloves if you want. (I had black ant infestation so i wasn't bothered by the bites, but they don't have feel weird when a swarm crawls around you arms.
Remove the little eggs, they look like maggots/rice and kill the queen (should look big and white with wings, i think their white because they don't surface). Fill up the holes and re-pot when you think you have successfully removed it.
Do take care with the roots, and expect to see a little shock, but your green darlings should bounce back. Maybe a lil course of nitrozyme if you're worried about damage. Trying to remember what other solution i have (sound like 'Rhino') stinks of dead fish, but it's good for shocked roots.
For poisons i reccomend the following:
Ant Stop - Deltamethrine based poison (i haven't notice any damage to my crops). Read instructions carefully.
Tobacco - Get some rolling tobacco (any brand will do), take a handful and put into a container, add warm water, cover and leave it to soak over night. The next day, remove the tobacco and pour the liquid over the nest. This should give the ants a nicotine over-dose. Though i didn't find this extremely effective, you may need some proper harsh tobacco!!
Wear gloves as nicotine is quite absorbant, i felt a bit quesy after handling it.
Bait stations are quite good, they have gel and i believe they attract the ants with smell. They feed on the gel taking it back to the nest and then slowly killing the rest. I believe more than one station would be needed, pending on size of the nest.
I also read that growing mint is effective, i think this is bollox as i have mint growing in my greenhouse (from previouse owner am always weeding out), and they attract spider-mites (don't get me ranting about them

)
In some ways i wish i had never used ant-stop (although effective) i am concerned about it not being organic. I have since switched to using Neem Oil. I found it a nightmare to get hold of. Even going to beauty shops to try and buy it. I found some stocked at a local horse/equestrain shop if that helps.