They will likely leave within a few days if not sooner. They would much prefer to be inside a hollow tree or other spot where there is some protection (walls of a house for instance). Should the become a problem you might be able to find a beekeeper in the area that does removals.

-Tim

Here is a link that might be useful: Swarm & Hive Removal Lists

Thanks Tim. They left this morning, as quickly as they came. Pretty neat. Dawn