Probably wasp and yes, they should die out in your zone when getting
cold.

Blueheron,

Honeybees die immediately after stinging (the stinger is barbed and essentially pulls the bee's guts out when they pull away after inserting the barb. So if these are honeybees, the one that stung your daughter never bothered anyone again.

This time of year, yellowjackets get extremely aggressive as they hunt for the last of the nectar. They are also more likely to nest in the ground than honeybees.

If these are yellowjackets and there are not many of them, once you have a hard freeze, I would suggest you seal all of the cracks and holes that are giving the yellowjackets entry to the foundation.

If there are too many to wait or if this is a honeybee colony, get a professional exterminator to remove the insects and nest and then seal the cracks or holes up. With a honeybee nest complete with honey, when you just kill the bees, the honey will just draw other bees.