Azalea leaf gall? If so, removing the galls was the right thing to do.

As for the black spots/dots, a guess without a photo but it does sound like caterpillar frass. Keep an eye on the shrubs, see if any more evidence or damage appears that would warrant treatment.

Another possibility is shotgun fungus. If you have wood mulch, it can develop a fungus that shoots tar like spore cases that stick to anything they touch.

From Cornel University:

The spots may actually be spores from members of a group of fungi commonly called the "shotgun" or "artillery" fungi in the genus Sphaerobolus. These fungi colonize dung or other organic matter such as wood mulch, wood benches, wood sheds, etc.

Artillery fungi use an interesting mechanism to disperse their spores. Dark brown spore packets, called peridioles, sit on top of specialized cup-shaped cells which accumulate water and cell contents. When enough liquid is accumulated, the cupped cells invert causing the cells to burst and propel the peridioles as high as 19 feet where they can adhere to new surfaces.

Hi rhodyman, I just came across your response about the little black balls and it sounds like exactly what' happening in my kitchen! I have herbs growing on my windowsill - basil, thyme, rosemary, mint and garlic chives. For the past few months I've noticed these little black balls that look like poppy seeds stuck to mostly the mint leaves (mostly on the bottom but also on top), and also all along the ceiling above the plants and on the window that the plants sit next to.

What is happening in my kitchen?!? Thank you!

Danielle, that certainly sounds like artillery fungus spores! I'd dispatch those herbs to the outside and get them repotted, tout de suite!

Artillery fungus grows on old wood, such as might be in your potting soil or mulch. Other culprits could be any unpainted wooden structures. I've seen it arise on someone's wooden window frames in an old garage. Inside that garage was parked a very rare antique automobile, fully restored. The paint job was ruined.