one more thought...
can a plant/flower not come back as well the following year if I remove all the seed pods?? I'm enjoying harvesting seeds but am concerned that I might be killing them, or stopping them from growing larger.
I'm sorry if this is an ignorant or silly question.

In general, most seeds must be fully dry before harvest. Saving seed from perennials will not affect them.

Harvesting seed from plants that re-grow each year from their own seed (hardy annuals & biennials) is another matter; unless you replant some of the seed, or leave some on the plant, you might lose them. Hollyhocks are a good example.

As soon as the brown papery pods on the columbine open, you are set to go. I harvest the whole stalk and shake into a large bowl. I leave the bowl on the patio to allow the bugs and spiders to wander off. They're usually gone by the next day and I can bring the bowl inside.

Doesn't hurt plants a bit!