The first year bloom should be removed to prevent the nutrients that would go to seedheads. Leave the leaves arround where the flowers were. On the new growth you should be able to see the start of next years buds.

If you have a problem with deer,it might help prevent some damage if this fall you cut off the leaves but leave the leaf stems. They will form a sort of spiky crown that deer don't like to put their noses in. Some years it works but like everything if the animals are hungry they will eat anything.