Let them be for now while your plant adjusts. Leaves are your plant's food factories, so every leave you remove affects the plant's ability to make its food. If the damage would have been in summer when the plant was growing like crazzy, it wouldn't be a big deal to remove all or most of the foliage. My reply might be tempered if the plant is very healthy and you're only talking about a handful of leaves. Generally speaking though, it's always best to do any significant pruning after the middle of Jun.

Al