Though this response is probably a bit too late... I tend to leave them on to enjoy the flowers and the hummingbirds that visit them. However, I'm sure it wouldn't hurt as it seems that once a the first few sets of bananas are formed, the rest of the blooms don't germinate.

On a side note, I'm getting bananas in January with all of this mild weather in Charleston. They're only a few inches long a may not fully ripen- fngers crossed.

bob