When I lived in Z5 I always waited until spring, to see which parts were still alive. Which usually wasn't much, but it would be a bummer to remove a branch that could make flowers next year.