Cut down the trunk that bore the fruit. Otherwise, it will die off by itself if you want to leave it. One way or the other, it won't continue growing or produce any more fruit.