I'd say it depends on your light shift and how strong your back is.

I would leave them out for as long as I could. As long as they don't see a freeze.

Mine are still outside doing well, and I live in New England. The only reason why I am bringing them inside is because they would see the low thirties tonight and moving forward:-(

Mike

I think I will follow the same pattern

I, too, keep mine out for as long as possible, although I don't live somewhere as cold
as Mike's region. With the solar values decreasing this time of year, I don't worry as much
about burning or shocking the leaves of the plant. I think one important tip to remember is this:
if the roots are cold, don't put the plant out into strong, warm sunlight immediately.

With smaller plants in smaller pots, I pull the plants indoors at night to keep the root-temp
higher, then I put the plants outdoors in the morning when the sun rises. I also use slightly warm
water to raise the temperature of the roots after chilly nights followed by sunny Autumn days.

Josh