It might be because he's spending a lot of time defending the feeder from other hummers.

I've had something similar with a female hummer. She would perch on this one tree limb and just stay there for like 10 minutes. But now I don't see her do that and if I do, it's maybe once a day and for about a minute because she's busy chasing off other hummers.

Your male will be gone in a few days, your females will hang around a little longer, until the 1st part of Oct, if you're lucky.

You are lucky to still have an adult male. Here in central indy I havent seen a male for a couple of weeks now. Although I still have hummers daily, only 2 or 3 seem to be hanging around. Are they they same birds or does it change daily? Thats migration for you. My record for seeing my last hummer is Oct 6th and that happened last year, before that it was late sept.

I still have one fat male ruby throat, and several females and juveniles. The male is guarding a feeder, but not perched all day. He has replaced a female who perched almost all day on this tree limb. The male is chasing away the others.
They are feeding at 2 window feeders and 3 feeders hanging in nearby trees. We are still having temp. in 90's, and it is 83 degrees now at 9:30 pm.