Well, what you have stated could be due to other reasons than just sun; Like, soil type, variety, nutrients ... Plants with less nutrients in poor soil tend to ripen fruits faster. But the plants and the fruits will be smaller in size. Probably , you are caring too much for those with smaller, green fruits and growing lots of foliage !

In my garden I start getting direct sun after 11: am.
Morning sun (shining at a low angle) is less intense than mid day/afternoon. So if you sun exposure is short, afternoon sun is more effective.