Could it have been the "lemon mangosteen"? Just a guess.

Hmm, it had tiny seeds so probably not a mangosteen unless the lemon mangosteen seeds are different from the normal kind. Thanks for the guess though!

Hi Ryan, hopefully better late then never.
I just got on the forum for the first time in a long while.
The fruit you are referring to is most likely a "Granadilla"
There are dark purple types in other parts of the world, but here they are a orange yellow. They are a bit larger then a golf ball, maybe twice the size.
They are in the passionfruit family, but unlike many types of passionfruit which are pretty sour, Granadillas are sweet and ready to eat. We serve them to our guests here all of the time. Kids here refer to them as "moneys brains" Hope you get this so late, and hope it helps.

Wow, that is totally it!

Thanks so much. I've been wondering about that fruit for ever. I'm actually surprised how close my memory was to reality considering its been so long.

Next time I make it down that way, I'll know what to ask for. Thanks!