You live too far south. Almost all commercial almonds are grown in southern California. They don't like humidity and late frosts will do them in. According to Southern Living Garden Book, the only parts of the south that can grow even a limited few almonds are Oklahoma, southwestern Missouri and some hot dry sections of Texas.

Also, according to SLGB, you can grow black walnuts and English walnuts in the south. The trees are huge, messy, have competitive roots and secrete a substance from their roots that will poison almost anything trying to grow near them. I have to admit that black walnuts are positively delicious. But boy are they hard and messy to shell.

If I were you, I would plant pecans. But that's just me.

Thanks DB, I actually already have 2 pecan trees. Ate my first three pecans off of them a few days ago. I guess I will rule out the almonds. Might still try the walnut though

Don't recall ever seeing any Persian/Carpathian(English is a misnomer) walnuts(J.regia) in the Deep South... but, a number of years back I got my hands on some scionwood of a couple of varieties that the folks at TAMU had imported for trial (did not get any successful grafts). Might be worth contacting the folks at the National Clonal Germplasm Repository for Juglans (walnut) species, at UC-Davis - they may be able to recommend selections of J.regia that are more likely to do well in the Deep South. Don't think that they are still distributing germplasm material at the present time, due to concerns about Thousand Cankers Disease, but that situation may have changed.

Up here in the frigid northland (KY), J. regia is subject to damage from late frosts, so they need siting with good 'air drainage', similar to peaches.

ive been curious about this too
im in New Orleans
macadamia and chestnut were the 2 i was looking at.

macadamia
http://www.crfg.org/pubs/ff/macadamia.html

Walnuts need 700 to 1500 chill hours
depending on variety
http://homeorchard.ucanr.edu/The_Big_Picture/Tree_Selection/

Chestnut only 300 to 400
http://www.garden.org/ediblelandscaping/?page=201111-grow-chestnuts

Hazelnut needs 1500 chill hours
http://www.gardeningblog.net/how-to-grow/hazelnuts/