I was recently in Ashville and was amazed by all of the pink dogwoods. Unfortunatly they don't seem to do well on the Mississippi coast. Also, all of the naturally growing redbuds were great. They do well down here in Jackson county but they don't seem to be locally native.

Carolina silverbell is also nice.

Carolina Jessamine

Venus Flytraps (native to NC)

Not all natives but all have done well for me

For shade
mayapple
solomen seal
bleeding hearts
lots of ferns
gingers
camellia
hydrangea
lamium
cranesbill
columbine
toadlilies

For sun
pitcher plant
iris
rain lilies
species tulips
redbuds
crinums
hardy amaryllis
gardenia (afternoon shade)
clematis
native honeysuckle