One plant I would definitely not recommend is vinca major (nor would I recommend vinca minor, as it is almost as bad). From personal experience, these have both become invasive in our yard.

At first they looked lovely sitting all neat in their beds. Then I had difficulty keeping them from growing up trees. When they did they would bore their roots through and into the tree's bark. We have a large yard. I became sick for a couple of years (this was after they started to become difficult) and couldn't get out to do much yard work, and by that time they grew up most trees that are in the yard and weakened and ultimately led to the demise of many of our lovely trees. Also, causing a hefty tree removal bill.

It has become a landscaping nightmare to rid these vines from our yard. They are tough and hard to pull by hand. Also, being under other trees and shrubs and near other plants, chemicals are also difficult to use without killing others.