They may need to be monitored to be sure they get enough water. Often the area very close to a fence or wall can be quite dry. I would suggest planting several inches out from the fence, and there should be no problem. Remember a fence may cast shade, so check if the area to be planted is in full sun, part sun, or mostly shade, and select plants accordingly.