What you have there is a rhizome and perhaps a whip shoot which is not growing upright. If you dig them up they will undoubtedly die. If it were me, I'd take out the rhizome. As for the shoot, I'd take that out, too, if I didn't like the location. However, if you want to keep it, put a loop of twine around it and gently pull it into an upright position by tying the other end of the twine to an upright culm or a stake. You might want to even "overcorrect" it a little by bending it up past the vertical stage a bit, with the top a little closer to the support. If you're in risk of breaking it because it's a little stiff, do the bending progressively over a couple of days. At this stage it's pliable, but will harden off in a vertical position in a month or two if you do this. Then you can then remove the corrective twine.