Could it be overwatered?

Bay that is rootbound (when the roots have grown out to the sides of the pot and started to circle it and become matted) needs very frequent watering, and even then the roots can start to rot and the plant can decline. If you haven't been repotting your plant regularly when it's beginning to be rootbound, it's probably time.

Happening in the woods now too with the healthy trees there being unaffected.

FataMorgana

Here is a link that might be useful: mushrooms in potted plants

Mushrooms usually come up where there is decaying plant matter. There may be a problem with your plant or maybe your plant needs to be repotted. 4 years is a lot of time to be in the same soil in the same pot.

Oilpainter, you are correct. In this instance, and in a million other examples of mushrooms coming up in a container plant the decaying plant matter happens to be the major ingredient in most potting mixes: the peat moss.

There is one particular species, a small yellow mushroom that so commonly pops up in greenhouses, houseplants, etc., that it is called the 'houseplant mushroom', lol.

Anyway, such mushrooms do not affect the plant in the container, though the underground mycelium will continue to breakdown and digest the potting mix. Time to change out for some fresh soil in the near future.

Mushrooms 'bloom' in response to day length, to moisture content, and other factors. Simply remove the fruiting bodies and dispose of them. There is nothing else that you can do aside from the repotting.

If you can take some pictures, we might be able to ID them for you.

Thank you for the responses. I figured it was time for repotting or at least refreshing the soil. That is on my to do list for when the weather cools a bit. Have several other plants in need of re-potting and plan to do all the same time.
Thanks again.
Murphy