Brown leaves are common with overcrowding. If moisture at the base of the plant can't escape, it sits there and grows fungus. Kind of like a wet shower curtain. Try clearing out the area around your plant to provide good airflow. Use a mulch to lock in just the right amount of water and allow the surface to dry out when the sun comes out. Look up Botrytis. Everything will be back next year.

Good Luck!!

Replant the pulled out lilies and just leave the snapped off ones in the ground. The stem feeds the bulb so the snapped off ones will grow a smaller bulb, but should return next season pretty much good as new. I have a couple that the deer seem to get almost every year before I get out the Liquid Fence, but they still come up every year as the bulbs are pretty resilient.

I don't have raccoons, but I do use chicken wire against rabbits. It blends into the background and you never know it's there. Don't know if chicken wire would stop a raccoon though.