And also, since I've been spraying the leaves with the soap stuff, wouldn't that kill the ladybug larvae too? What am I to do...

The leaf that resembles a curled up wad likely has lots & lots of aphids on the back. Remove it.

The leaves with the squiggly patterns have leafminers

The larvae (black & orange ) is a ladybug youngster. The small dots are aphids.

The orange and black thingy there is the larva of the Lady Beetle. Whether Insecticidal Soaps will harm them is debateable with some reports indicating yes and others indicating no. That larva can help control the Aphids, but you can do little about the leaf miners once the eggs hatch and they burrow into the leaves short of squishing them.
The real question is why so many insect pests? Aphids are known to be attracted to plants growing in soils with an over abundance of Nitrogen, plants with lush green growth and there is much evidence to indicate other insects are also. What does a soil test say about nutrient balance?