Looks like an echeveria. If the yellow falling leaves are on the bottom part of the plant it should be okay. If it's in the middle or newer leaves then maybe there's a problem. How often do you water it?

The leaves are coming from the bottom, but it's leaving it with a pretty bare stem. For watering I normally give it a pretty good dose every 5-6 days and then give the soil time to drain out.

Watering sounds about right for most echies, although it could be less depending where you live and if you're growing it indoor or outdoor. If you can post a picture of the whole plant it might be helpful.

When the leaves started to turn yellow I moved it inside in front of my window so that I could watch it better. But it was outside before