the flowers only last one day after opening, then die.
they also like a lot of sun and lean soil. maybe that is the reason for the bud drop. are you fertilizing too much, maybe? i would think you would be able to grow these as annuals outdoors in wisconsin during summer. i also think they are not good candidates as houseplants, esp. in a closet, because of their strong light requirements and poor circulation in that environment. they won't get pollinated and produce seed in the closet, either, unless you do it by hand.