Ideally on these, every branch tip should get some kind of blossom. I put in a 3-gal last Fall that had about 8 blooms and now it's on pace for at least 40. That said, it gets sun from 8am - 6pm, which probably has a lot to do with it. If not a sun issue, maybe they're being bitten off by deer before they get a chance to flush out? QF's definitely should be well into flowering mode by now, hence the name. I would not recommend putting these anywhere near where trees or buildings would cast a shadow on them, especially in zone 4.

They haven't been deer pruned, and while sun may be an issue overall, the one in the most sun (in front of a rose that's blooming beautifully) has no buds.

I remember when I brought them home late one spring thinking that it was unusual that they didn't get buds, given that most nursery-grown shrubs seem to be primed to bloom. For example, I bought three Little Limes this spring, and while none of my limelights is budded yet, the little limes are full of buds.