I think the site you describe has too little sun. Full sun means at least six hours of sunlight a day, part shade means very light dappled shade or at least four hours of direct sun a day.

Blueberries do need an acidic soil or the leaves will yellow, growth will suffer and fruit set will be light. Use a home kit to check your soil acidity; for blueberries it should be under 5.0. If your soil is not acid, you will have trouble growing a good crop of berries.

Don't know about deer eating the leaves but birds will eat the berries unless you protect them with netting.

Here is a link that might be useful: Blueberries

I have blueberry bushes in an area that was mostly sunny when I planted them. However, nearby trees are now shading this area and the frequent rains of this spring and summer have kept the area rather wet. In spite of this, I have a fair number of blueberries ripening right now. I would like to move these bushes to a sunnier location, however. My soil is naturally acidic, so no problem there.

Deer love my blueberries and I had to move them inside a fenced area.