A good overview and instructional book for many types of reed baskets is Lyn Siler's "The Basket Book". It's in most public libraries and there's usually a copy or two on ebay.

Many other basketry books are out there, most of which deal more specifically with certain styles, such as rib baskets, flat reed baskets, coiled baskets, baskets from gathered materials, Nantucket, Shaker, etc.

If you're interested in the easiest forms of drilled-base baskets that are often taught in kids' craft classes, check out the Boy Scout Merit Badge book on basketry.