The Starkville Public Library has a great selection for children's books. I haven't utilized their services much for adult books. I have looked in their catalog for a few recent books but they didn't have any of them in circulation. I think they mostly have older books in their adult section.
They do have a reading hour every week for children and in the summer they have programs twice a week. Some of the past programs include plays, puppet shows, craft fairs, and story tellers. ALl of the programs are free of cost and open to anyone in the public. They are always getting in new children's books and even have a good selection of children's videos. And, the childrens section is apart from the main part of the library so you don't have to worry about keeping your kids silent.