Apple Mountain has long been the store to visit on Church Street for free fudge samples, but that shouldn't be the only reason to visit. They have some excellent Vermont artwork, including Warren Kimble, Sabra Field, and many local photographers.
Add to that the cutest T-shirts, low-priced maple syrup gifts, and excellent service, and this is a store you just have to go to before you leave town. Even locals like to shop there for holiday gifts for family.
The best thing about the store is that it is also affordable--there are great gifts for under $5.