As a New Yorker, I can say that I don't lack opportunities to hit some of the best bakeries in the country. Manhattan has quite a few, the small village of Warwick nearby me has an incredible French bakery, and living near the Culinary Institute of America means more students pastry chefs are being turned out each year.
New York City bakers are fortunate that Mrs. London's Cafe and Bakery in Saratoga Springs is a few hours north, because the quality of pastries and light lunch items at Mrs. London's is the best in upstate New York. With the exception of during racing season at the nearby track in Saratoga, Mrs. London's is mostly a quiet place to sit with a cup of yummy tea and a tart, cookie, slice of cake, or other delicacy. The treats sold here are so expertly prepared, one feels bad digging in!
For such a classy place, the prices are quite reasonable. Two can enjoy a hot beverage and top-notch dessert for a little over $10. They also have takeout, if you cannot bear to leave empty handed!