The grounds of the Vanderbilt museum are so beautiful you might find yourself imagining that you live there and are fabulously wealthy. The view of Northport Harbor is beautiful! Take the house tour (get really jealous) or visit the Marine Museum.
If you have kids go the the Planetarium! It is small and a good educational experience for them . The gift shop has some great stuff you won't mind buying.