The name on the storefront is actually Feldmans IV Housewares. It's on a quiet corner on Madison and 87th, and when you go, it's like walking into someone's cluttered attic. It's completely surreal - walking into a store on Madison, and finding it perpetually full of clutter, with shelves full of various odds and ends.
If you have a specific need, I highly recommend asking for help finding it, you'll never navigate through the place, even though it's tiny! Somehow, the staff knows exactly where everything is, and are very helpful, which makes up for the messy environment. And, they do seem to have most housewares and hardware you might need, so don't be shy, just ask for it!
Not sure prices are the best, but they have a sale shelf in the back which is worth checking out if you have time to browse.