I'm able to get to Gilroy once or twice a year. I can spend an entire day and still am not able to get to all the stores I want. The outlets are spread out, there are four centers, so plan on driving between them. Also arrive early to get good parking. Check out the web page and map out a plan, unless you can go a couple days in row.
more