I tend to favour shooting around the times of good light, about 1hr before sunrise, sun rise-90mins-2hrs after and 2hrs-90mins to sunset-1hr after sunset.
I don't personally see the fascination with taking images in harsh light just because you are there or just taking images non stop "as you happen to be there". Just hang around a bit longer or get up a bit earlier if you like warm golden light. I kill time by having a great Lunch. You can get nice images outwith these times.
A more cloudy day will lend itself kinder to taking images towards the middle of the day. This was taken around 4pm, sunset wasn't until 9pm
_DSC8784 by
Stephen Taylor, on Flickr
Its not great but clouds can cast interesting shadows.
This depressing number was taken during the early afternoon on a miserable May in France
_DSC2632 by
Stephen Taylor, on Flickr
Around 11am in March
_DSC7736 by
Stephen Taylor, on Flickr
A good 3hrs before sunset this one too
_DSC7629 by
Stephen Taylor, on Flickr
I live quite near to Glencoe etc so I would just drive up early for an AM. Come home, process, crash out for the rest of the day. Or in an Evening go up, take the images and come home again. I tend not to go out for large full day outings unless leading workshops or unless I am over abroad, and then I tend to drive between locations in the day light hours, have lunch, do touristy stuff etc.
I spawned this horror before lunch on a March day
_DSC3117 by
Stephen Taylor, on Flickr