I dont mind exploring, but as you said you'll usually find a dig spot or chest with a potion. There's not much reason to do it.
I wish console games would be more like their PC counterparts and put more random shit in their game. And I dont just mean random low level items, I mean random weapons/gear/whatever. Give me a reason to explore other than finding some shitty book or key. Fallout 3 sort of achieved this by placing skill books around and not holding your hand.
At least give me the perception that I could find some game altering weapon somewhere.