Cache location is often frequented by locals. In the Summer of 2012, their was a line all along Route 460 of people waiting to utilize the natural resource of this location due to the week long power outage caused by a Derecho. Frequently see people stopped here, but you shouldn't have a real problem with Muggles, either wait them out or make a loop and come back!
Hint is a total spoiler! Watch out for poison ivy.