I think it would depend on who is hunting in the area. If the local land owners give permission to anyone who asks, no I probably wouldn't. There are some real idiots out there.
But, I know where my father hunts, the land owners are very picky about who they let on their land. Many time (most times, actually) he and his party are the only people hunting there because the ranchers/farmers know that he is responsible and careful. They know they won't have to worry about him cutting their fences or shooting their livestock or shooting at their homes.
I would also say that if you can, go walking in the later morning (after 9:30-10:00 or around noon would be preferable) and definitely NOT right around dawn and dusk. Deer bed down during the day time hours (unless a storm is coming), so hunters generally won't see anything to shoot at during the mid-day hours. Deer are most active right around dusk and dawn and of course that's also when light conditions aren't condusive to seeing longer distances (or idiots looking beyond what they are shooting at, and those are the idiots who miss their shots and hurt people).