If you asking here, the answer is probably Yes.
Around My area, I know the People & Places like the Back of my Hand,
There are places I wouldn't Think Twice about Just going to them.
however. there are other places, I'd think twice.
if I need to think twice, I'm more comfortable asking.
Written Permission ? Only if they suggest it,
Or if I get a No due to Liability & I feel it is worth Offering to sign a Liability waiver.
Most people Don't want to sign anything out of Fear.
as for who to ask. naturally the owner would be first choice.
not all abandoned property falls under the same category.
at least around here there are plenty of abandoned homes where the land belongs to someone other then
the home owners (99 year Leases, from the railroad,
Etc.)
people and real estate firms, from other states purchasing Properties Then
letting them rot.
others letting a neighbor do free upkeep like mowing just because they found a sucker to do it, in order to not live next to a snake , rat, infested woods.
alternative people I use for permission, when I feel it hasn't gone public
due to complete abandonment.
neighbors, local or state police, locals who know more about the place then I do. boro, or township employees. state workers. postal employees, fire companies etc.