Before I go and adjust all the rock climbing areas, I just want to make sure:
It’s OK to trace this data because USGS is public domain, right?
This LIDAR data should always be more accurate than satellite images, right, so there should be no harm in adjusting cliffs to match the hillshade image?
Cliff ways should follow the top edge of the cliff, and not the bottom edge?
The part of the hillshade image that looks like the cliff edge is actually the cliff edge, right? The hillshade doesn’t mislead in some way?
In general LIDAR is high-quality but presumably there are places where it is misaligned/bogus/broken/inferior. So I would not assume that is better in every single case.
For example, LIDAR may be outdated and aerial more recent. Maybe some cliff was mapped based on survey. Though none of you examples suggest such case and in general such edits are a good idea.
And there could be places where it can be misinterpreted (for example in one case I confused stream with path on LIDAR).
mistakes in alignment, different alignment criteria, software bugs in some layer between raw data and display in editor, manually applying wrong offset etc
Oh, you mean Way: White Diamond Access Road (679973414) | OpenStreetMap? Yeah, I need to verify things before modifying everything, though. I want to make sure boulders and trails are on the correct side of the cliff edges, etc. That trail runs below the cliff if I remember correctly. I guess there’s a way to offset satellite images so they line up with the LIDAR images?
I climbed there yesterday and recorded GPX tracks and took a bunch of notes, but still not 100% sure about some things. This area consists of a bunch of “tiers”, for instance:
Yes, 3DEP is in the public domain as a work of the federal government.
To be fair, every other data source available to us has the same theoretical sources of error. The advantage of 3DEP is that it comes with rigorous documentation about standards and tolerances. I’m no expert in this field, but quality levels QL0–2 compare favorably to even high-resolution aerial imagery. The area around Minnewaska State Park, in the original post, is QL2.
According to WESM, the Rattlesnake Mountain site is right on the edge of a QL2 project boundary. The lower-resolution data isn’t derived from LiDAR; it might be from satellite imagery or IfSAR.
Several areas of the Northeast haven’t been covered by LiDAR projects yet:
Oh definitely, I am not saying that LIDAR is bad - high quality LIDAR is often extremely valuable, showing paths under permanent tree cover via extreme detailed terrain shape still feels like magic to me.
But it should not be assumed to be always correct and always ideally aligned and always up to date. And yes, this applies to all data sources.
But how do we know which source to trust when they disagree? I can’t assume the 3DEP imagery is more accurate than the satellite?
USGS has a helpful instant chat and they sent me some links:
Horizontal Accuracy
It is difficult to quantitatively test the horizontal accuracy of the lidar source data from which most of the 1-meter DEM is produced. Factors such as Global Positioning System (GPS) accuracy, Inertial Measurement Unit (IMU) precision, flying height, and calibration control all affect positional accuracy (American Society for Photogrammetry and Remote Sensing, 2015). Because these factors differ across collections, the horizontal accuracy of the overall 1-meter DEM is variable. In most cases, the horizontal accuracy is expected to be within 1 meter.
Horizontal Accuracy
The horizontal accuracy varies by the horizontal accuracy of the source data. In most cases, the horizontal accuracy of seamless DEM coverage produced from 3DEP technologies is expected to be 1 meter or better (Gesch and others, 2014). DEMs created from lidar data and legacy topographic data are particular cases that require more explanation regarding their horizontal accuracy. Lidar Source Data
It is difficult to quantitatively predict the horizontal accuracy of the lidar source data from which much of the seamless DEM datasets are produced. Factors such as Global Positioning System (GPS) accuracy, Inertial Measurement Unit (IMU) precision, flying height, and calibration control all affect positional accuracy (American Society for Photogrammetry and Remote Sensing, 2015). Although accuracy can be measured (as compared to predicted) through field collection, such a program is not currently practical.
Again, depends on data sources. I am lucky to be from area where state-provided aerial imagery and LIDAR data has accuracy better than high-quality GPS.
But neither “LIDAR is always better aligned” nor “aerial imagery is always better aligned” will be always true. Though I would bet that LIDAR in general has better accuracy as whole point is getting extreme detail, so people making it will likely care more about calibration. While it is true for some aerial imagery but not all of it, some is quite coarse and not aligned with accuracy measured in centimeters.
I also prioritize mapping the top edge of the cliff. I do map multiple tiers if they are reasonably distinct, like if the ledge separating them is a wide enough ledge to have it’s own trail. E.g. OpenStreetMap
One flaw I’ve noticed is that the LIDAR processing seems to erase detached blocks (probably from whatever algorithm erases houses/trees to get just the ground elevation?):
We do not currently assess 3DEP lidar data for horizontal accuracy. It is difficult to have 3D ground checkpoints that would be visible in a lidar collection. For Quality Level 2 data, lidar pulses are nominally 0.71 meters apart so having a pulse exactly hit the 3D object would be unlikely. That is why our checkpoints are collected in flat areas so that the vertical elevation will be the same for several feet in all directions and the horizontal error will not impact the vertical assessment.
However, that being said, horizontal error in lidar derived elevation data is largely a function of positional error from the Global Navigation Satellite System (GNSS), altitude (angular orientation) error (as derived from the Inertial Navigation System (INS)), and the flying altitude. The GNSS and INS errors are not typically listed in the mapping reports so ASPRS developed a table that can be used as a guide to estimate the horizontal errors to be expected at various flying altitudes based on typical GNSS and INS errors. The flight altitude is listed in the mapping report. See the table below: