Skip Links

USGS - science for a changing world

Data Series 1027

Four-Band Image Mosaic of the Colorado River Corridor Downstream of Glen Canyon Dam in Arizona, Derived from the May 2013 Airborne Image Acquisition

Citation Page
Abstract
Introduction
Data Collection
Image Processing
Accuracy and Error
Data Organization
Companion Data
References Cited
Data Release
 

Accuracy and Error

An initial horizontal accuracy of the image data was assessed by Fugro Earthdata Inc., using 188 GCPs provided by GCMRC. The GCPs were marked during image acquisition with 1-square-meter (m2) diagonally alternating black and white plastic panels centered on control points throughout the river corridor in the GCMRC survey-control network (Hazel and others, 2008). The root mean square error (RMSE) reported by Fugro Earthdata Inc. is 0.17 m easting and 0.15 m northing, or better, depending on the acquisition zone.

After mosaicking, we assessed the horizontal accuracy of the 2013 data postregistration to the 2009 imagery. We completed three horizontal-accuracy assessments that are relevant for the 2013 image mosaic. We compared the 2013 mosaic to the GCMRC survey-control network, the 2013 mosaic to the 2009 mosaic, and the 2009 mosaic to the GCMRC survey-control network. All three assessments used the same 91 GCPs that coincided in the 2009 and 2013 data acquisitions. A total of 95 GCPs actually coincided between 2009 and 2013; however, we removed four outlier points that had large observed errors in 2013, which we believe resulted from misplacement or disturbance of a panel on a monument in the field (fig. 5). The accuracy assessments were completed by following the Federal Geographic Data Committee geospatial-positioning accuracy standard for calculating RMSE and accuracy at 95-percent confidence level (Federal Geographic Data Committee, 1998). First we calculated the sum of square error for each coordinate independently, then a combined sum of square error (SSE) for a combined error given by:

SSEc = ∑(Ccontrol, iCimage, i)2(3)

where C is either the x or y coordinate (easting, northing).


Next we calculated mean square error (MSE) by taking the mean of our calculated sum of square errors for each coordinate and the total SSE:

MSEc = SSE/n(4)

We were then able to calculate RMSE separately for the x and y coordinates as follows:

RMSEc = sqrt(MSEc)(5)

Alternatively the above calculations can be accomplished in one step with the following:

RMSEc = sqrt[∑((Ccontrol, iCimage, i)2/n)](6)

where C is either the x or y coordinate (easting, northing).


We then estimated accuracy at the 95-percent confidence level for the x and y coordinates as follows:

Accuracyc = 1.9600 × RMSEc(7)

Next, we calculated the combined (or “total”) x and y RMSE as follows:

RMSExy = sqrt[∑((Xcontrol, iXimage, i)2 + (Ycontrol, iYimage, i)2/n)](8)

We then estimated the combined x and y accuracy at the 95-percent confidence level as follows:

Accuracyxy = 1.7308 × RMSExy(9)

When comparing the 2013 and 2009 image mosaics, we considered 2013 the “control” and 2009 the “image” dataset.

When comparing the 2013 mosaic to the GCMRC survey-control network, we determined RMSEs of 0.26, 0.26, and 0.37 m for easting, northing, and combined, respectively, with 95-percent confidence-level accuracy estimates of 0.52, 0.50, 0.64 m (table 2), respectively. When comparing the 2013 and 2009 mosaics, we determined RMSEs of 0.17, 0.13, and 0.21 m for easting, northing, and combined, respectively, with 95-percent confidence level accuracy estimates of 0.33, 0.25, 0.37 m (table 3), respectively, indicating an RMSE nearly equal to the ground-sample distance (that is, length of one pixel) when comparing the 2013 and 2009 mosaics (for example, for change detection). A comparison of the 2009 mosaic with the GCMRC survey-control network was reported previously (Davis, 2012); however, we report the accuracy here by using equations 3 through 9 and the 91 coincident GCPs. When comparing the 2009 mosaic with the GCMRC survey-control network, we determined RMSEs of 0.28, 0.23, and 0.36 m for easting, northing, and combined, respectively, with 95-percent confidence level accuracy estimates of 0.55, 0.45, 0.63 m (table 4), respectively.

One other important spatial-error component in the image data is associated with smear, which is generally presented as pixel-value drag across parts of the scene in this type of airborne remotely sensed data (Davis, 2012). These errors commonly appear at the edges of drastic topographic changes, such as sheer cliffs and scarps. In some places, no flightline tiles were smear free enough to use in the final mosaic dataset. We marked and recorded all areas that contained unavoidable smear, which accounted for 244,876 m2 or 0.0857 percent of the total image-mosaic area.

Map showing Colorado River in Grand Canyon and spatial locations for all ground-control points that had a placed panel in May 2013.
Figure 5. Map showing Colorado River in Grand Canyon and spatial locations for all ground-control points (GCPs) that had a placed panel in May 2013. Colored circles, panels used in accuracy assessment; small uncolored circles, panels omitted from accuracy assessment (for non-coincidence or placement error). Each circle is colored by combined (easting and northing) RMSE (RMSExy in equation 8) from comparison of U.S. Geological Survey’s Grand Canyon Monitoring and Research Center 213 mosaic with survey-control network.

Table 2. Comparison of 2013 mosaic with GCMRC survey-control network (limited to n=91 GCPs coincident between 2013 and 2009 image-data acquisitions) Durning and Others, 2016.
Horizontal accuracy assessment statistic Easting (X) Northing (Y) Combined (XY)
Sum of square errors (SSE) 6.3247 5.9822 12.3069
Mean square errors (MSE) 0.0695 0.0657 0.1352
Root mean square errors (RMSE) 0.2636 0.2564 0.3678
Accuracy at 95% confidence 0.5167 0.5025 0.6365

Table 3. Comparison of 2013 and 2009 mosaics (limited to 91 GCPs coincident between 2013 and 2009 image-data acquisitions) Durning and Others, 2016.
Horizontal accuracy assessment statistic Easting (X) Northing (Y) Combined (XY)
Sum of square errors (SSE) 2.6552 1.5365 4.1918
Mean square errors (MSE) 0.0292 0.0169 0.0461
Root mean square errors (RMSE) 0.1708 0.1299 0.2146
Accuracy at 95% confidence 0.3348 0.2547 0.3715

Table 4. Comparison of 2009 mosaic with GCMRC survey-control network (limited to 91 GCPs coincident between 2013 and 2009 image-data acquisitions) Durning and Others, 2016.
Horizontal accuracy assessment statistic Easting (X) Northing (Y) Combined (XY)
Sum of square errors (SSE) 7.0375 4.8769 11.9145
Mean square errors (MSE) 0.0773 0.0536 0.1309
Root mean square errors (RMSE) 0.2781 0.2315 0.3618
Accuracy at 95% confidence 0.5451 0.4537 0.6263

Accessibility FOIA Privacy Policies and Notices

Take Pride in America logo USA.gov logo U.S. Department of the Interior | U.S. Geological Survey
URL: http://pubsdata.usgs.gov/pubs/ds/1027/ds1027_accuracy.html
Page Contact Information: GS Pubs Web Contact
Page Last Modified: Monday, 12-Dec-2016 18:47:53 EST