Performance Indicators |
Verification |
Validation |
|---|---|---|
Hazards |
||
| Hazards monitoring networks maintained | Earthquake --Data are used by automatic, computer based, data processing and analysis software at regional and national data centers. The data are used to compute the magnitude and location of earthquakes. In these analysis routines, each station used is given a standard deviation. This parameter indicates the degree of error associated with the data from that station. Bad data is immediately recognizable by high values for the standard deviations. The automatic processing routines reject these data. Volcano
-- Data are collected automatically by electronic equipment at
monitored sites and sent to the 5 U.S. Volcano Observatories. Each monitoring
network
is designed to meet the individual conditions at each volcano. Data are collected
in standard modes, which are established within the scientific community. Landslides -- Scientists involved in data collection efforts check instruments periodically to verify operation. Each data collection activity is unique and generally involves only one project scientist. Data are checked before performing analyses. Geomagnetism -- Data is collected automatically by electronic equipment at 14 remote sites and sent via satellite to the National Geomagnetic Information Center (NGIC). NGIC defines the data formats. All data is sent from remote sites to NGIC in a standard format using standard communication protocols. Data are reviewed on a daily basis for natural variations in the Earth’s magnetic field and for equipment malfunctions. Water Programs -- the number of hazards monitoring networks maintained (1) remains the same year after year. Procedures for data collection are documented by GPRA discipline coordinator and are available upon request. |
The National Research Council (NRC) validated this performance measure in their finding that USGS is a "vitally important provider and coordinator of information related to critical issues in the natural sciences" and often refers to the USGS’ future role as a "natural science and information agency." Monitoring availability of digital databases and infrastructure is fundamental to ensuring that this future role is attained. |
| Risk assessments delivered | Geology Hazard Assessments -- As formal USGS publications, Hazard Assessments
are subject to rigorous peer and management review, which includes verification
of any calculations, accuracy and consistency of data presented and appropriateness
and validity of source information. Water Programs --Information reported is well defined by backup material maintained by GPRA discipline coordinator, who collects the data directly from the Water Resources Reports Tracking System (RTS). Risk assessments are not counted until they are logged in the RTS as being distributed to customers. Supporting documentation is available at a macro level through the GPRA discipline coordinator, and at both macro and micro levels in the RTS. |
The NRC validated this performance measure in their finding that USGS is a "vitally important provider and coordinator of information related to critical issues in the natural sciences" and often refers to the USGS’ future role as a "natural science and information agency." Monitoring availability of research products is fundamental to ensuring that this future role is attained. Quality of research is captured in peer review and evaluations. |
| Real-time streamgages on the internet (quarterly average) | Data definitions are well defined and distributed by staff who provide the information to the GPRA discipline coordinator and are aware that the "number of sites reporting real-time daily mean streamflow on the Internet during the quarter." The staff can demonstrate how they collect this data each quarter. | Validation that USGS continues to have real-time streamgages reporting on the internet can be obtained by looking at the real-time streamflow information available on the Web at: http://waterdata.usgs.gov/nwis/rt/. Performance measure must support specific decisions about future improvements to the streamgaging network. |
| Real-time earthquake sensors (cumulative) | Data are used by automatic, computer based, data processing and analysis software at regional and national data centers. The data are used to compute the magnitude and location of earthquakes. In these analysis routines, each station used is given a standard deviation. This parameter indicates the degree of error associated with the data from that station. Bad data is immediately recognizable by high values for the standard deviations. The automatic processing routines reject these data. | Performance measure must support specific decisions about future improvements to the earthquake monitoring network. Customers and stakeholders are engaged in the strategic planning of performance goals. |
| Stakeholder Meetings | Geology Programs --Program Coordinator or Associate Program Coordinator
provides title of meeting, location, and dates; obtains from teams or their
own offices a copy of the agenda or other documentation; and reports meetings
that meet the definition criteria. Geography Programs -- A single point of contact is established for the meeting; the Geography Chief of Staff is the responsible official. Consistent methods for stakeholder meeting data collection are applied and documented. Water Programs -- At the time the quarterly data call is made, a detailed definition of what constitutes a stakeholder meeting is distributed to every reporting office/program each quarter. Offices/programs are asked to provide date, location, and purpose of meeting, and a list of participating agencies/groups/ individuals. GPRA discipline coordinator determines whether meetings should be classified as Hazards or Environment & Natural Resources, according to the stated purpose of each meeting and participating agencies. Offices and programs report only those meetings with a printed agenda, minutes, or other concrete documentation, for audit purposes. |
The NRC recommended that USGS do even more in reaching out and being responsive to our partners and customers. USGS has taken very positive steps with listening sessions and other venues to monitor those external voices. The strength of the USGS in large measure depends on the value that our customers and partners place on our science and the many ways in which our science impacts their work. USGS will continue to engage in more stakeholders meetings. This performance measure is an indicator of outreach. |
| Customer Satisfaction | Source data are individual responses to survey questions. All are fully documented. The different aspects of each product for which satisfaction ratings are sought are clearly and simply defined on the questionnaire. Both data entry and aggregation methodologies are documented and approved. | The respondents themselves validate the usefulness of the surveys. Quality assurance is handled by the survey manager and by the responsible program specialists and managers. |
Environmental and Natural Resources |
||
| Long-term data collection and data management efforts maintained and improved, and large data infrastructures supported | Biology Programs -- Definitions are provided in series of memoranda from
Associate Director provided electronically in descriptive material at beginning
of intranet website for reporting GPRA accomplishments. Consistent collection
of data is ensured through uniform use of website for reporting quarterly
accomplishments. All field stations are notified at the same time of a
reporting requirement, and all use the same procedure for reports. |
National program element reviews and reviews of individual research centers validate biological databases. The National Research Council (NRC) validated this performance measure in their finding that USGS is a "vitally important provider and coordinator of information related to critical issues in the natural sciences" and often refers to the USGS’ future role as a "natural science and information agency." Monitoring availability of digital databases and infrastructure is fundamental to ensuring that this future role is attained. |
| New systematic analyses and investigations delivered to customers | Biology Programs -- Definitions are provided in series of memoranda
from Associate Director provided electronically in descriptive material
at beginning of
intranet website for reporting GPRA accomplishments. Consistent collection
of data is ensured through uniform use of website for reporting quarterly
accomplishments. All field stations are notified at the same time of a reporting
requirement, and all use the same procedure for reports. Geology Programs -- GPRA discipline contact confirms that targets and actual numbers are accurate, that actual numbers exceeding or not meeting targets have been reported accurately, and re-checks the database information against the original information received from disciplines. Water Programs -- Information reported is well defined by backup material maintained by GPRA discipline coordinator, who collects the data directly from the Water Resources Reports Tracking System (RTS). Risk assessments are not counted until they are logged in the RTS as being distributed to customers. |
The NRC validated this performance measure in their findings that USGS is a “vitally important provider and coordinator of information related to critical issues in the natural sciences” and often refers to the USGS’ future rule as a “natural science and information agency.” Monitoring availability of research products is fundamental to ensuring that this future role is attained. Quality of research is captured in peer review and evaluations. |
| Decision support systems or predictive models developed or improved, and delivered to customers | Biology Programs -- Definitions are provided in series of memoranda from
Associate Director provided electronically in descriptive material at beginning
of intranet website for reporting GPRA accomplishments. Consistent collection
of data is ensured through uniform use of website for reporting quarterly
accomplishments. All field stations are notified at the same time of a
reporting requirement, and all use the same procedure for reports. Geology Programs -- Data are checked by contributing scientists once they are entered into the GEODE system and before they are released to the public. Files are checked for keywords and symbols. GEODE serves pre-existing databases and only obvious errors, seen when various layers of data are combined, are checked against original databases by contributing scientists. Water Programs -- Information reported is well defined by footnotes on quarterly report, which describe the purpose/focus for each new/improved hydrologic model. GPRA discipline coordinator collects the data directly from the Website where new/revised hydrologic models are made available to the public for download. Geography Programs -- Data definitions are defined and documented on website. Data control handbooks are online that define data specification standards. Long-term acquisition strategic component parts are available for peer review process including stakeholder representation. Working group defines the process. Mapping centers and the GAM Program Coordinator are responsible officials. |
Customers validate that the systems and models are acceptable and useful.
The NRC validated this performance measure in their recommendation that
multi-scale, multidisciplinary, integrated projects that use system modeling
are the best way to address the Nation’s complex natural resource
problems. Geography Program -- 100% of data validated through appropriate peer review. Customers validate that the systems and models are acceptable and useful. |
| University-based partnerships for natural system analysis | Biology Programs -- Definitions are provided in series of memoranda from
Associate Director provided electronically in descriptive material at beginning
of intranet website for reporting GPRA accomplishments. Consistent collection
of data is ensured through uniform use of website for reporting quarterly
accomplishments. All field stations are notified at the same time of a
reporting requirement, and all use the same procedure for reports. Water Programs --University-based partnerships are defined by the USGS Water programs as the 56 grants awarded annually to 54 State Water Resources Research Institutes. These grants are awarded to the same universities at approximately the same time every year. |
The NRC program evaluation recommended that USGS do even more in reaching out and being responsive to our partners and customers. USGS continues to explore alternatives to the university based partnership measure to better capture cooperative activities. |
| Stakeholder meetings | Biology Programs -- Headquarters staff check all data before reporting
to the Bureau. Website allows entry and editing by only two headquarters
employees to prevent double entries or incorrect calculations. Geology Programs --Program Coordinator or Associate Program Coordinator provides title of meeting, location, and dates; obtains from teams or their own offices a copy of the agenda or other documentation; and reports meetings that meet the definition criteria. Geography Programs -- A single point of contact is established for the meeting; the Geography Chief of Staff is the responsible official. Consistent methods for stakeholder meeting data collection are applied and documented. Water Programs --At the time the quarterly data call is made, a detailed definition of what constitutes a stakeholder meeting is distributed to every reporting office/program each quarter. Offices/programs are asked to provide date, location, and purpose of meeting, and a list of participating agencies/groups/ individuals. GPRA discipline coordinator determines whether meetings should be classified as Hazards or Environment & Natural Resources, according to the stated purpose of each meeting and participating agencies. Offices and programs report only those meetings with a printed agenda, minutes, or other concrete documentation, for audit purposes. |
The NRC recommended that USGS do even more in reaching out and being responsive to our partners and customers. USGS has taken very positive steps with listening sessions and other venues to monitor those external voices. The strength of the USGS in large measure depends on the value that our customers and partners place on our science and the many ways in which our science impacts their work. USGS will continue to engage in more stakeholders meetings. This performance measure is an indicator of outreach. |
| Customer Satisfaction | Source data are individual responses to survey questions. All are fully documented. The different aspects of each product for which satisfaction ratings are sought are clearly and simply defined on the questionnaire. Both data entry and aggregation methodologies are documented and approved. | The respondents themselves validate the usefulness of the surveys. Quality assurance is handled by the survey manager and by the responsible program specialists and managers. |