ORDNANCE DETECTION AND
DISCRIMINATION STUDY WORK PLAN
APPENDIX A
SAMPLING AND DATA COLLECTION FORMS
TABLE OF CONTENTS
Form A-1: Static Test Record Form....................................................................................A-1
Form A-2: (Example) Detector Efficiency Scorecard.........................................................A-3
Form A-3: (Example) Comparison Chart for Detector Probability
of Detection and False Alarm Rates.............................................................A-4
Final Ordnance Detection and Discrimination Study Work Plan
FORM A-1
PROFILE RECORD FORM
ODDS STATIC TEST, FORT ORD
INSTRUMENT:_________________________________________________________________________________________________
MANUFACTURER
TYPE (digital, analog, audio)
MODEL
S/N
CONSOLE S/N:__________ SENSOR S/N: NO.1______________ COIL S/N: NO.1___________
NO.2______________
NO.2 ___________
BACKPACK S/N:__________ SEPARATION: ________________
TEST ITEM:
________________________________________________________________________________
CATEGORY
NOMENCLATURE, ITEM NO.:
AVERAGE
CONDITION
MARKINGS
MAG. SUSCEPTIBILITY, micro-cgs units____
________
RESISTANCE, ohms
Longitudinal__________
Transverse:________
GEOPHYSICIST IN
INSTR.
CHARGE_________________________________ OPERATOR____________________________
NAME,
COMPANY
NAME,
COMPANY
DATE____________
TEMP, F________
WIND: mph ________ R.H.,%
SOIL TYPE_______MOISTURE_______
Fort Ord magnetic declination = 15 degrees East; inclination = 61degrees North.
V. DISTANCE: ITEM TOP TO PLATFORM TOP:__________ft.
V. DISTANCE: PLATFORM TOP TO BOTTOM OF SENSOR:________ft.
INSTRUMENT READINGS
0 degrees azimuth = true north; 0 degrees inclination = horizontal, positive clockwise.
EM/
MAG
ITEM___________ AZIMUTH__________ INCLINATION_______ READING__________
(units)
BACKGROUND:
BACKGROUND:
ITEM
ITEM
ABSENT:_______
PRESENT:______
TIME:________
ITEM
ITEM
PRESENT_______
ABSENT________
END PROFILE TIME:_______
CHANGE IN BACKGROUND__________
Record Number:
START PROFILE TIME:_________
TIME:______
REPEAT THE PROFILES? Y/N?________
Profiles on Reverse?_____
A-1
Final Ordnance Detection and Discrimination Study Work Plan
PROFILE RECORD FORM (Continued)
ODDS STATIC TEST, FORT ORD
EM/
MAG
ITEM___________ AZIMUTH__________ INCLINATION_______ READING__________
(units)
BACKGROUND:
BACKGROUND:
ITEM
ITEM
ABSENT:_______
PRESENT:______
TIME:________
ITEM
ITEM
PRESENT_______
ABSENT________
END PROFILE TIME:_______
CHANGE IN BACKGROUND__________
START PROFILE TIME:_________
TIME:______
REPEAT THE PROFILES? Y/N?________
NOTES:
SUSCEPTIBILITY: KT-9 meter; RESISTIVITY, analog ohm-meter, probes.
Profile record form.xls
A-2
Final Ordnance Detection and Discrimination Study Work Plan
Form A-2 (Example)
Detector Efficiency Scorecard
Probability of Detection and False Alarm Rate
Instrument Type and Serial #:
Search Radius:
Name/Position of Person Assembling Data:
Category
Group A1
Total of All Groups
Actual Detected Missed
False
Scores
Actual Detected Missed
Scores
Alarms
PD2
FA Rate3
PD2
FA Rate3
I
20
16
4
10
80%
5/Acre
20
16
4
80%
5/Acre
II
22
16
5
20
73%
3/Acre
22
16
5
73%
3/Acre
III
16
14
2
6
88%
3/Acre
16
14
2
88%
3/Acre
IV
26
20
6
4
77%
1/Acre
26
20
6
77%
1/Acre
1
2
3
Additional columns will be added for subsequent groups (Groups B through E) as needed.
The PD rate is calculated as the number detected/ actual number
The FA Rate is calculated as the number of false alarms per acre (43, 265 square feet).
(e.g. 2 false alarms in a 100’ by 100’ grid would equate to a FA Rate of 8.6/Acre)
Note: A separate form will be used for each search radius of 1.6 feet and 3.3 feet.
A-3
Final Ordnance Detection and Discrimination Study Work Plan
Form A-3 (Example)
Comparison Chart for Detector
Probability of Detection and False Alarm Rates
Category
Composite
Search Radius
EM61
1.6 feet
PD
G-858
FA
Group A
GA-52
PS
FA
PD
FA
MK-26
PD
EM61
G-858 GA-52 MK-26
FA
I
80% 2/acre
92%
2/acre
76%
2/acre
76% 2/acre
80%
92%
76%
76%
II
80% 5/acre
92%
5/acre
76%
5/acre
76% 5/acre
80%
92%
76%
76%
III
80% 3/acre
92%
3/acre
76%
3/acre
76% 3/acre
80%
92%
76%
76%
IV
80% 1/acre
92%
1/acre
76%
1/acre
76% 1/acre
80%
92%
76%
76%
Category
Group B
EM61
Group C
G-858 GA-52 MK-26 EM61
Group D
G-858 GA-52 MK-26 EM61 G-858 GA-52 MK-26
I
80%
92%
76%
76%
80%
92%
76%
76%
80%
92%
76%
76%
II
80%
92%
76%
76%
80%
92%
76%
76%
80%
92%
76%
76%
III
80%
92%
76%
76%
80%
92%
76%
76%
80%
92%
76%
76%
IV
80%
92%
76%
76%
80%
92%
76%
76%
80%
92%
76%
76%
Note: A separate form will be used for each search radius of 1.6 feet and 3.3 feet.
A-4
ORDNANCE DETECTION AND
DISCRIMINATION STUDY WORK PLAN
APPENDIX B
SPECIFIC OE DETECTOR PROTOCOLS
Final Ordnance Detection and Discrimination Study Work Plan
TABLE OF CONTENTS
B1 HAND HELD MAGNETOMETER (HHM) CLEARANCE.................................................... B-1
B1.1 SEARCH LANES....................................................................................................... B-1
B1.2 MAGNETOMETER SEARCHES.............................................................................. B-1
B2 GEOPHYSICAL SEARCHES.................................................................................................. B-2
B2.1 DATA COLLECTION............................................................................................... B-2
B2.1.1 Data Collection Lines................................................................................. B-2
B2.1.2 Data Collection with the Digital EM Detectors.......................................... B-2
B2.1.3 Data Collection with the G-858.................................................................. B-4
B2.1.4 Collection of Magnetic Background Data.................................................. B-4
B2.2 DATA PROCESSING AND INTERPRETATION.................................................... B-5
B2.2.1 Validation of Data Sets............................................................................... B-5
B2.2.2 Processing of TDEM/FDEM Data.............................................................. B-5
B2.2.3 Processing of TFM Data............................................................................. B-6
B2.2.4 Processing of Magnetic Gradient Data........................................................ B-7
Final Ordnance Detection and Discrimination Study Work Plan
APPENDIX B
SPECIFIC OE DETECTOR PROTOCOLS
B1
B1.1
HAND-HELD MAGNETOMETER (HHM) CLEARANCE
Search Lanes
The search area will be divided into search lanes and will be marked using a string or other
suitable marking material. The string will be stretched from baselines established along the
north and south boundaries of the clearance area.
B1.2
Magnetometer Searches
Each lane will be searched in turn using each of the hand held flux-gate magnetometers and coin
detectors. The detectors will be placed at their highest sensitivity setting. The operator will
slowly move forward along the longitudinal axis of the search lane and will move the
magnetometer from side to side (the MK-26 will not be swung but held steady over the
centerline of the lane). As anomalous areas are encountered the magnetometer will generate a
change in aural tone, or in the case of the MK-26 a meter deflection, that is indicative of a buried
metallic object. The operator will further refine the position of anomalous areas by observing the
peak aural tones as the magnetometer is moved over the anomalous locations. The operator will
place a pin flag in the ground at the location at which the aural tone is the highest, or in the case
of the MK-26, the meter indicates the strongest signal, along the longitudinal and lateral points
across the anomalous area. The meter readings of the MK-26 detector will be recorded for each
anomaly. At the completion of the grid with a magnetometer, the locations of the pin flags will
B-1
Final Ordnance Detection and Discrimination Study Work Plan
be recorded using precision GPS and the flags removed. The procedures will then be repeated
with the other HHM.
B2
GEOPHYSICAL SURVEYS
Geophysical surveys will consist of collecting digital TDEM, FDEM, TFM and magnetic
gradient data, and interpretation and analysis of this data.
B2.1
Data Collection
The OE contractor will collect the digital data using a Geonics, Model EM61, Time Domain
Electro-Magnetic survey detector. TFM and magnetic gradient data will be collected using a
Geometrics, Model G-858 Magnetometer Cesium Vapor Magnetometer. To correct and remove
diurnal fluctuations from the TFM data, the contractor will record background magnetic field
data using a Geometrics, Model G-856 Precession Proton Magnetometer. The procedures that
the contractor will use to collect this data is described in the following subsections.
B2.1.1
Data Collection Lines
Geophysical survey data will be collected along individual data collection lines spaced at even
intervals. These lines will be marked using string or other suitable marking material. The lines
will be stretched from pre-marked baselines established along the north and south boundaries of
the survey area. In addition to the data collection lines, the OE contractor will install fiducial
control lines at twenty-five (25) foot intervals. These lines will be installed parallel to the
baselines and will be used to further refine the spatial coordinates of the geophysical data.
B2.1.2
Data Collection with the Digital EM Detectors
The OE contractor will collect the digital data using the EM61, EM61-HH, and GEM 3. The
cart-mounted configuration of the EM61 will be used with both coils to collect data and spatial
B-2
Final Ordnance Detection and Discrimination Study Work Plan
coordinates for collected samples will be generated by the detector’s on-board optical odometer.
A similar process will be used with the GEM 3. A separate digital file will be established for
each digital survey. The file name will consist of the numerical date and time at which the
survey began, and a suffix of “EM” to identify the data as being electromagnetic (EM)
(i.e., 311230EM). Within the data file a separate identifying line number will be established for
each data collection line. While keeping the detector centered over the data collection lines, the
operator will traverse the test area and collect the EM data. In addition to collecting the EM data
the operator will digitally tag the line records as the center of the detector passes over each
fiducial line.
The EM61-HH (handheld) is a high sensitivity high-resolution time-domain metal detector
capable of detecting both ferrous and nonferrous metallic objects. Unlike the cart-mounted unit
with its 1m x 1m detectors the handheld unit consists of 33 cm by 20 cm detectors. Its mode of
operation can be with or without the wheel. Without wheels the detector is used in a sweeping
mode in front of the operator where the detector collects readings at automatic time rates. With
the wheel assembly the operators pushes the detector in a more controlled in-line operation. In
the wheel mode the data collection rate can be adjusted to collect readings at every four inches or
eight inches. The HH also consist of two channels on the wheel mode, this allows responses to
be sampled at two positions along a decay curve. The two time gates allow discrimination of the
targets based on different response decay rate. The early channel detects targets with short and
long decay rate from small, medium and large targets while the late channel detects targets with
the longer time constant only (large targets). The HH provides excellent resolution for small
shallow targets but has decreased detection capabilities at greater depths as compared to the
standard EM61 unit. Due to the size of the detectors, the line spacing for the HH should be
B-3
Final Ordnance Detection and Discrimination Study Work Plan
between one to two feet intervals depending on the size of the suspected targets. The line
spacing would be the only operational change in regards to the grid layout. The functions of the
EM61-HH for data collection and data output are identical to the standard unit.
B2.1.3
Data Collection with the G-858
The OE contractor will collect both the TFM and magnetic gradient data using a G-858
Magnetometer. The OE contractor will employ the G-858 in the Magnetic Gradiometer mode
and will collect data from both the lower and upper detector as independent channels. A separate
digital file will be established for each G-858 survey. The file name will consist of the numerical
date and time at which the survey began and a suffix of “MG” to identify the data set as
magnetic gradiometer data (i.e., 311230MG). Within the data file a separate identifying line
number will be established for each data collection line. The bottom detector will be kept at a
constant height above ground level, as close to the ground surface as practicable, and centered
over the data collection lines. The top sensor will be placed 24” above the bottom sensor. The
operator will traverse the test area and collect the magnetometer data. In addition to collecting
this data the operator will digitally tag the line records as the center of the detector passes over
each fiducial line.
B2.1.4
Collection of Magnetic Background Data
During operations the OE Contractor will use a Geometrics, Model G-858 or G-856
magnetometer to collect and record fluctuations in the ambient magnetic field. Prior to the start
of the TFM and magnetic gradiometer surveys the G-858 or G-856 will be placed into operation
and will digitally record the ambient magnetic field at 1 second intervals. This data will be
logged to a digital file using the date and time that the file is opened, with a suffix of “BM” to
identify it as base reference magnetometer data (i.e., 311230BM).
B-4
Final Ordnance Detection and Discrimination Study Work Plan
B2.2
Data Processing and Interpretation
The OE contractor will use Geosoft’s Oasis Montage Software to analyze and interpret the
collected geophysical survey data.
Output from this analysis will be used to identify any
anomalous areas that require further investigation. If anomalous areas are identified, the OE
contractor will investigate them using the procedures described in Section 3.3.3 of this study.
The final geophysical data set will then be independently interpreted/evaluated by the
Government and/or a commercial firm specializing in the interpretation and analysis of EM,
TFM and magnetic gradient data. The purpose of this independent evaluation is to provide a
quality assurance analysis of the data processing and interpretation process.
To perform its analysis of the geophysical data, the OE contractor will use Geosoft Oasis
Montage Software. This software is specifically designed for interpretation of TDEM/FDEM,
TFM, and magnetic gradient digital data sets. The OE contractor will interpret the data using the
following procedures outlined in the following subparagraphs.
B2.2.1
Validation of Data Sets
The OE contractor begins data interpretation process by verifying the validity of the collected
data sets. This is accomplished by overlaying the individual data samples on a standardized grid.
The results are checked to ensure that the data is accurately positioned along the predetermined
survey lines, match the site dimensions, and properly fits within the site and fiducial marks. In
addition to these checks, TFM and BM data is checked for proper digital date/time stamping.
B2.2.2
Processing of TDEM/FDEM Data
The validated EM data is imported into the interpretative software and displayed in tabular,
survey line graphic, and color contoured formats.
The interpretation process begins by
establishing a standard background for the entire site. This is extrapolated by analyzing the
B-5
Final Ordnance Detection and Discrimination Study Work Plan
overall site data and determining the value of areas that are obviously free of metallic debris.
This background value is then removed from the data set. Following this adjustment anomalous
areas are identified using the contour drawing. Each anomalous area is then evaluated using both
the tabular listing and line graphics of the geophysical samples taken across the anomalous areas.
Using this approach individual targets and their spatial coordinates are extracted from the data.
This target data is then exported as a target listing that contains a unique anomaly number,
spatial coordinates and target classification. This process continues until all targets are identified
and the target listing is complete. For EM61 survey data this analysis is performed for samples
obtained from the lower coil, upper coil, and the differential between the readings of the upper
and lower coil. Using this approach ensures that the maximum number of anomalies is extracted
from a given data set.
B2.2.3
Processing of TFM Data
The validated TFM data sets are corrected for diurnal fluctuations using Geometrics
MAGMAPPER software. This software is designed to remove the ambient background from
each TFM sample collected by the G-858 detector. The resultant data set represents only the
magnetic field changes that are caused by anomalous objects contained within the survey area.
Following this adjustment anomalous areas are identified using the contour drawing. Each
anomalous area is then evaluated using both the tabular listing and line graphics of the
geophysical samples taken across the anomalous areas. Using this approach individual targets
and their spatial coordinates are extracted from the data. This target data is then exported as a
target listing that contains a unique anomaly number, spatial coordinates and target classification.
This process continues until all targets are identified and the target listing is complete. As the
data set was collected with the G-858 configured in the gradiometer mode an independent
B-6
Final Ordnance Detection and Discrimination Study Work Plan
evaluation will be performed for both the upper and lower detectors. Processing and evaluation
of magnetic gradient data is discussed below. Using this approach the maximum amount of data
can be extracted from the data set.
B2.2.4
Processing of Magnetic Gradient Data
Magnetic gradient data, which is calculated from the top and bottom readings of TFM data sets,
is imported into the Geosoft interpretative software and displayed in tabular, survey line graphic,
and color contoured formats. The interpretation process begins by displaying and analyzing the
magnetic gradient data in a contour drawing to identify anomalous areas. Each anomalous area
is then evaluated using both the tabular listing and line graphics of the geophysical samples taken
across the anomalous areas.
Using this approach and individual targets and their spatial
coordinates are extracted from the data. This target data is then exported as a target listing that
contains a unique anomaly number, spatial coordinates and target classification. This process
continues until all targets are identified and the target listing is complete.
B-7
ORDNANCE DETECTION AND
DISCRIMINATION STUDY WORK PLAN
APPENDIX C
QUALITY ASSURANCE/QUALITY CONTROL
Final Ordnance Detection and Discrimination Study Work Plan
TABLE OF CONTENTS
C1 INTRODUCTION....................................................................................................................... C-1
C2 DATA QUALITY OBJECTIVES............................................................................................... C-1
C3 QUALITY PROCEDURES......................................................................................................... C-1
C3.1 EQUIPMENT.............................................................................................................. C-1
C3.1.1 Pre-Operational Checks............................................................................... C-2
C3.1.2 Post-Operational Checks..............................................................................C-3
C-4 GEOPHYSICAL DATA........................................................................................................... C-3
C4.1 INDEPENDANT REVIEW......................................................................................... C-4
C4.2 SELECTION OF ADDITIONAL TARGETS............................................................. C-4
C5 INSPECTION OF COMPLETED WORK.................................................................................. C-4
C5.1 RAMDOM SAMPLING..............................................................................................C-5
C5.2 CONFIRMATORY EXCAVATION...........................................................................C-5
C5.3 COMPARITIVE REVIEW OF RECOVERED ITEMS AND
INSTRUMENT READINGS...................................................................... C-6
C6 SUMMARY................................................................................................................................. C-7
Final Ordnance Detection and Discrimination Study Work Plan
C1
INTRODUCTION
The procedures in the section describe the controls that will be used to ensure the work is
accomplished in an effective manner. These controls are based on quality objectives and are
designed to ensure that adequate inspections and checks are conducted on the critical aspects of
the work.
C2
DATA QUALITY OBJECTIVES
The data quality objectives (DQOs) associated with this work are as follows:
•
To ensure that the tools, sensors, and equipment used to accomplish the work are fully
functional and reliable
•
That the geophysical data is collected in a manner that yields high quality data sets
•
That the interpreted geophysical data yields a complete listing of potential OE items
•
That the results of this process are repeatable and verifiable.
C3
QUALITY PROCEDURES
The quality procedures for this study consist of inspection/checks of equipment, reviews and
verification of interpreted geophysical data, and inspection of completed work. The following
subsections describe these procedures in greater detail.
C3.1
Equipment
The quality of geophysical data sets is dependent on the operational capabilities of the equipment
used. To ensure that equipment is fully capable and will perform in accordance with the
C-1
Final Ordnance Detection and Discrimination Study Work Plan
manufacturer’s specifications, the OE contractor will perform pre-operational and postoperational checks. Following these checks, any equipment that is found unsuitable will be
immediately removed from service and the OE Quality Control Specialist and USACE OE
Safety Specialists will conduct an investigation to determine the impact of failure on completed
work and the need to rework previously worked areas.
C3.1.1
Pre-Operational Checks
Operators will follow the manufacturer’s published procedures for placing operating equipment.
In addition, the equipment will receive a functional check to ensure it is operating in accordance
with published standards.
C3.1.1.1
Geophysical Instruments
Upon initial receipt of the EM61s (cart mounted and hand held) and the G-858s, the instruments
will be placed into operation, in accordance with the manufacturer’s specifications. Following
this initial inspection the instrument will be assigned a test sample identified during Static Test
(Section 2) and the instrument reading will be compared to a reading previously recorded for that
sample. This test sample will remain with the instrument throughout its time on-site. As part of
the pre-operational check for the instrument, the instrument will be placed over a permanent test
point, the test sample will be centered under the instrument, and the digital reading will be
recorded. Should the reading deviate more than ±10% of the test sample value, the instrument
will be removed from service.
C3.1.1.2
Schonstedt Magnetometers
Prior to use all magnetometers will be checked and/or calibrated against a test item identified
during static testing. The purpose of this test/calibration is to ensure that the instruments are
operating properly and to appropriately adjust the sensitivity level of the instruments. A
C-2
Final Ordnance Detection and Discrimination Study Work Plan
checkpoint will be established by burying a 105mm inert projectile (or test item identified during
static testing) at a depth of 4 feet. Magnetometers will be checked against these sources to ensure
they are operational and capable of detecting ferrous objects at the depth specified. This test will
be performed prior to placing the instrument into operation. To ensure that instruments remain
operational during field operation, they will be checked daily during field tests.
C3.1.1.3
Precision GPS
At least twice per day, once in the morning and once in the afternoon, the operator will check the
accuracy of the GPS receiver against a known reference point. The operator will compare the
GPS coordinates against the coordinates of the reference point. The difference between these
coordinates must remain within the range of ± .25m. Instruments that fail this test will be
removed from service until such time as the malfunction is identified and corrected.
C3.1.2
Post-Operational Checks
Daily, upon completion of field operation, all equipment will be inspected to ensure it is
complete and serviceable, and is shut down in accordance with the procedures identified by the
manufacturer. Operators will report any damaged equipment, unusual wear or missing
components. Additionally, the batteries will be removed from battery powered equipment and
the batteries will be placed on charge. These procedures will ensure the equipment is serviceable
for the next day’s operation and that the batteries are fully charged.
C4
GEOPHYSICAL DATA
To ensure the quality of the geophysical data interpretation the OE contractor will perform
independent reviews of the processed data, have its OE Quality Control Specialists select
C-3
Final Ordnance Detection and Discrimination Study Work Plan
additional target anomalies, perform detailed inspections of completed grids, and post-excavation
comparisons of the recovered items against the output from the geophysical survey instruments.
C4.1
Independent Review
A second person will reanalyze a minimum of 10% of the interpreted geophysical data. The
results of this analysis will be compared to the original analysis for accuracy. The on-site
Geophysicist will resolve any conflicts between these analyses. In addition to resolving these
conflicts, the Geophysicist will review the operator’s previously processed data to determine the
extent of the problem. Any suspect data sets will be reviewed by a second person.
C4.2
Selection of Additional Targets
To ensure the target selection parameters are correct, the OE contractor’s On-Site Quality
Control Specialist will select additional anomalies that did not meet the target criteria, from the
geophysical data sets. At a minimum, the QC Specialist will select 10 anomalies per grid or 10%
of the target count for that grid, whichever is greater. These anomalous locations will be
excavated/investigated and the results will be reported back to the on-site Geophysicist. If OE
items are encountered, a complete review of the data collection and interpretation process will be
conducted by the Geophysicist. As a result of this review, the Geophysicist will document
whether the collection and interpretation process needs to be modified, if corrective actions are
necessary, or if the processes are being performed to their optimal capabilities.
C5
INSPECTION OF COMPLETED WORK
As work is completed on each grid the OE contractor’s QC Specialist will physically inspect the
grid and will randomly sample the grid to ensure remaining metallic items are not OE, and with
C-4
Final Ordnance Detection and Discrimination Study Work Plan
concurrence of the government will excavate selected areas to confirm the results of the
geophysical survey.
C5.1
Random Sampling
The OE QC Specialists will inspect each completed grid. This inspection will be performed
using a hand-held magnetometer. During the inspection, the OE QC Specialist will identify the
locations of metal debris using a metal detecting device. The OE QC Specialist will excavate a
portion of these items to verify that they are general debris and not OE items. At a minimum the
OE QC Specialist will excavate at least 10 items or a number equal to 10% of the target count,
whichever is greater. If an OE item is encountered, the OE QC Specialist will report his/her
findings to all pertinent project personnel, including the on-site Geophysicist. The Geophysicist
will document whether the collection and interpretation processes need to be modified, if
corrective actions are necessary, or the processes are being performed to their optimal
capabilities. If it is found that the interpretation processes need modifying, or corrective actions
are identified, all data processed previously will be re-evaluated under these new guidelines.
C5.2
Confirmatory Excavation
Selected portions of a grid will be excavated to confirm that all OE items have been identified
and excavated. The grid will be subdivided into 10’ x 10’ squares. The OE QC Specialist and the
government’s Safety Specialist will then select two or more of these squares for excavation. The
area will be excavated to a depth of at least four (4) feet and as the spoil is removed:
•
It will be laid out in layers not to exceed 6 inches in depth
•
Checked with a hand-held magnetometer
•
All metallic items detected will be visually inspected and cataloged.
C-5
Final Ordnance Detection and Discrimination Study Work Plan
If an OE item is encountered, the OE QC Specialist will report his/her findings to all pertinent
project personnel, including the on-site Geophysicist. The Geophysicist will document whether
the collection and interpretation processes need to be modified, if corrective actions are
necessary, or the processes are being performed to their optimal capabilities. If it is found that
the interpretation processes need modifying, or corrective actions are identified, all data
processed previously will be re-evaluated under these new guidelines.
C5.3
Comparative
Readings
Review
of
Recovered
Items
and
Instrument
To ensure the excavated anomalies represent the target item(s) identified during interpretation of
the geophysical data, the On-Site Geophysicist will review the description(s) of recovered items
with the sensor readings and the results of the Static Test and obtained during the geophysical
survey. This review will focus on verifying that the recovered item is appropriate in size and
shape to have generated the survey instrument reading. The OE contractor will also subcontract
to a separate geophysical firm to analyze the data and compare the results to the on-site
interpretation. Items that do not favorably match the data or vary significantly from the on-site
interpretation will be recorded and these target locations will be reinvestigated and the
discrepancy resolved.
As part of this review, the OE QC Specialist will collect, or will oversee the collection of , data
over 10% of the geomapped anomalies to verify the targets were removed. Data over these
locations will be collected using each instrument fielded at the Field Trial Site and which
detected the anomaly targeted for excavation. Instances where the OE QC Specialist believes the
target anomaly is still present (based on his or her interpretation of the data collected) will be
flagged on the ground and excavated following the protocols in Section 3.3.3 of this work plan.
C-6
Final Ordnance Detection and Discrimination Study Work Plan
The findings of the excavation, the OE QC Specialist’s data, and the original data in such areas
will be reviewed and compared by the on-site Geophysicist. The Geophysicist will document
whether the collection and interpretation processes need to be modified, if corrective actions are
necessary, or if the processes are being performed to their optimal capabilities. If it is found that
the interpretation processes need modifying, or corrective actions are identified, all data
processed previously will be re-evaluated under these new guidelines.
C6
SUMMARY
These QA/QC procedures are designed to ensure the critical components of the process are
inspected before, during and after operations are performed. Application of these procedures will
ensure the work performed is of high quality and meets the objectives of this study.
C-7
ORDNANCE DETECTION AND
DISCRIMINATION STUDY WORK PLAN
APPENDIX D
DQO WORKSHEET
August 18, 1999
TABLE OF CONTENTS
STEP 1: STATE THE PROBLEM.......................................................................... D-1
STEP 2: IDENTIFY THE DECISION................................................................................ D-2
STEP 3: IDENTIFY THE INPUTS TO THE DECISION.................................................. D-3
STEP 4: DEFINE THE BOUNDARIES OF THE STUDY.................................................D-3
STEP 5: DEVELOP A DECISION RULE...........................................................................D-4
STEP 6: SPECIFY LIMITS ON DECISION ERRORS...................................................... D-5
STEP 7: OPTIMIZE THE DESIGN.....................................................................................D-6
August 18, 1999
Final Ordnance Detection and Discrimination Study Work Plan
APPENDIX D
DQO WORKSHEET
This appendix contains the worksheet that was used to develop DQO’s based on the EPA seven
step process.
DQO WORKSHEET
Date of Creation:
3/25/99
Revision No.:
6.0 (4/21/99)
QA Reviewer’s Initials:
Site Name:
Fort Ord
Location:
Fort Ord, CA
Project Title:
Ordnance Detection Study
STEP 1:
STATE THE PROBLEM
A. Planning Team Members: See CESPK-ED-EF/jk/25 March,
1999/c:\TEMP\OE_RIFS_Prog_02.doc.
B. Decision Maker:
Darrin Rodischen
Gail Youngblood
C. Available Resources: HNC, HLA, California State University, Sacramento, TERC I,
CRREL
D-1
August 18, 1999
Final Ordnance Detection and Discrimination Study Work Plan
D. Relevant Deadline:
4/30/99
E. Concise Description of the problem: For selected geophysical instruments, the
problem is to determine the maximum depth of detection under Fort Ord site and OE
specific conditions.
STEP 2:
IDENTIFY THE DECESION
A. Identify the Principal Study Question: Is the depth of detection equal to or greater
than the maximum depth of penetration?
B. Alternative Actions (that could result if principal study question is resolved):
B.1.
Resolutions: Yes, the 90% exceedance depth of detection is equal to or
greater than the maximum depth of penetration? NO, 90% exceedance depth
of detection is not equal to or greater than the maximum depth of
penetration?
B.2.
Possible Actions: Declare area UXO cleared; do not require deed restrictions.
Declare area not UXO cleared and place deed restrictions, conduct removal
actions.
B.3.
Decision Statement: Determine whether the maximum depth of detection
relative to the maximum depth of penetration supports declaring an area
cleared and/or having limited or no OE deed restrictions.
D-2
August 18, 1999
Final Ordnance Detection and Discrimination Study Work Plan
STEP 3:
IDENTIFY THE INPUTS TO THE DECISION
A. Identify the informational inputs needed to resolve the decision - Maximum depth of
penetration for a variety of OE items encountered at Fort Ord.
B. Identify sources for each informational input - Phase II EE/CA and revised penetration
studies.
C. Identify the information that is needed to establish the action level - The action level
is the percentage of items that can be detected for a specified OE item at a specified
depth.
D. Identify potential sampling techniques and appropriate instruments - The instruments
that will be assessed include magnetometers and Electro-magnetometers. Section 2.1
identifies instruments that will be employed to collect data.
STEP 4:
DEFINE THE BOUNDARIES OF THE STUDY
A. Define the spatial boundary of the decision statement - The boundaries of the study
will be limited to the boundaries of the seeded test site and actual OE sites.
B. Specify the characteristics that define the population of interest - Surface soils (0-6
inches) and subsurface soils (1-10 feet bgs)
C. Define the temporal boundary of the decision statement –
C.1.
Determine the time frame to which the decision statement applies - It will
D-3
August 18, 1999
Final Ordnance Detection and Discrimination Study Work Plan
be assumed that the sampling data will represent both current and future
detection capabilities.
C.2.
Determine when to collect data - Restricted access, the OE items do not
pose a immediate threat to humans or the environment. Moreover, the OE items
are not subject to change in short time periods and characteristics of the OE item
do not warrant any temporal constraints. To expedite the decision all data will be
reported within 5 working days of sampling.
C.3.
Identify practical constraints on data collection - the most practical
consideration is the ability to take instrument readings from areas of heavy
vegetation or steep slopes. Brush clearing and appropriate instrument selection is
possible solutions to these problems.
STEP 5:
DEVELOP A DECISION RULE
(1) Specify the parameter of interest - The maximum and minimum depths of detection.
(2) Specify the action level for the study - Instrument must detect 90% of buried OE
targets at specified minimum depths of detection; and must be able to locate buried
OE target within 5 feet of actual anomaly locations.
(3) Develop a decision rule - If a instrument detects 90% of buried OE targets at the
specified minimum depths and locates the buried OE targets within 5 feet cm for 95
percent of actual locations, then that instrument will be considered for inclusion in the
matrix of OE detectors that may be used at future OE sites.
D-4
August 18, 1999
Final Ordnance Detection and Discrimination Study Work Plan
STEP 6:
SPECIFY LIMITS ON DECISION ERRORS
(1) Determine the possible rage of the parameter of interest - The possible range of
depths of detection is expected to be from surface to 10 feet below ground surface.
(2) Define both types of decision errors and identify the potential consequences of each 2.1 Deciding that a instrument can detect an OE item at a specified depth when it
truly can not detect the item. The consequence of this error is that OE item will
not be detected and human health will be endangered. Decision error (2.1) is the
more severe decision error.
2.1.1 The true state of nature for decision error (2.1) is that the instrument can
not detect the item.
2.2 Deciding that a instrument can not detect an OE item at a specified depth when it
truly can detect the item. The consequence of this error is that time and energy
will be spent on additional sampling. The consequences, therefore, are far less
severe than consequences of decision error (2.1).
2.2.1 The true state of nature for decision error (2.2) is that the instrument can
detect the OE item.
(3) Define the true state of nature for each decision error as the baseline condition or null
hypothesis and define the true state of nature for the less severe decision error at the
alternative hypothesis.
3.1 Null Hypothesis, Ho = Instrument cannot detect OE item (the signal of an
instrument is not significant)
3.2 Alternative Hypothesis, Ha = Instrument can detect OE item (the signal of an
D-5
August 18, 1999
Final Ordnance Detection and Discrimination Study Work Plan
instrument is significant).
(4) Assign the terms “false positive” and “false negative” to the proper errors.
4.1 False positive error = Decide instrument can detect OE item when it truly can not
detect the item. A false positive signal or target is one where there is no apparent
OE item to be detected.
4.2 False negative error = Decide instrument can not detect OE item when it truly can
detect the OE item.
(5) Specify a range of possible values of the parameter of interest where consequences of
decision errors are relatively minor (gray region).
5.1 The gray region has been set between five and seven feet below ground surface.
5.2 Assign probability values that reflect tolerable probability for the occurrence of
decision errors.
5.2.1 Tolerable False Positive Decision Error Rate: Set a rate of 20% for the
probability of a false positive error.
5.2.2 Tolerable False Negative Decision Error Rate: Set a rate of 30% for the
probability of a false negative error.
STEP 7:
OPTIMIZE THE DESIGN
In this step, statistical techniques were used to develop alternative data collection designs
and evaluate their efficiency in meeting project DQOs. To develop the optimal design for
this study, it will be necessary to reevaluate design optimization more than once after
D-6
August 18, 1999
Final Ordnance Detection and Discrimination Study Work Plan
revisiting previous steps in the DQO process. A statistician will accomplish this reevaluation.
(1) Develop general sampling and analysis design alternatives - A systematic sampling
method using grid samples will be used to determine whether or not the instrument
can detect the OE item of interest at the depths of interest.
1.1 Samples will be taken in a square-shaped grid pattern. The statistician will
determine the distance between samples.
1.2 The number of samples needed to detect OE items within a pre-specified
confidence limit will be determined by the statistician.
(2) Select the most resource-effective design that satisfies all of the project DQOs Initially a systematic sampling method will be employed.
(3) Document the operational details and theoretical assumptions of the selected design •
The definition of detection is clear and unambiguous
•
Depths greater than 10 feet bgs will not be evaluated
•
Mathematical distribution of signal strength is unknown
Individuals proficient in the use of said instruments will operate Instruments
D-7
August 18, 1999
***DRAFT***
ORDNANCE DETECTION AND
DISCRIMINATION STUDY WORK PLAN
APPENDIX E
SELECTION OF GEOPHYSICAL INSTRUMENTS
FOR THE FORT ORD ORDNANCE DETECTION STUDY
E-1
***DRAFT***
SELECTION OF GEOPHYSICAL INSTRUMENTS FOR THE FORT ORD ORDNANCE DETECTION
STUDY
Roger Young, PG
US Army Engineering & Support Center, Huntsville
November 30, 1999
House Resolution (H.R.) 2401 and H.R. 3116 directed the establishment of a program to demonstrate
and evaluate advanced technologies and systems that can be used to characterize and remediate active
and formerly used defense sites. In June 1993 the US Army environmental Center (USAEC) began a
series of demonstration site and live site tests to comply with the mandate. During that time a great many
ground-based and airborne geophysical systems have been evaluated for their ability to detect buried
UXO. The results of these tests are documented in a series of reports issued by AEC.
It is important to note that each test round had different targets sets buried at the site. Therefore,
detection rates between different locations and test rounds cannot be directly compared.
However,
detection rates have clearly improved over the last five years to the point where detection rates in excess
of 90% are achievable at test sites devoid of large amounts of frag and other metallic clutter. Detection
rates in excess of 70% are achievable at “live sites”.
The execution and scoring of geophysical systems at demonstration and live sites is complex. Careful
study of the AEC and other reports is necessary for a full understanding. However, the following tables
summarize detection results from several tests. The most notable result is that all effective detection
systems were ground-based.
Airborne systems were ineffective.
Furthermore, the ground-based
systems must travel directly over the area to be investigated; ground-based standoff systems are also
ineffective. This means that any terrain that must be investigated for buried UXO must be flat enough
and devoid of vegetation enough for the system to traverse it while maintaining a precise and correct
navigational “fix”. The trade-off between site preparation/suitability and probability of detection of UXO
has not been formally measured.
E-2
***DRAFT***
JPG Phase I Demonstration Site - 1994
(Top 5)
Sensor
Geo-Centers
ADI
UXB
Coleman
Metratek
1
STOLS/hybrid magnetometer
array
TM-4 Cesium Vapor
Magnetometer
Schonstedt GA-52B Fluxgate
magnetometer/
Foerster Mk26 Fluxgate
magnetometer
Ground Penetrating Radar plus
Electromagnetic Detector
Ground Penetrating Radar plus
EM-61 Electromagnetic Detector
Notes
Ordnance
Detection
Ratio
46%
False
Alarm
Ratio
1.33
45%
2.8
42%
1.51
Did not map entire
site
39%
5.2
31%
1.95
Did not map entire
site
Did not map entire
site
Full detection score given to items mapped at 2 meters or closer to correct location
Source: “Evaluation of Individual Demonstrator Performance at the Unexploded Ordnance Advanced Technology
Demonstration Program at Jefferson Proving Ground (Phase I)”, US Army Environmental Center Report SFIM-AECET-CR-95033, dtd. March 1995.
JPG Phase II Demonstration Site- 1995
(Top 5)
Sensor
Parsons
Geometrics
Geo-Centers
Geophex
ADI
1
EM-61 Electromagnetic Detector
G-858 Cesium Vapor
Magnetometer plus Ground
Penetrating Radar
STOLS G-858 Cesium Vapor
Magnetometer Array plus EM-61
Electromagnetic Detector plus
Schiebel Electromagnetic Sensor
Array
G-858 Cesium Vapor
Magnetometer Array plus
Geophex GEM-2 Electromagnetic
Senor Array
TM-4 Cesium Vapor
Magnetometer plus EM-61
Electromagnetic Detector
Probability
of
1
Detection
85%
83%
False
Alarm
Ratio
4.68
3.96
72%
20.7
71%
3.41
65%
9.35
Notes
Full detection score given to items mapped at 2 meters or closer to correct location
Source: “Unexploded Ordnance Advanced Technology Demonstration Program at Jefferson Proving Ground (Phase
II)”, US Army Environmental Center Report SFIM-AEC-ET-CR-96170, dtd. June 1996.
E-3
***DRAFT***
JPG Phase III Demonstration Site- 1996
(Top 5)
SCA/Geometrics
Naeva
GeoCenters
Blackhawk
Geometrics
Geophex
1
Sensor
Probability
of Detection
EM-61 Electromagnetic Detector
EM-61 Electromagnetic Detector
plus Scintrex SM-4 Cesium Vapor
Magnetometer
STOLS Array of G-822 Cesium
Vapor Magnetometers plus EM-61
Electromagnetic Detectors
G-858 Cesium Vapor
Magnetometer plus EM-61
Electromagnetic Detector
GEM 3 plus G-858 Cesium Vapor
Magnetometer
96%
94%
False
Alarm
Ratio
3.06
1.94
93%
5.18
90%
3.0
77%
3.11
Notes
Full detection score given to items mapped at 2 meters or closer to correct location
Source: “Live Site Unexploded Ordnance Advanced Technology Demonstration Program”, US Army Environmental
Center Report SFIM-AEC-ET-CR-96171, dtd. June 1996.
E-4
***DRAFT***
Live Site Demonstrations - 1996
(Top 5)
Vallon – (Eglin Air
Force Base)
Array of Vallon EL1302A1
Flux-gate Magnetometers
74%
False
Alarm
Ratio
NA
Australian Defense
Industries –
(Jefferson Proving
Ground)
Dual TM-4 Cesium Vapor
Magnetometers
71%
NA
Geo-Centers
(Yuma Proving
Ground)
STOLS Array of G-822
Cesium Vapor
Magnetometers
60%
NA
Coleman (Eglin
Proving Ground)
Array of EM-61
Electromagnetic Detectors
plus ground penetrating
radar
55%
NA
Metratek (McChord
AFB)
Array of EM-61
Electromagnetic Detectors
plus ground penetrating
radar
30%
NA
Sensor
1
Probability of
1
Detection
Notes
Of the 47 locations that
were excavated during
validation activities, 32
contained ordnance, 3
contained non-ordnance,
and the remaining 12
contained no discernable
man-made materials.
Of the 43 locations that
were excavated during
validation activities, 1
contained ordnance, 22
contained non-ordnance,
and the remaining 20
contained no discernable
man-made materials.
Of the 40 locations that
were excavated during
validation activities, 1
contained ordnance, 2
contained non-ordnance,
and the remaining 37
contained no discernable
man-made materials.
Of the 40 locations that
were excavated during
validation activities, 31
contained ordnance, 1
contained non ordnance,
and the remaining 8
contained no
discernable man-made
materials.
Of the 40 locations that
were excavated during
validation activities, 1
contained ordnance, 2
contained non-ordnance,
and the remaining 37
contained no discernable
man-made materials.
Most firms achieved average accuracy of better than 1 meter.
Source: “UXO Technology Demonstration Program at Jefferson Proving Ground, Phase III”, US Army Environmental
Center Report SFIM-AEC-ET-CR-97011, dtd. April 1997.
E-5
***DRAFT***
Ft. McClellan Live Site - 1999
(Top 4)
Sensor
Firm A
EM-61 Electromagnetic Detector
Probability
of
1
Detection
73%
Firm B
Firm C
Firm D
EM-61 Electromagnetic Detector
EM-61 Electromagnetic Detector
EM-61 Electromagnetic Detector
69%
65%
39%
1
False
Alarm
Ratio
1.54
Notes
See note 2
1.38
6.16
3.24
See note 2
See note 2
See note 2
Full detection score given to items mapped at 1 meter or closer to correct location
2
Detectors evaluated on-site, but rejected by geophysical contractors included: G-858 cesium vapor total field
magnetometer and gradiometer, Geonics EM-61 handheld; Geonics EM-61-3D; Schonstedt GA52-CX & GA72-CV
flux-gate gradiometers; White All-Metals Detectors; Vallon All-Metals Detectors.
Source: Unpublished Source Selection Board data, US Army Engineering and Support Center, Huntsville, November
1999
Ft. Ritchie Test Plot – Nov 1999
Sensor
1
False
Alarm
Ratio
0.06
Probability
of
1
Detection
16/16 =
100%
14/16 =
88%
16/16 =
100%
15/16 =
94%
Not
Calculated
IT
EM-61 Electromagnetic Detector
IT
EM-61hh Electromagnetic Detector
IT
IT
Scintrex Smartmag Cesium Vapor
Magnetometer
Schonstedt GX52a
IT
Lobo EM hand-held metal detector
8/16 =
50%
Not
Calculated
IT
White EM hand-held metal detector
10/16 =
63%
Not
Calculated
Notes
0.68
1.44
FAR not calculated.
“Significant
numbers” of non-OE
anomalies were
reported.
FAR reported as
“less sensitive to hot
rocks than the
Schonstedt”
Instrument
“performed similarly
to the Lobo, but with
somewhat better
results”
Full detection score given to items mapped at 2 feet or closer to correct location
Source: “Fort Ritchie OE Geophysical Prove-out Results” IT Group Memorandum to US Army Engineer District,
Baltimore, 17 November 1999
E-6
***DRAFT***
All of the successful systems used at these sites consist of one or more of the following technologies
types:
•
Cesium vapor magnetometers
•
Time-domain electromagnetic metal detectors
•
Frequency-domain electromagnetic metal detectors
•
Multifrequency electromagnetic detectors
•
Flux-gate magnetometers
•
Ground-penetrating radar (GPR)
During the earlier phases of tests, many systems were fielded that attempted to “fuze” geophysical data
sets from dissimilar instruments (e.g., mag + GPR, mag + EM). However, these attempts have not been
particularly successful.
In addition, many of the systems tested consisted of “arrays” of multiple
instruments of a single type. Some of these attempts (e.g. STOLS cesium vapor mag arrays) have been
very successful and should be considered whenever terrain & vegetation do not constrain the array’s use.
When designing the ODDS for Ft. Ord, geophysical instruments representing each of the successful
technologies were considered. This was done subjectively, not as part of a formally scored matrix. The
following table summarizes the results:
E-7
***DRAFT***
GEOPHYSICAL DETECTION TECHNOLOGIES CONSIDERED FOR EVALUATION AT ODDS
Technology
Effectiveness
Cesium Vapor
Magnetometers
High:
CV Mags have been the detector
used in several highly ranked
geophysical systems.
Time-Domain
Electromagnetic
Metal Detectors
High:
TD electromagnetics have been the
detector used in several highly
ranked systems.
Frequency-Domain
Electromagnetic
Metal Detectors
Medium:
FD electromagnetics have NOT
been the primary detector in any
highly ranked systems. However,
other experience shows that they
are very good at detecting small
items. They are not good detectors
for deeply buried, single items.
They can detect non-ferrous items
undetectable by mags.
Medium:
The GEM 2/3 was a primary
detector in two highly ranked
systems. However, they were never
the highest ranked systems.
Multifrequency
electromagnetic metal
detectors
Flux-Gate
Magnetometers
Medium:
Flux-gate mags have been used as
the primary detector in some highly
ranked systems.
Ground Penetrating
Radar
Low:
Although a number of systems
utilized ground penetrating radar as
a detector, GPR was never
successful as a stand-alone system.
Implementability
Cost
Medium:
CV Mags are relatively light and
compact and can be easily used in
open areas. In areas of difficult terrain
or vegetation it is difficult to maintain a
correct navigational fix. CV mags are
widely available from a variety of
sources.
Medium:
These instruments typically utilize a
transceiver coil 1 meter square but
smaller versions are also available. It
is easy to use the instrument in open
areas but difficult to use it in areas of
difficult vegetation or terrain. The
most commonly used instrument is
widely available.
High:
Mine/coin detectors are light and
compact. They can be used in any
traversable terrain. Instruments are
widely available from a variety of
sources.
Average in
typical terrain.
Much below
average when
towed arrays can
be used.
Medium:
These instruments are relatively light
and compact and can be easily used
in open areas. In areas of difficult
terrain or vegetation it is difficult to
maintain a correct navigational fix.
Only a limited number of instruments
are available.
High:
Flux-gate mags are light and compact.
They can be used in any traversable
terrain. Instruments are widely
available from a variety of sources.
Low:
These instruments are large, bulky
and slow. They are difficult to use in
any but the easiest terrain.
Instruments are widely available from
a variety of sources.
Representative
Instruments
Geometrics G-858
Geometrics G-822
Scintrex
Notes
Digital signal should be c0registered with navigational
data for best results.
Average in
typical terrain.
Below average
when towed
arrays can be
used.
Geonics EM-61
Geonics EM-61 hh
Digital signal should be coregistered with navigational
data for best results.
Higher than
average cost in
typical terrain.
Instruments are
slow and can
detect very small
items.
ANPSS-12
White
Fisher
Garrett
The analog output is not
usually co-registered with
navigational data.
Average in
typical terrain.
GEM2
GEM 3
Digital signal should be coregistered with navigational
data for best results.
Less than
average in
typical terrain.
Schonstedt GA-52/Cx
Schonstedt 72-CX
The analog output is not
usually co-registered with
navigational data.
Much higher
than average.
Systems are
slow and
expensive.
The data output is usually
viewed in transects, not
maps.
E-8
***DRAFT***
Based analysis of the available data, and experience of the team members, it was determined that the
only currently available geophysical technologies likely to be effective at Ft. Ord are the following:
•
Cesium-Vapor Magnetometers
•
Flux-gate Magnetometers
•
Time-Domain Electromagnetic Metal Detectors
•
Multifrequency Electromagnetic Metal Detector
Some of these geophysical technologies are represented by a family of similar instruments; others are
best-represented by only one manufacturer. Based on these factors, the following specific instruments
were selected for use in the ODDS:
Technology
Cesium-Vapor Magnetometers
Flux-Gate Magnetometers
Time-Domain Electromagnetic Metal
Detectors
Multifrequency Electromagnetic Metal
Detector
Selected Instrument
Geometrics G-858
Schonstedt GA2-CX
Geonics EM-61
Geonics EM-61hh
Geophex GEM 3
Towed-arrays were not selected for use in the ODDS. All successful towed arrays use one or a
combination of the above instruments. After the initial ODDS is complete, and technology effectiveness
demonstrated, then towed arrays of successful detectors should be considered at areas of Ft. Ord
based upon implementability and cost.
E-9