Document XzeRZ030d3M1q0poqYvLzNeNw
R.W. McCollum
Li
MA
A,
96^'^iS,'
/Vtf..
J A-_ A.'t'tzOL&h&tl 0^6/c }'G_>
' 1 `f-G-r
71
t
CYW1 3-000943
The effect of analytical error on the interpretation of blood lead data obtained from population studies is discussed. Statistical analysis of measured blood lead values reported in four representative population studies shows over 40 percent of the variability in blood lead measurements is due to analytical error. Because of this analytical error, a large percentage of the observed blood lead measurements which exceed a threshold limit are "false positives" in that the true blood lead values for these individuals do not exceed the threshold. The EPAhas suggested that the distribution of blood lead values could be used as a guide for determining the portion of a population at risk. "At risk" is defined as having blood lead values above a certain threshold. If this is done, the effect of analytical error which causes "false positives" should be considered properly to obtain an accurate estimate of the population at risk.
Effect of analytical variability on measurements of population blood lead levels
JAMES M. LUCAS. Ph D . Consultant E.l Du Pont de Nemours & Company, Inc., Wifmmgton. DE 19898
introduction
The Environmental Protection Agency has suggested that the distribution of blood lead values could be used as a biological guide for determining the portion ofa population at risk as defined by blood lead levels above a certain threshold.1'' A similar guideline has been adopted hv the Commission on European Communities.1'' ' In general, these biological guidelines, based on the cumulative frequency distribution of blood lead values in a population, enable the determination of the portion of a population which exceeds a specified threshold blood lead value. Although this approach takes into account the inherent variability of true blood lead values of individuals in a population, it can be misleading if it fails to consider fully the impact of analytical errors on the measured blood lead values.
The size of the analytical error in blood lead determinations that can be encountered in a highly experienced laboratory is shown in a recent publication.,J| In this study, a blood sample obtained from a single donor was divided into 35 separate samples. These samples were submitted along with other blood samples to the Kettering Laboratory over a period of nine months. The mean measured blood lead value was 19.1.3 ^ig/100 g with a standard deviation of 5.72. Values ranged from 12 to 42 Mg lead/100 g of blood. If the extreme value of 42 Mg' 100 g is rejected as an outlier, the coefficient of variation is 21 percent, if it is included, as it would be in a test where only a single sample is made on an individual, the coefficient of variation is above 25 percent. The Kettering Laboratory is accredited by the American Industrial Hygiene Association, has long experience with blood lead analysis, and has performed well in many intcrlaboratory comparisons. Larger analytic errors have been reported in other studies'" so errors such as these are not uncommon. While the presence of this analytical variability has been recognised.1'-' its effect on the biological guideline blood lead distribution and on the proportion of individuals who will exceed a
Coevr^nt t$g1
tt
specified threshold has not been assessed. This paper uses a simple analysis of variance model to show the large effect that analytical errors can have on the blood lead distribution and on the proportion of individuals who will exceed commonly used thresholds.
In an effort to define the factors accounting.for variation in blood lead levels in populations, analysis of blood lead data obtained from a number of different studies have been compared. For these studies, we have estimated die individual-to-individual variation and the analytical erroi variance components. These variance component estimates are then used in our calculations which estimate the percentage of individuals who will falsely or truly exceed selected threshold blood load levels. Our calculations show that for typical populations the percentage of "false positives", which are measured values that exceed the threshold value because of analytical error, is large.
variations in measured blood lead values
The total variation in measured blood lead level for a population contains several components - true blood lead variation between individuals, within-person variahiliu
(over time) for an individual and a ntitnbcr of analytic.il error components which includes both sampling and measurement error. For most of this paper a simple separation of the total variability into two components, an
analytical error component and the remainder (called the individual-to-individual component), will suffice. I he
effects of the individual-to-individual variation and of the analytical error are schematically shown in Figure l.
In Figure I-A. a hypothetical but reasonable distribution of blood lead results for a population is shown. As blood lead measurements are approximately lognormaliy distributed.11-" the drawings represent the distribution ol the logarithm of blood lead values. As drawn, this distribution includes both the variation in the true individual-to-
lrvJut'i*i HvgiA# Asso<iJM<on
Am ind Hyt Auoc JfAp;
Fonua'v
CYWI 3-000944
N14729.01
V
Figure 1 - Effects of variability on measured blood lead levels.
individual blood lead levels lor the population group and the variation due to analytical error. In Figure l-B, the hypothetical distribution which only includes true individuai-to-individua! variability in blood lead levels is pictured, in Figure l-C, the hypothetical distribution which includes only analytical error is shown. This corresponds to the case where a single individual is sampled and analyzed repeatedly for lead. As shown in Figures l-B and l-C, almost none ol the population is above the threshold, yet when the two effects are combined as pictured in Figure l-A, "talse positives" occur.
estimates of blood lead variability
The percentage contribution ol the individuai-to-individua! variance and of the analytical variance to the total measured variance was determined for blood lead values from four major population studies. These studies-were chosen as representative of the best recent studies, using venous blood samples, with repeat blood samples from individuals. A need lor more research to determine all components of blood lead variability is indicated as there have been few studies m which repeat blood samples have been taken on individuals and no studies have been carried out to determine all components of individuai-to-individual variability, and the components ol analytical error. The four selected studies included a multi-city survey,' ' a longitudinal study,a personal air monitor study.IV| and a Southern California rural-urban study.'"1' Results of the analyses ol variance on the studies are summarized in Table 1 11k a im! \ sis ol v a nance break do w n used to obtain I able I
is described in detail in Appendix A. The analytical error was over 46 percent of the total measured blood lead variability in the four studies.
In the multi-city study, blood samples were obtained from more than 2000 suburban housewives in 10 communities across the United States. Duplicate samples were obtained from about I0(/1; of the subjects. This study also measured air lead levels using stationary samplers, thus simulating how an air quality standard for lead would be implemented. In this study the value of the individual-to-individuul variance was the smallest of all studies reported; it accounted for only
TABLE 1 Summary of Analysis of Variance for Blood Lead Values from Four Studies
Component Standard Deviation
Individual- toIndividual
Analytical Error
Multi-City Survey1
longitudinal Study'"
Personal Air Monitor Study
Southern California Study
0 052 (20%)* 0 063 H 2%) 0 097 (54%)
0 087 (21%)
0 5 03 (80%) 0 174 (88%) 0 089 (46%)
0 169 (79%)
*% Total Variance
[ ]Component Standard Deviation Total Standard Deviation
All analyses a'v adrried out on lay bluud la.id levels
100
c y w i 3-000945
~r,: a s > * eo
eiov.- '^'oshold
'orrc-'^v :
Above 1'"'`^rr. ?
C
!c:o * i>-c^3'vt A
; !
m
Measured Blood lead
-.: - Trijp Glood Lead Throsho 1 id L in'-i t
pi - Measured Blood lead Thm-.iviiiv-nt
Figure Z - True blood lead vs measured blood lead.
2<>rr of the total variance even through the method variance was not excessively large. For a homogeneous group of subjects, such as suburban housewives, the variability between individuals will be small.
' I'hc longitudinal study was a five-year study of more than 2000 workers from 2? locations around the United States. Urine samples were obtained from all subjects and blood lead samples were obtained from more than 200 individuals. On 2! 7 individuals blood samples were obtained in each of the five years. No trends in blood lead were observed over the period of the study. Without duplicate blood samples in a year, long-term changes in an individual's blood lead cannot be separated from the analytical error. Thus, for this study the analytical error is inflated by long term withinperson variability.
The personal air monitor study was conducted to determine the relationship between air lead levels and blood lead levels with the air lead being measured using persona! air monitors. Five groups of thirty subjects each were monitored for a 2-4 week period. Two to eight blood samples were obtained from each subject and each sample was analyzed in duplicate. In three of the groups, two blood samples were taken each week of the study. With this sampling procedure week-to-week variability for an individual can be separated from analytical error. I'hc analytical error component shown for this study does not contain this within-person variability. This study shows the smallest analytical error of all the studies, in fact, the analytical error estimated in this study is smaller than the measurement error shown in the Kettering Study''*' [where the measurement error is one of the components of analytical error as described in Appendix A], To be conservative all our calculations showing the effect of analytical error use the variance components from this study.
90
'W ---isms
In the Southern California study blood samples li mn populations, an urban group and a rural group, wore obtained. The urban group lived in a housing dc\ elopmcm close to a freeway (and a stationary air samplei which monitored air lead levels) while the rural group lived in an area of low lead exposure. While the study appeared to be well designed and conducted, there were often large differences in measured blood lead level between samples taken from the same individual even though these blood samples were taken onlv one day apart. For this study the analytical error was large.
estimation of "false positives"
When blood lead levels arc measured on a typical human population, there are often individuals whose measured values are above a threshold value (c.g.. 40 ^g 100 ml.). Repeat samples taken on these individuals usually have blood lead measurements at a much lower level - below the threshold value. This can occur because ol analytical error or because of within-person variability (whore an individual is above the threshold at the time of measurement but is below the threshold by the time of the follow-up sample). In this manuscript, we evaluate the effect of analytical error. Because of analytical error, a large percentage of the measurements that exceed a threshold are "false positives'' in that the individual's true blood lead level is not above the threshold.
The occurrence of "false positives'* is schematically illustrated by a bivariate plot shown in Figure 2 where the measured blood lead value is plotted on the X axis and the true blood lead value is plotted on the Y axis. I'hc "measured threshold limit" and "true threshold limit" divide the distribution into four quadrants - "A". "B". "C". and "D".
"A" represents the measured values which arc correctly classified as being below the threshold value since they lie below the measured and true threshold limits. I he values in "D" arc correctly classified as being above the threshold limits. The values in "B" and "C" are incorrectly classified The values in "B" lie above the measured threshold but bciow the true threshold limit. The values in quadrant "B" will be incorrectly classified as being above the threshold; these are "false positives". In a similar manner, the \ nines in "C" will be incorrectly classified as being below the threshold. They are "false negatives".
A numerical estimate of the percentage of "false posit ises" can be made by using a bivariate distribution model ol blood lead values."11 A summary of the results from such a calculation is given in I able II. I he specific results m 1 able II were derived using the variance components from the personal air monitor study. The results from this study arc conservative in that they show fewer "false positives" than the other studies because the data from this study had the smallest analytical errors. Similar results could be calculated for any study (or for other responses besides blood lead) when the individual-to-individual variance component and the analytical variance component can be determined. The description of the procedure used to obtain
im ha Hyj Assoc l!*2i
feo'-.iw !991
CYWI 3-000946
TABLE II Estimation of False and True Exceedences of Blood Lead Threshold Values
Population Geometric Mean fg/100 mL)
15 20 25 30 35 40
Percent' of values observed above a threshold when the threshold is
30 1 l 1 9 06 27 38 50 00
35 0 26 3 25 13 36 30 56 50 00
40 0 06 1 11
6 06 17 14 32 98 50 00
Percent" of values which are
false positives when the threshold is
30 1 05 6 77 l 2 76 11 80
35 0.26 2 86
8 93 13 07 11 80
40 0 06 1 05
A 91 10 41 13 19 11 80
Percent' of values actually
30 0 10 3 50 20 76 50 00
above the threshold when the threshold is
35
001
0 62
6 63 24 54 50 00
40 0.00 0 10
1 78 9 92 27 53 50 00
'Percent m Categories B and D m figure 2. "Percent m Category B m Figure 2 ' Percent in Categories C and D in Figure 2
the results in Table II using the logarithm of the blood lead values is given in Appendix B.
T able II shows that the analytical error will almost always cause some "false positives" when measuring blood lead levels in a population. When the population mean blood lead level is well below the threshold value. mo$t of the values measured over the threshold will be falsely categorized. For example, in a population with a true mean blood lead level of 25 ng/100 ml. (the upper end of the range for the average blood lead level in typical populations"1), and a threshold value of 40 jig. 100 mL. Tabic 11 shows that 6.06 percent of the individuals will be measured to be above the threshold However.4.91 percent of the population (81 percent of these individuals) will be "false positives" as their true blood lead is below 40 jig/100 ml..
The percentage of ``false positives" increases as the population mean decreases for a given -threshold value, although the absolute number of individuals classified above the threshold decreases. If a group has its mean near the threshold limit, an opposite problem occurs. In this group there can be many individuals whose measured blood lead is below the threshold limit while their true blood lead level is above the threshold. These would be "false negatives".
example of "false positives" To illustrate how analytical error can account for the difference in the number of individuals above a threshold between the original sample and the follow-up sample, wc will use the data from a recent survey in Pittsburgh that measured blood lead levels in children."" In this study a representative sample of households from the metropolitan Pittsburgh area was surveyed for levels of lead in paint and dust in homes. Following this survey, blood samples were requested from children in households having children aged 7 or younger. While not all households complied with the request, the complying households had higher lead content
in dust and paint than the noncomplying households, hour hundred fifty-six children were sampled. The average of the 456 blood lead values was 21.9 (median 21.0) and the standard deviation was 7.9. Fifteen children (.V.T) showed blood lead values above 40 on the first sample. A resample was requested for these children. Fourteen of these 15 children were found for a resample. Most children were
TABLE HI Blood Lead Values for 1 5 Out of 456 Children in Pittsburgh Study Whose Initial Blood Lead Values
Were Greater Than 40 ug/100 mL
Child
_M__e_a_s_u_re_d__B_l_o_o_d__P_b__(uIg_/1_0_0__m_L_) First Second Third
Sample Sample Sample
P_ redicted Blood Pb (ug/lOO mL)
1 2" 3 4
5 6 7
8 9 10 11 12" 13 14" 15 RMS'
45 26 73 73 75
42 35 43 27 45 38 41 28 46 34 42 38 47 35 59 28 42 19 43 Could not be located 40 21 50 48 43 41 32 16 1
32 41
31 31 ' 32 30 32 31 33 37 31 31 30 34
30 63
31 39 30 30 31 29 31 30 31 35 30 30 29 32 29 61
'First column - Regression caused by analytical variability. Second column - Regression caused by analytical variability and withmperson variability.
"Not used in RMS calculation
' RMS Root Mean Sfluare Difference from second sample
American industnj1 Hygiene Assooahcn JOURNAi
(t2) 2/81
9!
erwi
3-000947
resampled within one month of the original sample. There was ,,<' attempt to change exposures between the original sample and the resample. In the resample. 2 of the 15 children remained above 40 while 12 dropped below. These results arc shown in Table III. The very high value was obtained from an cight-vcar-old being treated for lead poisoning
l.'sing the regression equation shown in Appendix C. we can predict the blood lead levels for individuals in the Pittsburgh study whose initial blood lead was above 40. The regression has two causes; the first is analytical error, and the second is within-person variability (as the blood lead lev el could be above the threshold at the time of the original measurement but below the threshold by the time a resample is taken). In Table IN. we show the results of two regression calculations. One considers only the regression effect due to analytical error while the second gets slightly better predictions as it predicts the combined regression caused by both effects. The blood lead values predicted using the regression equations are much closer to the resampled blood lead values than are the initial sample values. The good agreement between the predicted and the resample blood lead levels shows the validity of the calculation of "false positive" percentages (Table N).
In summary, we have shown that the percentage of blood lead values measured to be above a threshold will usually overestimate the percentage actually above the threshold. For typical populations, the percentage of "false positives" will be substantial. A numerical estimate of tire extent of "false positives" has been given along with a predictor that is a better estimate of a confirmatory blood lead reading than is the original reading.
The existence of false positives depends only on the fact that the total observed variability is bigger than variability in the true values due to the presence of analytical error. The Analysis of Variance model used here is more general than the classification models used elsewhere'11| as it shows how the classification probabilities change with changes in population mean level and with the threshold level. Thus, the approach illustrated here is appropriate for any quantitative variable.
acknowledgement
I would like to thank R.D. Snee for providing the original data for the personal air monitor study, for performing some of the analysis of variances described and for many helpful discussions.
wr
references
1 Office of Research and Development: An Quality Criteria for Lead. EPA-600/8-77-01 7. U S Environmental Protection Agency, Washington, D C (1 977)
2. Zieihuis. R.L.: Biological Quality Guide for Inorganic Lead Int. Arch Arbeitsmed. 32 103-127 (1974),
3 Commission of the European Communities: Council Directive of March 19. 1977. on Biological Screening of the Population for Lead Official Journal of the European Communities. Vol. 20. No L105 10-17, Brussels <1977)
4. Lerner, S.: Blood Lead Analysis -- Precision and Stability. J. Occup. Med. 17 153-154 (1975).
5 Bil!ick, I.H., A.S. Curran and D.R. Shier: Analysis of Pediatric Btood Lead Levels in New York City for 1970-1976 Environ. Health Perspect. 37-183-190 (1979)
6 Pieice, J.O.. S.R. Koirtyohann, T.E. Clevenber and F.E. lichte: The Determination of Lead m Blood International Lead Zinc Research Organization, Inc . Nevy York (1976)
7. Tepper, L.B. and L.S. Levin: A Survey of Air and Population Lead Levels in Selected American Communities Environmental Quality and Safety. Supplement Vol. II -- Lead. pp. 152-196. George Thieme Verlag. Stuttgart. W. Germany (1975).
8 McLaughlin, M.. A.L. Linch and R.D. Snee: Longitudinal Studies of Lead Levels in a U S Population Arch Environ Health 26:131-136 (1973).
9. Azar. A.. K. Habibi and R.D. Snee: An Epidemiologic Approach to Community Air Pb Exposure Using Personal Air Samplers. Environmental Quality and Safety. Supplement Vof. //-- Lead. pp. 254-270. GeorgeThieme Verlag, Stuttgari. W. Germany (1975).
10. Johnson. D.E.. R.J. Prevost and J.8. Tillery: Baseline Levels-of Platinum and Palladium in Human Tissues. EPA600/1-76-019. Environmental Health Effects Research Science Document. U.S Environmental Protection Agency. Washington, D C. (1976).
11. National Bureau of Standards: Tables of the Btvanate NormalDistribution Function and Related Functions Applied Mathematics Series No. 50. U.S Government Printing Office. Washington, D.C. (1959V
12. Urban, W.D.: Statistical Analyses of Biood Lead Levels of Children Surveyed in Pittsburgh. PA: Analytical Methodology and Summary Results. NBSIR 76-1024. Institute of Applied Technology, National Bureau of Standards, Washington. D C (1976).
13. Colton, T.: Statistics in Medicine. Little Brown.and Co. Boston. Mass (1974).
14. Scheffe. H.: The Analysis of Variance John WileyandSons. New York (1959).
15. Snee. R.D. and P.E. Smith, Jr.: Statistical Analysis of Interlaboratory Studies. Am. Ind. Hyg. Assoc. J 33.784-790 (1972).
16. Koppter. J.F.. M.E. Maxfield. W.E. Moss. G. Tietjen and A.L. Linch: Interlaboratory Evaluation of the Reliability of Blood Pb Analyses. Am. Ind. Hyg. Assoc. J 31 412 429 (1970).
APPENDIX A
Estimates of the total variance and the components of the total variance for blood lead values were obtained for four studies using a standard hierarchical analysis of variance.1141 As the distribution of blood lead value is approximately log normal.'1' 1 all results are developed on a login scale. The
92
variance components for these studies arc discussed in this appendix.
Consider a study where:
g = number of groups
km Ind Hyf kssoc 1(42)
feCrujrv 1981
CYWI 3-000948
Source
TABLE A 1 Analysis of Variance
Degrees of Number Freedom
Groups Person io-Person Witiun-Person Sampling Measurement
g g-1 n g(n - 1) i gn(! 1) s gnus It m gnt$(m - 1)
Variance Component
'>*...... ........ .
m
n = number of individuals (per group) t = number of sampling times {per individual) r = number of samples (per sampling time) d = number of determinations (per sample) o' = variance component
The data from such a study could be analyzed using the analysis of variance, shown in Table A-!. Even more extensive breakdowns could be considered. For example, the measurement variance component could be further broken down by considering the component parts of the measurement error, such as the operator-to-operator error and the instrumcnt-to-ins.trumcnt error. Data-to make this more comprehensive breakdown is seldom available.
In the analysis of variances shown in Table A-l. the analytical error contains two components, a sampling component and a measurement component as shown by the following formula:
0n<lvlnl = a.'.mpho, + flwi.nl.mnl / IT)
In most screening studies only a single measurement is made on each sample (m=l). When this occurs, the sampling variance component and the measurement variance
component cannot be estimated separately; only the total analytical error can be estimated. Our estimate of the effect of analytical error will assume that a single measurement is made on each sample, so for our calculations
....
Generally.'enough samples are not taken to estimate all the variance components shown in Tabic A-l. For example, in a study in which each individual is sampled on two occasions and each sample is measured once, only two variance components can be estimated. These two components arc:
1) a'r.r.,.,, + (k) nl.......... .
2) the sum of (I - k) or.... r......+ ot...,n. ... +- a. . -
In this formula, the k value which multiplies the withinperson variance component is a number between 0 and I. If the two samples from an individual arc taken close together, k will approach one; however, if there is a long time between samples then k will approach zero.
In this latter case, if the second component is interpreted as analytical error, it will be inflated as it contains much of the within-person variability.
When only a single sample is taken from an individual, but duplicate determinations arc made on the blood sample. (Tmrrmitemcni can be estimated. However, the total analytical error cannot he estimated as no estimate of sampling variability can be obtained. In this case.tire measurement error may be (falsely) reported as the total analytical error. This causes the precision of the study to be overestimated. To estimate the analytical variabilitv.'more than one sample must be taken from an individual. Tabic A-2 summarizes analyses of variance for blood lead values from lour studies for which multiple samples were taken from individuals. In the longitudinal study1*'. the repeat samples from an individual were taken a year apart. For this study, the within-person variability is combined with the analytical error causing an overestimate of the analytical variability.
TABLE A-2 Analysis of Variance for Blood Lead Values from Four Studies
Study
Component Standard Deviation'
individual-toIndividual
Analytical Error
Total
Geometric
Standard Deviation
Multi-City Survey' '
Longitudinal Study'"
Personal Air Monitor Study''"
Southern California Study...
0.0521 (20)"
0 063 M2)
0 0972 (67) 0 0972' (54)
0 0871 (21) 0 0784" (18)
0.1030(80)
0.174 (88)
0 0688(33) 0.0889 (46)
0.1689 (79) 0 1662 (82)
0.1154
0 185
0 1191 0.1317
0 1900 0 1838
1.30
1.53
1 32 1 35
1 55 1 53
'Component Standard Deviation = (Variance Component)''
"Values in parentheses are % Total Variance =
Component Standard Deviation Total Standard Deviation
x 100
' Modified
obtained from duplicates (see Equation (1))
"Deleted six outlier blood lead values.
America" Industrial Hygiene Association JOURNAL
(42) 2/81
S3
CYWl 3-000949
/ Sljtfm11.IllInilI
Za.-M
TABLE A-3 Personal Air Monitor Study Analysis of Variance Table
Source
Variance
Degrees of Variance Component Freedom Component Estimates
G'oiip Person Sampling Time Analytical
4 145 195 194
0 00893 0 00854 0 00090 0 00474
....... ..........
....... . .............. .
When smgie readings are made ................................ * i---........... = (0 0889) ............. - ........- ' ---........ - 000944 ^ (00972)' -> .......... >- ............. (00972)' * (00889)' - (0 1317)
For the other three studies described, duplicate samples were taken much closer together (so k = I). For example, in the Southern California study""1 which had the largest percentage analytical error, duplicate samples were taken one day apart.
In the four studies summarized in Tabic A-2. a component estimating group-to-group differences was also obtained as each of the studies was made on more than one group." This component which accounts for differences between groups was not reported as part of the individualto-individual variance.
In the personal air monitor studies. ' tun hUuut samples were taken from most individuals during each week nl (he study. Thus, for this study it was possible to separate the week-to-week wilhin-pcrson variability from the anakheal error. Table A-3 shows the detailed analysis of variance for the personal air monitor study.
In the personal air monitor study, duplicate
determinations were carried out on each blood sample. Only
the average of duplicate determinations was used in the
analysis since the values of the individual determinations
were not available. In the analysis, therefore, only the sum of
o^mpimc and
could be estimated. The following
equation was used to estimate the analytical error which
would be obtained if only single determinations were used:
O.iii.iMm .n i M.ictr il-ir-.mi.til1.1.1 -- I7.ift.iis.... t.l.ipli, .If i-.'-h ik.....\
For this study:
............< 2 ("11
OjnafviH >1 <(rtermination) " 0.00474 + (0.0795)' 2 = (0 (>X*9)
The value of (0.0795)' for a;f8,,,<.mcni was obtained Irom an AIHA study.m'IM This modification was used to make the personal air monitor study consistent with the other studies which used only single determinations.
The analytical variability for the personal air-monitoring study is the smallest of all four studies considered. In fact, the analytical error for the personal air-monitor study is smaller than the sampling error found in the Kettering l.ab study."1 Had the estimate of false positives used the variance components from any of the other studies, the percentage of false positives would have been greater.
APPENDIX B
calculation of bivariate lognormal distribution probabilities The relationship between measured blood lead and true blood lead values can be described by a bivariate lognormal distribution (a bivariate normal distribution using log blood lead values).
Five parameters are required to describe this distribution:
u, = the mean of the true blood lead values Um = the mean of the measured blood lead values n\ = the true variance in blood lead values )7m = the variance in measured blood lead values
p = the correlation between measured and true blood lead values
The means of the true and the measured blood lead values are considered to be the same; they arc equal to the population mean. A bias in the measurement could easily be accounted for by adjusting the mean levels. The true blood lead variance o', is estimated by oiU..in + oi.nm,( -- which for the personal air monitor study is (O.Q972):. The variance in measured blood lead levels (ai) is estimated by cr,V,,,i which is (O.I317)2. The correlation (p) is:
9*
_____Covariance (XV) [Variance (X) Variance {V)['
_
P
a,
x or)'
fit
(7m
Thus our estimate of p is
The probabilities in Tables II and. B-l were obtained by f irst calculating Zi and Z: where:
^ _ log (true threshold value) "Jogji.
17,
2 _ log (measured threshold value) - lot* m Om
Note that the measured threshold value and the true threshold value need not be equal.
Values of Zi and Zj were used with normal probability tables to determine the probabilities in quadrants A + C. B D. A + B. and C + D. (These refer to quadrants shown in Figure 2.) The probability in quadrant D was obtained from tables of the bivariate normal distribution"" using Zi. Z;
4m Ind Hyg Assoc J M2)
febtul'y 1981
3-000950
'* v
Population Geometric Mean Biood
lead lug / 100 ml)
15 20 25 30
15 20 25 30 35
15 20 25 30 35
15 20 25 30 35 40
15 20 '25 30 35 40
15 20 25 30 35 40
w
TABLE 8-1 Estimation of False and True Exceedences of Blood Lead Threshold Values
Threshold for Blood Lead lug/100 ml)
Meas True
Bivariate Distribution (percent)
A B'* C
D
% Values Observed
Above Measured Threshold,
(8*0)
% Positives Which Are
False Positives.
100 8 (B + bf
% True
Exceedences of Threshold,
fC 1 D)
30 30 98 85 1 05 0 04 0 06
1 11
89 73 6 77 1 21
2 29
9 06
66 49 12 76 6 13 14 62
27 38
38 20 11 80 1 1 80 38 20
50 00
30 35 98 89 1 11 0 00 001
1 11
90 86 8 53 0 09 0 53
9 06
71 79 21 59 0 83 5 79
27 38
47 42 28 04 2 58 21 96
50 00
26.43 23 58 4 13 45.87
69 44
35 35 99 74 0 26 0 00 0 00
0 26
96 54 2 86 023 0 39
3 25
84 44 8 93 2 21 4 42
13 36
62.39 13 07 7 05 17 49
30 56
38 20 T1 80 11 80 38.20
50.00
30
40 98'89
t.U 0 00
000
1 11
90 94 8.96 0 00 0.09
9.06
72 54 25 68 0 08
1.71
27 38
49 63 40 44 0 37 9 56
50 00
29.72 42 74 0 84 26 70
69.44
15 94 34 04 1 19 48 82
82 86
35 40 99 74 0 26 0 00 0 00
0 26
96.74 3 17 002 0.08
3 25
86 36 11.86 0.28 . 1 50
13.36
68 04 22.04 1 40 8 52
30 56
46 70 25 77 3 30 24 23
50 00
28 12 21 89 4 86 45 13
67.02
40 40 99.94 0 06 0.00 . 0 00
0 06
96 85 1 05 0 04 0 06
1 11
93 31
4.91 0 64
1 15
6 06
79 67 1041 3.20 6 73
17 14
59 27 13 19 7 74 19 79
32 98
38 20 11 80 11.80 38 20
50 00
95 75 47 24
1Q0 94 79 56 34
100 88 67 43 24
100 99 94 81 62 41
100 98 89 72 52 33
100 95 81 61 40 24
0 10 3 SO 20 76 50 00
001 0 62 6 62 24 53 50 00
001 0 62 6 63 24 54 50 00
0 00 0 10 1 78 9 92 27 54 50 00
0 00 0 10 1 78 9 92 27 52 50 00
0 00 0 10 1 78 9 92 27 53 50 00
*A - Values correctly classified as below threshold. B Values incorrectly classified as above threshold C - Values incorrectly classified as below threshold. D Values correctly classified as above threshold. ' % False Positives for the Measured Threshold.
and p. {Actually, a computer program that followed the above procedure was used, as interpolation would be required in the tables.) Once the probability in quadrant D is known, the probability in all quadrants can he calculated.
In Table B-l, the four classification probabilities of the
bivariate distribution arc presented for different population mean and assumed threshold blood lead values. In addition, the last three columns present the percent of values observed above a threshold. (B + D). the percent positives which arc "false positives". (B/(B + D) X 100). and the percent exceedences of the threshold, (C + D).
APPENDIX C
prediction of blood lead values for repeat blood samples
The value of a follow-up blood lead sample can be predicted using the following regression equation which estimates the statistical phenomena of "regression toward the mean".
American industrial Hyjiere Association JOURNAL
M) V81
Individuals whose measured blood lead levels arc above a threshold will either be those who have positive analytical errors or those who have high true blood lead levels at the time measurements are taken. When only these individuals are resampled, the resample will tend to be lower because
95
CVWI 3-000951
4W
post11vc analytical errors will occur less often or because the jndi'iiiuars blood lead may have dropped in the time between the original sample and the resample. Using the estimated variance components from the personal air monitor study we will estimate the regression effect caused by analytical error and the regression effect caused by the combined effect of analytical error and uuhin-person variability. 1 he regression calculation enables one to make a good prediction of the resample blood lead value.
The regression equation has the form log Y = log u + /3(log X - log u)
(1)
where: Y = the predicted blood lead value for the repeat biood sample
X = the original blood lead reading
u = the geometric mean of the population (assumed to be 21 for the Pittsburgh study)
8 = regression coefficient
For the personal air monitor study the regression coefficient is:
n,.....-
rTi... ,i
0.00834 0 01734
0.493
for the regression equation that includes both the elici t ol analytical eTtor and the effect of within-person variability and
_ a?,...... 4-
_ 0.00944 0.01734
for the regression equation that includes onl> the effect of analytical error
= the total variability (for single samples) = (0.1317)'
= person-to-person variability = 0.00X34 Owithm*person = the within-person variability = 0.00090
The variance component values from the personal air monitor study that were used as the analytical error could not be estimated from the Pittsburgh data as there were no duplicate samples.
Publications brochure available from Air Pollution Control Association . . .
The revised brochure, "Publications of APCA," describes contents and prices of APCA periodicals, proceedings of technical meetings, and other publications covering air pollution control technology. An order form is inefuded in the brochure. Copies may be obtained at no charge by writing to: Publications Dept.. Air Pollution Control Association. P.O. Box 2861, Pittsburgh. PA 15230
i
Am Ind. Hyg Assoc JI42)
feOru*'* !98i
CYWI 3-000952
INTEROFFICE CORRESPONDENCE
ChOicFaFICgEo PHlOaC TnUBEtI<Q * /20TE/79
TO: Bound Brook
a t t -n . o f :
g . Duffy
s u bj ec t : Blood Lead Incentive
COPY TO G. J. Brucia - NA E. J. Dean - NA F. B. Dorf - NA H. T. Walker - NA
REFERENCE:
Presently at the Chicago Plant the employees receive one book of S&H Green Stamps ($3.00 value) when their latest blood lead analysis is below 0.06 mg lead/100 grams of blood. Based on the monitoring time table the maximum award/employee is six books of stamps/year. However, there is also a stipulation that if all employees are below 0.06 all would receive two books of stamps - This situation has occurred only once.
It is proposed that this incentive system be replaced by one of the following or a combination. This would be based on an employee achieving blood lead levels below 0.05 mg lead/100 grams of blood.
A. An employee would receive one day off with paytaken within one month of the test and in agreement with plant management.
B. An employee would receive one days pay with no time off.
C. An employee could choose a gift from a catalog. Prizes in the range of a days pay.
D. An employee could chose one of the above.
" HCGsck
H. C. Gaffney
NA M2* |v, - ZT: mi
- CYW1 3-000953
N14729.02