Document 3JO9VKnx0veLvXd9qk5V4z9Za

FILE NAME: Doubt Science (DBTS) DATE: 2005 DOC#: DBTS012 DOCUMENT DESCRIPTION: Gennaro Journal Article from IJOEH - Business Bias: How Epidemiologic Studies May Underestimate or Fail to Detect Increased Risks of Cancer and Other Diseases Business Bias: How Epidemiologic Studies May Underestimate or Fail to Detect Increased Risks of Cancer and Other Diseases VALERIO GENNARO, MD, LORENZO TOMAHS, MD In spite of claiming primary prevention as their aim, studies of potential occupational and environmental health hazards that are funded either directly or indi rectly by industry are likely to have negative results. The authors present three common scenarios in which faulty design of epidemiologic studies skews results, and list 15 study design flaws that lead to results that are danger ously misleading with regard to both the evaluation and the improvement of public health. Key words', epidemi ology; industry influence; study design; public health. 1NT J OCCUP ENVIRON HEALTH 2005;11:356-359 I nterests other than those concerned with the pro tection of public health--in particular, personal ambition or economic profit--can heavily affect biomedical research,1 and cancer research in particu lar.2"5There is ample evidence that, in spite of claiming primary prevention as their aim, occupational and envi ronmental studies that are directly or indirectly spon sored by multinational corporations almost invariably lead to negative results.^ In such studies the real risk of disease in subjects exposed to harmful factors is often underestimated. One way this is done is by indicating as safe environmental situations that very likely present risk. For example, in petrochemical and refinery-based epidemiologic studies conducted (or simply supported) by corporations, workers potentially exposed to about 50 substances classified as toxic, mutagenic, and car cinogenic9are regularly declared healthy.10'11There are several reasons to question these results. Studying the scientific literature oriented to the identification of the disease risks in strategically and economically relevant activity sectors such as oil refineries and petrochemicals, it is common to observe a statistically significant reduction of the observed/ expected ratio of cases (dead or ill) among exposed Received from the Liguria Regional Operational Center, National Mesothelioma Registry, Nadonal Cancer Research Institute, Genoa, Italy. Address correspondence and reprint requests to: Dr. Valerio Gen naro, Liguria Regional Operational Center, National Mesothelioma Registry Descriptive Epidemiology and Cancer Registry--Epidemiol ogy and Prevention Department, National Cancer Research Institute (1ST), Largo R. Benzi, 10-16132 Genoa, Italy. workers (vs unexposed). This may, of course, occur because there is no exposure at all, but in other instances the real cause of the negative results--that is, the absence of an association between exposure and adverse health effects--may reside in the epidemio logic study design. We present three scenarios, examples of which have been observed in recent studies, in which real risks of disease are underestimated. In addition, we put forth 15 points, some of which are borrowed from a nearly 25-year-old analysis,12 that are both critical and dan gerously misleading with regard to both the evaluation and the improvement of public health. As reanalyses of specific data sets are not available, we cannot, how ever, make any direct evaluation or simulation of spe cific studies. Scenario 1 If exposed and unexposed workers are not separated, the automatic and obvious consequence is a large underestimation of the real magnitude of risk among the exposed workers (misclassification error). This error might be negligible (statistically, not ethically, of course) only if and where the proportion o f unexposed workers is not relevant (in terms of size, person-years, etc.). Only the classification of the whole cohort in the homogeneous subgroups of workers, therefore, will permit an estimate of the real risk magnitude.13 Scenario 2 A more serious misclassification bias occurs when exposed diseased workers are classified as unexposed controls.14This is often the case in studies of U.S. refin ery workers, among whom the most heavily exposed workers are often "contract workers" who may work at a refinery or refineries cleaning tanks o r installing insu lation but who are not regular "employees" of the refin ery. This "problem" has been known to the American Petroleum Institute (API) for more than 40 years. In 1958, the American Petroleum Institute (API) con tracted with Dr. Robert Kehoe to design "An Epidemi ologic Study of Cancer among Employees in the Amer ican Petroleum Industry."14 In describing worker exposure classification Kehoe noted: 356 It was quickly discovered as various industrial situa tions were studied also thatjob tides differed gready from company to company and indicated litde if any relationship to the degree and kind of hazard. Men charged with the actual operation of the equipment, for example in the petroleum industry, may have very litde or no contact with either petroleum or the various refined products, but the samplers and maintenance personnel may have frequent and heavy exposures. At the same time, maintenance and labor classifications may work in all parts of the refinery or, equally common, be assigned for a sig nificant period of time to a single area. In reviewing the effect of technical changes in the refining processes on the exposure factor, one is immediately impressed by the fact that this is an extraordinarily fluid and dynamic industry. New processes evolve constandy, and this has been particularly true in recent years as companies moved rapidly from `batch' type of operations to essentially `assembly line' procedures. With this evolution, the degree and kind of contact change markedly. Maintenance problems are reduced and even presendy widelyspaced `turn arounds' are being substantially sub contracted by many companies. [It must be admit ted that, although this development may diminish the exposure hazard for the refinery worker, it may be concentrating and augmenting the danger to the employees of companies specializing in this service type operation.] Consequendy, even if accurate and reliable occupa tional records were obtainable, the local situations are constandy changing and improving so that the exposures of today are much less than those ten years past, and it can be predicted confidendy that they are probably much greater than those of ten years hence. Unfortunately, instead of trying to correct this prob lem, API-funded researchers have capitalized on this phenomenon to generate study findings that appear to show that workers potentially exposed to all kinds of known carcinogens and other toxins live longer than unexposed population controls. This is in part due to the fact that exposed contract workers with disease are moved from the exposed diseased category (the "a"box) to the unexposed disease category. For example, Otto Wong stated that a contract worker with leukemia (a plaintiff in a lawsuit against Mobil) who worked at a Mobil facility cleaning reactor vessels but did not work as a regular employee for Mobil would not be categorized as a Mobil worker. On the other hand, Wong stated that a Mobil lawyer whose office was located at the same facil ity would be included in the exposed group.15 For rare diseases, such non-random misclassification that switches exposed-diseased workers to the unex posed-disease category can easily produce results that show that "exposure" is protective. This is in fact what Wong has often found.16 Scenario 3 If we compare illness frequencies among exposed work ers with those in the general population (which is nor mally less healthy than the workers when hired and even later) we create a "healthy-worker effect" (HWE) with the consequent related comparison bias. The HWE is too often considered inevitable. As a matter of fact, it is not only an effect, a bias, or finally, an epidemi ologic artefact, but a serious error that can be avoided by an epidemiologic study design in which an internal comparison between exposed and un exposed workers is performed correcdy. As a matter of fact, an unex posed group of oil refinery workers is often readily identifiable within the plant under study. When two of these errors occur at the same time, a "negative" result is practically certain: a protective effect will be demonstrated, and the studied workers will show a reduction of their risk with a lower-thanexpected number of observed cases (dead or ill). In addition, the reduction of this risk might also be statistically significant when the 90% confidence inter val (Cl)--instead of the conventional 95% Cl--is cal culated around the point estimate (i.e., RR, SIR, SMR). In fact, the conventional 95% interval might not show any significant reduction due to its larger interval. When we asked why this questionable mthod ologie approach is used, we received different answers: the data were analyzed in many ways (and that is often true) ; this way of analysis is usual (and again, this is often true) ; other approaches were not available; and, hard to believe, a different approach would be too costiy. In the light of such premises, we have identified 15 elements that, when present in epidemiologic studies, may lead to falsely negative results.12 These elements do not meet the criteria for good epidemiologic prac tice oriented to the improvement of public health. CRITICAL POINTS (ERRORS TO BE AVOIDED) 1. Privilege the use of descriptive instead of analytic statistics, and the adoption of cross-sectional instead of longitudinal epidemiologic studies; 2. fail to study the single homogeneous subgroups of workers (in terms of exposure) ; 3. consider only the exposure to one single sub stance, ignoring the possibility of exposure to mul tiple substances and their interaction; 4. keep the unexposed and exposed workers mixed (creating a dilution effect) ; 5. compare the exposed workers, who are usually selected according to their overall positive health condition, with the general population (instead of unexposed workers), creating a healthy-worker effect (and comparison bias) ; VOL 11/N O 4, OCT/DEC 2005 www.ijoeh.com Business Bias 357 6. take into consideration only one single disease (or disease family, e.g., cancers) rather than all diseases; 7. maintain disaggregation of homogeneous patholo gies, thus making statistical significance more diffi cult to achieve; 8. fail to study reversible symptoms or serious sentinel abnormalities; 9. study neoplastic effects (usually having mediumlong latency periods) at follow-up periods too short to allow for their development; 10. compare effects on the same target organ between groups of individuals exposed to different agents (e.g., asbestos workers vs tobacco smokers) having the same target (e.g,, lung); 11. interpret the absence (or inadequacy) of both envi ronmental (and biological) monitoring and epi demiologic studies as evidence of absence of expo sure and negative health effects; 12. keep the measurements of exposures separated from the measurements of health effects; 13. privilege statistical significance rather than biolog ical significance, and consider the results of large and multicentric studies more important than other factors (biology, exposure, etc.); 14. use the conventional two-sided statistical test instead of the one-sided statistical test, which appears to pro vide the greatest reassurance against missing an exposure-related effect17; and, last but not least, 15. use univariate analysis instead of a multivariate analy sis that permits the simultaneous study of all the rel evant variables (e.g., age at hire, sex, area,job, calen dar period, length of employment, latency, etc.). CONCLUSIONS The scientific evidence currently available suggests that epidemiologic studies addressing the identification of health risks for workers occupationally exposed to nox ious agents, as well as for residents in polluted areas, rarely fulfill the standards of scientific rigor and com m itment to the principles of public health protection if they are sponsored by strong economic interests. For instance, studies of workers in oil refineries conducted with total economic independence have identified pos sible environmental and health risks associated with exposures to more than 50 substances classified as toxic, mutagenic, and carcinogenic, such as asbestos, arsenic, benzene, chromium, nickel, polycyclic hydro carbons, and silica. The IARC has therefore evaluated exposures in oil refineries as probably carcinogenic to humans.9By contrast, other studies undertaken within the same areas of industrial production, supported by industry and of doubtful independence, do not report the existence of any risks.6'10'11,16 Epidemiologic investigations on oil refinery workers carried out in Liguria (Italy) have identified specific asbestos-related tumors, such as pleural18,19 and lung13 tumors, a finding that was subsequently and independ ently confirmed in Canada.20 These findings were ini tially ignored and/or openly disputed, but were later accepted.15 Only Kaplan21 had previously registered an excess of mesotheliomas in these workers. A review of studies of effects of exposures to selected chemicals (alachlor, atrazine, formaldehyde, and perchloroethylene) shows that 60% of such studies con ducted by non-industry researchers found these chem icals hazardous, while only 14% of industry-sponsored studies did so.5,22 There is a legitimate doubt that at least part of these studies effectively pursued the actual identification of specific risks, or complied with rigor ous scientific criteria. Such studies have contributed to a harmful delay in the adoption of preventive measures and have downplayed the significance of primary pre vention, especially in developing countries.23 The power of the limited number of multinational corporations is proven by the fact that they operate worldwide, with over 700 petroleum refineries where they employ about 1,200,000 workers. Additional work ers are employed in related industries, where about 2,500 different products such as lubricants, bitumen (residual oils), fuels, solvents, fabrics, plastics, disinfec tants, perfumes, etc., are produced.24Most studies spon sored by the companies owning the refineries have provided reassuring results.6,16 Given the way in which the data were assembled and analyzed, however, they are definitely not reassuring.7 Based on this background, there is an urgent need for strengthening economically and intellectually inde pendent scientific research that is explicitly oriented toward primary prevention (i.e., the protection of public health) and free from any business bias or bias due to any vested economic interest. We suggest, therefore, that qualified independent scientists be allowed to reanalyze the original data sets of studies that either 1) have been conducted or supported by sponsors having strong con flicting economic interests or 2) report negative results or a protective effect where there is a reasonable suspi cion (a priori or suggested by other studies) of the pres ence of increased risk of an adverse health effect. The authors thank Marcello Ceppi, Fabio Montanaro, and Stefano Parodi for their helpful comments, and David Egilman for his com ments and substantial contribution to Scenario 2. References 1. Bekelman JE, Li Y, Gross CP. Scope and impact of financial con flicts of interest in biomedical research. JAMA. 2003;289:454-65. 2. Tomats L. Can social injustice be compensated adequately? Epi demiol Prev. 1994;18:135-40. 3. Tomatis L. Primary prevention protects human health. Ann NY Acad Sci. 2002;982:190-7. 4. Ludwig ER, Madeksho L, Egilman D. Re: Mesothelioma and lung tumors attributable to asbestos among petroleum workers. Am J Ind Med. 2001;39:524-7. 5. Rosenstock L, Lee LJ. Attacks on science: The risks to evidence based policy. Am J Public Health 2002;92:14-8. 358 G ennaro, Tomatis www.ijoeh.com INT J OCCUP ENVIRON HEALTH 6. Satn KP, Bailey W[, Newton KL, Ross AY, Wong O. Updated epi demiological study of workers at two California Petroleum Refineries, 1950-95. Occu. Environ Med. 2002;59:248-56. 7. Parodi S, Montanaro F, Ceppi M, Gennaro V. Post script letters. Mortality of petroleum refinery workers. Occup Environ Med. 2003;60:304-5. <http://oem .bm jjournals.com /cgi/content/ f u l l/ 6 0 /4 / 3 0 4 >. 8. Gennaro V, Parodi S, Ceppi M, Montanaro F. Cancer in petro leum refineries: absence of risk or misdassification? Epidemiol Prev. 2003;27:173. 9. International Agency for Research on Cancer (IARC). Occupa tional exposures in petroleum refining; crude oil and major petroleum fuels. Evaluation of Carcinogenic Risks to Humans. 1989;45. 10. Raabe GK, Collingwood KW, Wong O. An updated mortality study of workers at petroleum refinery in Beaumont, Texas. Am JIn d M ed . 1998;33:61-81. 11. Lewis RJ, Gamble JF, Jorghensen G. Mortality among three refinery/petrochemical plant cohorts. 1. 1970 to 1982 active/ terminated workers J Occup Environ Med. 2000;42:721-9. 12. Hernberg S. "Negative" results in cohort studies--how to rec ognize fallacies. Scand J Work Environ Health. 1981;7:121-6. 13. Gennaro V, Finkelstein MM, Ceppi M, et al. Mesothelioma and lung tumors attributable to asbestos among petroleum workers Am J Ind Med. 2000;37:275-82. 14. Kehoe R. An Epidemiologic Study of Cancer among Employees in the American Petroleum Industry. Report to the American Petroleum Institute, March 1958, Bates Number 911230BinEuIM 02197. 15. Wong O. Deposition taken in Jorge TalleyPlaintiff vs. Safety Kleen Corporation, No. 784605, May 7, 1999. 16. Wong O, Raabe GK. A critical review of cancer epidemiology in the petroleum industry, with a meta-analysis of a combined data base of more than 350,000 workers, Regul Toxicol Pharmacol 2000 Aug;32 (1) :78-98. 17. Lemen RA. NIOSH. Testimony on formaldehide. 1986. 18. Gennaro V, Ceppi M, Fontana V, et al. Is the oil refinery plant a dangerous workplace for pleural cancer? Some epidemiolog ical evidence. Eleventh biennial meedng of the European Asso ciation for Cancer Research. Eur J Cancer. 1991; 27 (suppl 3): S47. 19. Gennaro V, Ceppi M, Boffetta P, et al. Pleural mesothelioma and asbestos exposure among Italian oil refinery workers. Scand J Work Environ Health. 1994;20:213-5. 20. Finkelstein MM. Asbestos associated cancers in the Ontario refinery and petrochemical sector. AmJ Ind Med. 1996;30:610-5. 21. Kaplan SD. Update of a mortality study of workers in petroleum refineries. J Occup Med. 1986;28:514-6. 22. Fagin D, Lavelle M. Center for Public Integrity. Deception: how the chemical industry manipulate sciences, bends the law and threatens your health. Seacaucus, NJ: Birch Lane Press, 1997:57. 23. International Agency for Research on Cancer (IARC). Occupa tional cancer in developing countries. IARC Scientific Publica tion 1994. N. 129. 24. International Labour Office. Employment and industrial rela tions issues in oil refining: report for discussion at the tripartite meeting on employment and industrial relations issues in oil refining. Geneva, Switzerland: ILO, 1998. VOL 11/N O 4, OCT/DEC 2005 www.ijoeh.com Business Bias 359