Document mmX4NZX7zMR3DV1Djk6LeZdXQ
Letters
We understand that by publishing contributions on matters affecting public health and the courts and the legislatures, there will be people involved who will react strongly to the articles published. Readers are invited to comment on matters in which they are involved and are urged to be as specific as possible in citing errors and raising criticisms of pub lished work. --Ed.
Scientific Method Questioned
To the Editor:--I have carefully read the special issue of your journal (Sept-Dec, 2005) guest edited by Dr. Egilman. Because I know of no similar series of papers to have ever been published in a scientific or medical journal, I feel compelled to offer some comments about it.
For the sake of disclosure, your readers should be aware that the two of us have met and that your students annually visited the occu pational health and medical departments of the firm in which I worked (Syntex) many years ago. I have also contributed a chapter on risk assessment to one of your occu pational medicine textbooks. In spite of the fact that I respect the contributions you have made to the field of occupational medicine, I am disappointed and concerned about this issue of your journal. I do not believe it was appropriate to have permitted the various authors and contributors to use your jour nal as a vehicle to legitimize views that were often speculative, undoc umented, or simply incorrect.
Unfortunately, one can reach no other conclusion but that this issue was a backdoor method of better ing the position of some of the authors in future litigation by per mitting them to claim that their views had been shared in a peer reviewed journal and, therefore, they should be admissible in court. In my view, this is an abuse of the
role of peer reviewed scientific pub lications and I believe it is inconsis tent with the guidelines of the Asso ciation of Science Editors. Nonetheless, I do believe that it is useful for scientists and physicians to have a scholarly dialogue about the various topics that are raised in this issue.
I was born in Pittsburgh in the early 1950s and my paternal grand father died of silicosis from his exposure in a glass factory. I nearly died in an industrial explosion at the age of 22 and I have been sen sitized to two or three chemical agents due to workplace exposure. I have taught several college courses addressing occupational disease. During the 1980s, I actively promoted a requirement that all engineering programs in the United States be required to teach a course in occupational health and safety. I feel strongly that cor porations should act in a forthright and ethical manner and have urged those which whom I have consulted to do so for more than 20 years.
With that background, I do have some views about why I believe this issue of your journal denigrates the reputation of scientific and medical publications. They are based on 25 years of experience in industrial hygiene, toxicology and almost daily interaction with occupational physicians, as well as having served as an associate editor or having par
ticipated on the editorial review board of at least six different scien tific journals.
a) A scholarly dialogue is useful but it should be based on facts and not innuendo. This issue of your journal failed to adhere to the rich tradi tion of scholars where one may choose to disagree with anothers interpretation of data but not ques tion the motives of the individual. Throughout this issue, many of the authors repeatedly suggested, by innuendo or by taking sentences out of context, that fellow scientists made decisions which they knew to be inappropriate, dishonest or unethical. The evidence provided was not sufficient to support such claims and a scientificjournal is not the appropriate venue to make such unsubstantiated accusations. The manner in which this issue was orchestrated did not provide a forum where the facts could be pre sented by both sides and then weighed fairly by the reader.
b) These were not commentaries: When you and I discussed this issue of the journal via email, you indi cated that these were commen taries and that they were peer reviewed. Although this may have been your goal, that is clearly not what occurred. First, the word com mentary is one that is well under stood in our field. It has tradition ally meant that the views presented are those of the author and not
290
those of the journal (nor are they usually validated by the classic peer reviewer process). Although you may have intended for them to be commentaries, the word commen tary doesnt appear on the front page of the articles (as is the tradi tion and expectation in our field) nor does that word appear any where in the issue. In fact, one can only infer that because these arti cles were meant to look like schol arly pieces (in some cases, having as many as 80 references) and because you claim they were peer reviewed, one must conclude that they were intended to give the appearance of scholarly work rather than opinion/editorial pieces.
c) The matter ofpeer review. In my opinion, it is not possible that these papers could have received proper peer review. I dont even see how the term could possibly apply since these were fundamentally the opin ions of authors backed up with a highly selected and one-sided cita tions. For the sake of discussion, if peer review had actually taken place with these commentaries, then the peer reviewers would have had to have been familiar with most of the references cited by the authors and the reviewers should have encouraged the authors to present both sides of the fence. It is unfathomable that any peer reviewer could have been in posses sion of the corporate documents that were cited and it is even less likely that they would have been aware of the many references or documents that would have painted entirely different picture of what had alleged occurred (unless he/she had testified as an expert on the other side of the issue). Also, apparently when informed reviewers were used, they may not have always been given serious con sideration. As noted by Dr. Finkel (who was apparently asked to peer review an article), his criticisms of the paper he reviewed were com pletely ignored by the author and the paper published without signif
icant revision. In short, one can only conclude that these papers were made to look like objective peer reviewed scientific manu scripts although there is little evi dence that they could have fulfilled that level of scientific journalism.
d) Inappropriate and nontraditionalformatfor debate. The intent of the issue was apparently to stimu late debate. Clearly, a debate about the issues raised could have occurred without allowing the authors to question the integrity of their debate opponents. If stimulat ing debate was indeed the true pur pose, scientific tradition would demand that persons on both sides of an issue present their case in companion articles in the same journal. Although the content of many of the articles could hardly be considered scholarly, the personal attacks offered in these articles is without precedent. Surely, if publi cation of personal attacks was to be permitted, the profession would have been better served had those on the receiving end been given a chance to have a companion piece in the same issue. To offer anyone a chance to respond to a 12 page arti cle with nearly 100 references via a letter to the editor is clearly inade quate and certainly not equitable.
e) Nontraditional disclosure of con flicts of interest. One has to be suspi cious of the manner in which acknowledgements were presented for this special issue of the journal. Again, one can only assume that it was intended to conceal from your readers the authors potential con flicts of interest and, in light of the role some of the authors play in lit igation, their financial motivation. Specifically, the acknowledgements or biographies were placed in the back of the journal so that when the manuscript was copied, the dis closure would not accompany the paper. I have never seen such an approach in my 20 years of reading as many as a dozen journals each month. Further, in several articles, attacks were leveled at persons whom the author has, or is likely to
be, offering opinion contrary to theirs in the courtroom (not one of the authors disclosed this fact).
f) The papers were indictments, not a disclosure ofnew scientific results or a scholarly analysis. The writing style used by several of the authors was exactly that used by lawyers in a legal proceeding. The authors often presented half-truths, fac toids, sentences taken out of con text and outright mischaracterizations as facts. This kind of approach is considered acceptable when lawyers present their claims to a judge in the courtroom. There is good reason that judges tell juries that what lawyers say is not evi dence! However, the factual hurdle that is required by lawyers who write these indictments is very low; far lower than a reputable scientist could possibly allow. The use of this approach is completely inappropri ate for a scientific journal.
Perhaps contrary to your views,I do believe that every journal or newspaper has a responsibility to protect the reputation of scientists against unjust accusations. That is why there are Boards to which one can take claims when newspaper reporters have got it wrong .and that is why lawyers are sometimes needed to protect persons from slander and libel.
I will close by mentioning two statements in this special issue of your journal which appear to rep resent a theme in this issue but con trary to the very foundation of sci ence. Dr. Egilman states that [b]ut the absence of evidence is not evi dence of the absence of an effect (page 360) and [o]nce it is gener ally accepted that a substance can cause disease in humans, all that is required to establish causation is documentation of exposure to that substance (page 369). Any scientist knows that both claims are flawed. First, although it is true that the absence of evidence does not prove that a causal association may not eventually be recognized, it is not scientifically appropriate to claim that a relationship exists until it is
VOL 12/NO 3, JUL/SEP 2006 www.ijoeh.com
Letters 291
established using the scientific method. One need only think about the historical view that damp weather was the cause of pneumo nia or tuberculosis, or that psychi atric disease was caused by a wan dering uterus to understand that his statement lacks merit. Second, if one were to accept his premise that all that is required to establish cau sation is documentation of expo sure, then any physician could tes tify that it is more likely than not that any cancer is likely caused by a persons chronic ingestion of chef salads since they are known to con tain huge amounts of known human carcinogens. In short, much more is needed than simply knowing that there is exposure to a chemical (at any dose) to prove causation.
I encourage you and your jour nal to create an environment where disagreements regarding the proper interpretation of scientific data can occur. This issue of the journal failed to do that and was a disservice to the rich tradition of the scholarly exchange of ideas.
Dennis J. Paustenbach, PhD, DABT Chief Principal ChemRisk 25Jessie Street, Suite 1800 San Francisco, CA 94105 tel 415-618-3201 fax 415-896-2444
In reply:--Paustenbach's accusation that we are not using the scientific method is an excellent example of what Harriet Hardy described as the way corporations [corporate lawyers and scientists] "twist and turn the truth to suit the particular need of the day." He gives the impression that we suggest that cause-effect relationships can be established with little or no evi dence when we merely echo Hill's analysis that,
All scientific work is incom plete--whether it be observa tional or experimental. All sci entific work is liable to be upset
or modified by advancing knowledge. That does not confer upon us a freedom to ignore the knowledge we already have, or to postpone the action that it appears to demand at a given time.1
Despite his "critique" of our meth ods, Paustenbach does not name a single factual or methologic error in the entire journal. This includes the Egilman and Billings article he cites, "Abuse of Epidemiology: Automo bile Manufacturers Manufacture a Defense to Asbestos Liability."
There is no dispute that asbestos causes mesothelioma, that brake work exposes workers to asbestos fibers and that there is no known level of exposure to asbestos that does not increase the risk of devel oping mesothelioma. There are more than 200 published cases of mesothelioma in brake mechanics. Paustenbach's "scientific method" requires that a formal epidemio logic study find an excess in these workers. We disagree. By analogy, once you show that arsenic can kill white women (and you don't need epidemiology to establish this), general causation is established. Once general causation is estab lished, it is reasonable to infer it can kill one-armed left-handed black men without any further evi dence. You can then infer it did kill a particular person if you show exposure and rule out other causes, neither of which is difficult for mesothelioma or arsenic poisoning if exposure has indeed taken place. As asbestos is by far the most common etiologic agent of mesothelioma, in almost all individ ual mesothelioma cases it is the only possible cause for the disease. In the context of mesothelioma in people whose sole exposures to asbestos occurred while working as brake mechanics, it is both good science and common sense to link the disease to those exposures.
Ford, GM, and Chrysler jointly paid their litigation consultant team (Paustenbach, his colleagues,
and their companies) approxi
mately $23 million between 2001
and April 2006.2-4 This is more than
enough money to conduct a
prospective epidemiologic study of
brake mechanics. Instead, the liti
gation consultants used this fund
ing to reanalyze existing general
(not brake-worker-specific) epi
demiologic and selected brake-
exposure data. Tellingly, the manu
facturer's defense lawyers--not the
manufacturers--funded
this
"research" and considered its pur
pose "in connection with the
defense of asbestos friction litiga
tion claims."3 exponent apparently
had a similar understanding of the
process, as they categorized their
work for the asbestos defendants
under the billing code "Technical
Support-Asbestos Litigation."4 Two
years before the bulk of their
research was published, Dr. Patrick
Sheehan, a coauthor on some of
the papers, provided the lawyers
one of several summaries "pre
pared at the request of counsel to
assist with the defense of pending
asbestos litigation" and designed
"to set forth litigation strategy tasks
to assist in ongoing, pending and
prospective litigation."5 Sheehan
also partnered with an automobile
defense lawyer to publish an article
in an American Bar Association
newsletter that explained how this
research could be used to put on "a
convincing science case" to defend
companies in mesothelioma litigation.6 Paustenbach claims to cham
pion the scientific method when
faced with material critical of the
corporate influence on science.
However, research carried out with
the goal to "assist with the defense
of pending asbestos litigation" does
not follow the scientific method,
which starts with a hypothesis, not a
political objective.
Corporations that make danger
ous products have a long histor y of
"manufacturing doubt."7 They try
to create scientific controversy over
the health effects of their products
and processes in order to delay or
avoid the costs of regulation, litiga
292 Letters
www.ijoeh.com INT J OCCUP ENVIRON HEALTH
tion, and environmental clean-ups. They maximize their profits by shift ing, or "externalizing," the costs of human disease and environmental decay onto taxpayers and sickened workers and their families. Pioneer ing tobacco company public rela tions firms first fabricated and then popularized a pseudo debate con cerning scientific epistemology that invariably defined "proof" as the one piece of evidence that did not yet exist. In cases where human epi demiologic evidence left no doubt about causation, they argued that animal data were required to estab lish causation (benzene, tobacco, arsenic). More commonly, when animal data, human case reports, and mechanistic understanding established a cause-effect relation ship, they claimed epidemiologic studies were required to establish causation. When epidemiologic studies finally supported a casual connection, they claimed the dose was unrepresentative (too high), or, as Paustenbach does, that an epi demiologic study of each and every job category where exposure occurs must be produced to establish a causal nexus for workers in that par ticular job classification. Then, like Paustenbach, they claimed the moral "scientific" high ground; "it is not scientifically appropriate to claim that a relationship exists until it is established using the scientific method." This "scientific method" says that the key evidence that is required to establish causation is
always the missing evidence. It is often a moving target: epidemiol ogy, epidemiology at the same or lower dose, epidemiology of the same occupational group, epidemi ology of the same gender, animal studies, animal studies that show the same cancer that humans get, multiple animal species, and so on. This is not science; it is political and financial strategems masquerading as science.
As for Paustenbach's other points, we followed submission, dis closure, and peer review policies with great concern for their integrity. Where authors received funding for conducting or writing up their research, that funding was disclosed alongside the text of the article, as is standard practice. In addition, we included a section with contributors' biographies and conflict-of-interest disclosures to provide more author information than is usually included in most journals. We did this because we know that full disclosure is para mount to good science. Perhaps unlike Paustenbach, we believe that a discussion of the corporate cor ruption of science belongs in all health and science journals, not just IJOEH. We are heartened by the increasing attention to the issue.
David S. Egilman, MD, MPH Susanna Rankin Bohme, AM 8 North Main Street, Suite 404 Attleboro, MA 02703 Tel: (508) 226-5091
References
1. Hill AB. The environment and dis ease--association or causation? Proc R Soc Med. 1965;58:296-300.
2. In re: All Goldenberg, Miller, Heller & Antognoli, P.C., Asbestos cases v. A.W. Chesterton, Inc. et al. Ford Motor Com pany's Supplemental Response to Plain tiffs' Discovery Requests in Response to the Court's April 25, 2006 Order. In the Circuit Court, Third Judicial Circuit, Madison County, Illinois. Available online at: <http://www.egilman.com/ Documents/Brakes%20Documents/ Ford%20Supplemental%20Response. DOC>.
3. In re: All Goldenberg, Miller, Heller & Antognoli, P.Q., Asbestos cases v. A.W. Chesterton, Inc. et al. General Motors Corporation's Supplemental Response to Plaintiffs' Discovery Requests in Responses to the Court's April 25, 2006 Order. In the Circuit Court, Third Judi cial Circuit, Madison County, Illinois. Available online at: <http: //www. egil man.com/Documents/Brakes%20Doc uments/GM%20Supplemental%20 Response.DOC>.
4. For one of many invoices showing the bill split into thirds, see Exponent, Invoice, October 22, 2002. Mallia v. Gen eral Motors, et al., Case No. 04-16237 CA42, in the Circuit Court of the Eleventh Judicial Circuit in and for Miami-Dade County, Florida. <http:// www.egilman. com/Documents/Brakes%20Docu ments/exponent%20invoices. pdf>.
5. Exhibit A: Ford Motor Company Privi lege Log. May 19, 2006. In re: All Goldenberg, Miller, Meller & Antognoli, P.C., Asbestos cases v. A.W. Chesterton, Inc. et al. In the Circuit Court, Third Judicial Circuit, Madison County, Illi nois. Available at: <http://www.egilman .com/Documents/Brakes%20Docu ments/Ford%20%20Privilege%20Log. pdf>.
6. Sheehan PJ, Mowat FS, Tarry SL. Havner, mechanics, and asbestos fric tion products: a convincing science case. American Bar Association Environ mental Litigation and Toxic Torts Com mittee Newsletter 8 (1): 16-21.
7. Michaels D. Doubt is their product. Sci Am. 2005;292:96-101.
VOL 12/NO 3, JUL/SEP 2006 www.ijoeh.com
Letters 293
Differential Peeky Bias
To the Editor:--Since the publication of our paper "Abuse of Epidemiol ogy: Automobile Manufacturers Manufacture a Defense to Asbestos Liability," legal counsel for the auto mobile manufacturers have raised several issues with regard to our analysis.1 We address them here.
In our paper we stated that as of 1978, "McDonald et al. reported `only' 0.4 cases of mesothelioma per 1,000 individuals in chrysotile asbestos factories. . . ."2 This number was deaths per 1,000 deaths. While we reported population incidence rates for mesothelioma, we did not directly compare them with McDon ald's death-rate data. At the sugges tion of Chrysler counsel, we have now done so. For the year 1979, the earliest year for which data were available, there were 0.18 mesothe lioma deaths per 1,000 deaths in the United States.3 This is less than half the rate of 0.4 per 1,000 deaths reported by McDonald, et al. Thus, this comparison provides further evidence for our conclusion that, "the rate reported by McDonald et al. is therefore at least more than double the expected rate."
In addition, we criticized the McDonald and McDonald study4 for limiting the determination of the source of occupational asbestos exposure to the period ten years prior to the subject's death.4 How ever, McDonald and McDonald pres ent two conflicting explanations for the years-of-exposure categorization. In the text of the Methods section, they state that "analysis of probability of occupational exposure to asbestos for patients and controls during the period up to 10 years before death is presented in Table 2." We under stood this to mean that only the period between death and 10 years prior to death was examined. How ever, a title caption for another table in the report (Table 3) indicates occupational groups for the study subjects "10 or more years before death." In either case the years of
follow-up included a ten-year period (10-20 years after exposure), during which time few if any mesotheliomas would be expected to occur. Inclu sion of these exposure data would have diluted any potential effect.
Finally, we stated that Goodman et al. used an 11-point scale to rate the studies they included in their meta-analysis. In fact, they used what appears to be a 13-point scale, which was based on 11 criteria.5 The maximum score also appears to be 8, not 9. The highest-ranking study therefore garnered a 5 out of 8, and it was the Teschke paper, not the Hessel et al. study.6,7 The Hessel paper had a score of 4, which was the second highest.
Goodman et al. relied on per sonal communications with the authors of some but not all of the papers they evaluated, allowing them to reject articles that other wise would have been included in the meta-analysis.8 The authors based their justification for the exclusion of two studies which were unfavorable to their sponsors' financial interests on this differen tial, unsystematic pursuit of addi tional exposure information.10,11 For example, Goodman et al. excluded the paper by Malker et al. (which revealed the highest RR, 2.4, for mechanics) because one of the authors of the study could not document actual brake work among workers in this category.9 We have named this differential study evaluation methodologic error (i.e., the selective pursuit of unreported exposure information to enhance favorable data or to dis credit unfavorable data) the "differ ential peeky bias." We thank
Chrysler's counsel for their com ments and suggestions.
David S. Egilman, MD, MPH Department of Community Health Brown University Providence, RI
Marion A. Billings, MSc Global Health through Education,
Training and Service
Attleboro, MA
References
1. Egilman DS, Billings MA. Abuse of epi demiology: automobile manufacturers manufacture a defense to asbestos lia bility. Int J Occup Environ Health. 2005;11:360-71.
2. McDonald AD, McDonald JC, Pooley FD. Mineral fibre content of lung in mesothelial tumours in North America. Ann Occup Hyg. 1982;26:417-22.
3. National Center for Health Statistics, Compressed Mortality File, compiled from CMF 1968-1988, Series 20, No. 2A 2000 on CDC WONDER On-line Database. <http://wonder.cdc.gov/>.
4. McDonald AD, McDonald JC. Malig nant mesothelioma in North America. Cancer. 1980;46:1650-6.
5. Goodman M, Teta MJ, Hessel PA, et al. Mesothelioma and lung cancer among motor vehicle mechanics: a meta-analy sis. Ann Occup Hyg. 2004;49:309-26.
6. Teschke K, Mortgan MS, Checkoway H, et al. Mesothelioma surveillance to locate sources of exposure to asbestos. Can J Public Health. 1997;88:163-8.
7. Hessel PA, Teta MJ, Goodman M, Lau E. Mesothelioma among brake mechan ics: an expanded analysis of a case-con trol study. Risk Anal. 2004; 24:547-52.
8. Goodman M, Teta MJ, Hessel PA, et al. Mesothelioma and lung cancer among motor vehicle mechanics: a meta-analy sis. Ann Occup Hyg. 2004;49:309-26.
9. Malker HS, McLaughlin JK, Malker BK et al. Occupational risks for pleural mesothelioma in Sweden, 1961-1979. J Natl Cancer Inst. 1985;74:61-6.
10. Goodman M, Teta MJ, Hessel PA, et al. Mesothelioma and lung cancer among motor vehicle mechanics: a meta-analy sis. Ann Occup Hyg. 2004;49:309-26.
11. Personal communication, Goodman M to Billings M, April 14, 2006.
Correction
An error appeared in Table 3, page 131, of the article, "Linking Environmental Hazards and Birth Defects Data" (Brender et al., Int J Occup Environ Health 2006;12:126-133). The first heading, "Residence within One Mile of Hazardous Waste Site" should read "Residence within One Mile of TRI Industrial Facility."
294 Letters
www.ijoeh.com INT J OCCUP ENVIRON HEALTH