Compromised Blinding

Succimer has a strong mercaptan ("rotten egg") odor that NIEHS acknowledged might make blinding impossible before the trial began. The blinding methods described in the protocol contain internal contradictions and were changed mid-trial without documentation in any publication. No assessment of blinding integrity was ever reported.

Source material is catalogued in companion resources

This limitation page presents the argument; the resources above hold the sources.

The Mercaptan Problem

Succimer is a sulfur-based chelating compound with a strong, distinctive mercaptan odor and taste. In 2004, TLC Project Officer Walter Rogan, MD described this characteristic at an NIH Grand Rounds presentation (Rogan, NIH Grand Rounds, October 27, 2004):

"If I opened a bottle of succimer, down here, those of you in the last row would find it detectable in about 5 minutes, and intolerable in about 15…if you ever opened a rotten egg, that's what it smells like… it's a nasty drug."

— Walter J. Rogan, MD. NIH Grand Rounds, October 27, 2004.

Any parent who opened a bottle of active drug would have been immediately aware that it contained something with a strong sulfurous smell — an obvious threat to double-blind integrity in a trial where parents were responsible for administering the medication.

NIEHS Acknowledged the Problem Before the Trial

The 1992 RFP Amendment explicitly recognized the blinding challenge:

"Can parents be made blind to treatment, if children given active drug smell like mercaptan? Possibly not. Offerors could consider proposing to query parents about whether they knew if the child was getting active drug, and see if they get it right. NIEHS knows of no agent that smells like a mercaptan and could serve as a placebo."

— NIEHS. RFP Amendment of Solicitation, October 22, 1992.

The same RFP further stated:

"In general, the more open the design, the more likely it is that questions of bias will be raised about the results. Proposals that do not offer truly random treatment assignment and blind psychometric assessment are proposing in essence a different study than what was approved at NIEHS."

— NIEHS. RFP Amendment of Solicitation, October 22, 1992.

Despite acknowledging that adequate blinding might not be achievable, and recommending that investigators query parents about treatment assignment, the trial proceeded as a "double-blind" study. No such assessment of parental awareness was ever reported.

Protocol Contradictions: Version 9 vs. Version 10

TLC randomized participants from August 1994 to January 1997 (TLC Group 1998, p. 317). Two protocol versions describe incompatible blinding methods:

Protocol Version 9 (August 23, 1994) — Internal Contradiction:

These two sections describe incompatible methods within the same protocol version.

Protocol Version 10 (November 4, 1997, transcribed PDF) — Changed Methods:

Issue Concern
Mid-trial protocol change Children enrolled earlier may have received different masking methods than those enrolled later
Internal contradictions Unclear which method was actually implemented
No documentation of changes The mid-trial changes in blinding methods are not documented in any TLC publication
No blinding assessment No publication reports whether parents or staff could distinguish treatment assignment

Implications

If blinding was compromised, the direction of bias is not straightforward. Two opposing mechanisms are possible:

The absence of any blinding assessment means neither mechanism can be evaluated. CONSORT guidelines recommend assessing whether blinding was maintained, particularly when the intervention has distinctive sensory characteristics. This was not done.

Source documents referenced on this page are available in the TLC Reference Library.