Eighth Retraction Marks Slide of Cancer Genetics Work

January 10, 2012

By Ivan Oransky, MD

NEW YORK (Reuters Health) Jan 09 - In a reminder of how much a once-heralded area of cancer research has crumbled, a former Duke oncologist and his colleagues issued their eighth study retraction late last week.

Like the others, it was related to validation of gene signatures that predict treatment outcomes.

On Friday, Dr. Anil Potti and his co-authors formally withdrew a 2008 study in the Journal of the American Medical Association that purported to offer a genetic signature that would show which patients with breast cancer would respond to a particular treatment.

The authors write in a statement on the JAMA website -- available at http://bit.ly/AeIufY -- that they are retracting the paper because it was based on a method they now believe is unreliable. That approach -- which no one has been able to reproduce -- was described in a now-withdrawn paper in the journal Nature Medicine in 2006.

The case is yet another example of researchers -- some with financial interests in the results -- being overly enthusiastic about findings that did not hold up to scrutiny.

The retraction by Dr. Potti is the eighth of what Duke officials said this past summer would be about a dozen - most related to genetic signatures for lung cancer -- along with another dozen corrections and partial retractions. The Duke team had published about 40 papers, many of which have been cited hundreds of times by other scientists, according to Thomson Scientific's Web of Knowledge.

One of the retractions was of a 2006 paper in Blood that claimed to identify a gene expression profile linked to antiphospholipid antibody syndrome accompanied by venous thrombosis. Reuters Health originally reported on that paper on March 23, 2006.

The now-retracted JAMA study garnered a fair amount of media coverage, too, including a story by Reuters Health on April 1, 2008.

Journals and universities began subjecting Dr. Potti's work to intense scrutiny, however, after it emerged that he had claimed awards and scholarships that he never received, in biographical sketches for grant applications.

The whole episode has been a "huge setback," said Dr. Otis Brawley, chief medical officer of the American Cancer Society.

"What happened at Duke is that you have a whole bunch of folks worried that this genomic information is just too complicated, making it too easy for someone to basically create fraudulent science," Dr. Brawley told Reuters Health.

UNDONE BY RESUME 'INACCURACIES'

Dr. Keith Baggerly, who studies genomics at the M.D. Anderson Cancer Center in Houston, has been looking into the Duke team's data since shortly after the Nature Medicine report came out. At that time, a colleague excitedly approached Dr. Baggerly and Dr. Kevin Coombes, hoping to use the work to improve the treatment of patients at M.D. Anderson.

But Drs. Baggerly and Coombes found numerous problems in the research, including mislabeling of data. They began asking Dr. Potti's group for the data, but the Duke team was slow to respond. Eventually, some journals began publishing critiques by Baggerly and Coombes, often alongside defenses of the work by Dr. Potti and his colleagues. Meanwhile, clinical trials making use of the genetic signature continued at Duke.

Questions from Dr. Baggerly and Dr. Coombes went largely unheeded until July 2010, when The Cancer Letter, a trade publication, reported that Dr. Potti had falsely claimed to be a Rhodes Scholar on an American Cancer Society grant application. Within months, the trials were halted, and Duke returned $729,000 to the cancer organization.

Dr. Potti resigned from Duke in November 2010, and has since joined a private oncology practice with offices in North Carolina and South Carolina. He and his colleagues, along with Duke, face two lawsuits from nine patients who took part in the trials. Eleven other such cases have already been settled for at least $75,000 each, according to the North Carolina Medical Board, which reprimanded Dr. Potti for the "inaccuracies" on his biographical sketch and CV.

According to the JAMA retraction notice, Dr. Potti works at the Myrtle Beach, South Carolina office of Coastal Cancer Center. But a person answering the phone there said he did not work in that office and was unavailable because he was in clinic.

For plaintiffs' attorneys, proving that patients were actually harmed by being in the trials will be difficult, said Dr. Brawley.

"I don't myself think that patients were harmed by being steered to a particular chemotherapy, at one level," he said. The choices in the trial were widely accepted therapies that their own doctors would have likely given them.

That wasn't the only risk, however.

"I'm a little bit concerned that some of the patients may have gone back and had new biopsies, for new analysis in the laboratory," Dr. Brawley said. "If that was purely for this trial, those were unnecessary procedures, with risks. I hope no one was harmed by that."

MOVING FORWARD

The episode is fueling soul-searching at Federal agencies.

There are "some positive things coming out of this whole mess," Dr. Baggerly said. For example, the U.S. Institute of Medicine (IOM) may require genetic tools such as the one the Duke team used to go through the same approvals that a medical device would go through at the Food and Drug Administration.

A report by the IOM is expected out in the next few months, and there are similar changes being considered at the National Cancer Institute -- which funded some of the Duke team's work -- and the Food and Drug Administration. Duke itself has created a team to establish new safeguards as genetic research moves into the clinic.

But the dark lessons remain.

"To a certain extent, what I'm worried about is that this may show aspects of how it is becoming increasingly difficult to check the scientific literature and how that difficulty stems at least in part from lack of immediate access to data but also lack of code and documentation," Dr. Baggerly told Reuters Health.

Given the highly technical nature of the work, it's not surprising that the flaws in the papers weren't caught before they were published, according to Dr. Baggerly.

"That's actually OK," he said. "It's not OK that it took so long for the challenges to be accepted once the research was questioned."

"The other thing that is not OK is the fact that it made it into guiding clinical trials," Dr. Baggerly added.

Dr. Brawley said the story "is a tragedy in a number of different ways."

"I'm actually more concerned right now with the systemic issue across the country that it's up to universities to police their researchers," he said. "But as science progresses, those universities are more and more interested in how many patents they have, and how many licenses they have for those patents."

"The universities that are responsible for assuring academic integrity actually have a conflict of interest," said Dr. Brawley, pointing out that Duke had an ownership stake in CancerGuide Diagnostics (formerly Oncogenomics, Inc.).

CancerGuide, which cut ties with Dr. Potti in July 2010 after the Rhodes misrepresentation came to light, had licensed technology based on his work at Duke, the student newspaper The Duke Chronicle reported in 2010. Duke has since divested from the company.

'A 21ST CENTURY DEFINITION OF CANCER'

Despite the setback, cancer treatment will continue to make more and more use of genetic information, Dr. Brawley said. Oncologists already use tools such as the OncotypeDX genetic test to tailor treatments for breast cancer and colon cancer.

"Since the 1840s, we've been using a light microscope to define cancer," he said. "Now with all the other advances we have, even the needle biopsy, we often find a one-centimeter tumor, and we're saying 'this looks like cancer,' according to a 19th-century definition. What we need is a 21st century definition of cancer."

"We've got these new tools, and people are very excited about using them," Dr. Baggerly said. "Some of these genetic level screw-ups are indeed what cause the disease, so there is the potential there. That said, some of the initial claims about how quickly we're going to be able to turn these (findings) into clinically useful assays have been overoptimistic."

"We're going to get there, but a number of the early studies thought this would be an easy problem," he said. "The biology turns out to be quite complex."

Comments

3090D553-9492-4563-8681-AD288FA52ACE
Comments on Medscape are moderated and should be professional in tone and on topic. You must declare any conflicts of interest related to your comments and responses. Please see our Commenting Guide for further information. We reserve the right to remove posts at our sole discretion.
Post as:

processing....