Comparative Effectiveness Research: Through the Lens of Medical Innovation
By Randel Richner | Friday, June 26th, 2009
The Top headline of FDA News Device Daily today read, “Comparative Effectiveness Research has Benefits, Risks Experts Say”. Why would Device Daily consider comparative effectiveness to be risky? Many obvious concerns come to mind. There are distinct risks that the process imposed on the device industry may stifle growth. Worries abound related to the direction policy makers may employ such as when studies will be required (e.g., at the early stages of development, or later in the cycle of real-world experience), how studies will be conducted (e.g., by the government or a public/private entity), who will determine the type, scope, design and rationale for conducting such studies, what the studies will be used for (e.g., to restrict coverage, to control access).
The medical device industry has legitimate reason to worry from the increasing banter of politicians and inexperienced policy makers suggesting that comparative effectiveness controlled by a new government agency will be the silver bullet to manage unbridled utilization of medical interventions. Those experienced in device trial design and commercialization strategies for devices know that the struggle to move new innovation to the patient already takes years driven by inconsistent and irregular evaluative processes imposed by technology assessment authorities in some 3000 private payer health plans, individual hospital technology assessment groups, state Medicaid coverage entities, and Medicare local and national coverage processes. Adding another evaluative process, an entity to conduct comparative evidence research, rightly gives technology manufacturers who are currently subject to multiple assessments reason to question the true utility of another over-arching authority.
To seriously understand why and how procedures are or a technology is properly used (and is it cost-effective?) one must examine how technology use (or underuse) is linked to the payment process. Few policy makers understand the complicated payment system for medical technology that rewards doctors for the most acute, lengthy, or complex procedures performed in the highest priced site of service. Until we correct the arcane formulas that punish any technological advance that is simpler, more efficient, and delinked from physician time, any “comparative effectiveness” study is irrelevant. To recoup the extraordinary costs of development, manufacturers and physicians often have no choice but to seek fair payment through complicated coding processes that are completely disassociated from the true value of a device or procedure.
Innovators need a crystal ball to commercialize. The investor community, who fuels the pipeline of great new technological advances, has serious concerns about how the new comparative effectiveness entity may affect the future, especially the amount of investment it will take to bring something promising to commercialization. New investors, particularly private equity and hedge funds, are likely to severely curtail device investing due to the uncertainty of the expected increased development costs or delays to market.
So, Is comparative effectiveness a rational approach to managing utilization and costs?
Indeed, in principle, we need more and improved information to ensure we are wisely using resources. Randomized controlled trials (the foundation of comparative effectiveness research) have a role in large target populations, where making the wrong recommendation is high. In addition, it is important to model the risk and potential consequences of making the wrong recommendations. Failure to develop a rigorous, systematic approach to evaluating tests and interventions can lead to mistakes—good tests for instance may fail to be adopted, and bad tests may be the norm. Be wary of the manufacturers that argue RCT’s are not feasible under most circumstances. Nonetheless, we need a new paradigm for evaluation that is transparent, independent, rigorous and scalable.
The era of “trust me” science is over. We must more directly rely on the good science and studies generated by the FDA—the pre-IDE process—the very important and time-tested process – and acknowledged as valuable by all parties. Use new study approaches developed at the FDA to inform decision making and increase the rigor and scalability of these methods and apply to “comparative effectiveness” research.
In the words of Henry Waxman, Chairman of the House Energy and Commerce Committee, “We need to compare whether some of these new ideas are really advances or more costly alternatives to what we know will work”. Medical innovators with products that improve patients’ lives passionately embrace proving their worth.
A fair, open, cooperative public/private process, if designed properly will enhance the information needs of patients, physicians, and scientists and eliminate wasteful and ineffective medical technologies and procedures. Implemented without a fix of the payment system, however, the fear that this may stifle access and innovation will be realized.








