Two Reasons Good News From Medical Trials is Often Overturned Later

October 27, 2012
48 Views

Medical trials that claim large effects from treatment are often followed by much less impressive results the more they are replicated or tried out in the real world. A new study reports two factors behind this, one of which is obvious, the other less so.

Medical trials that claim large effects from treatment are often followed by much less impressive results the more they are replicated or tried out in the real world. A new study reports two factors behind this, one of which is obvious, the other less so.

The first factor is that trials showing big effects are often performed with few trial participants. The small sizes make it a lot more likely that the results are based on chance. Follow-up studies tend to show a regression to the mean as the effect of chance is reduced. That’s the obvious one.

The other factor is that many of the large-effect studies are based on intermediate endpoints, such as lowering cholesterol, rather than more meaningful outcomes such as extension of life or prevention of heart attack.

In general patients and doctors should be skeptical when they hear about a trial showing great results. Look to see if it’s a big or small trial and what endpoint is being measured.

 


You may be interested

Care On The Road: How Telemedicine Can Reach Truck Drivers
Mobile Health
10 views
Mobile Health
10 views

Care On The Road: How Telemedicine Can Reach Truck Drivers

Larry Alton - August 21, 2017

Telemedicine is considered a powerful tool for individuals living in rural areas, far from adequate services or in need of…

Where Is The Balance? Pushing Back Against Consumer Health Tech
eHealth
3 views
eHealth
3 views

Where Is The Balance? Pushing Back Against Consumer Health Tech

Larry Alton - August 18, 2017

When Republican Congressman Jason Chaffetz glibly remarked that Americans struggling to afford insurance should choose between that and their smartphones,…

What to Look for in Patient Solutions Software
eHealth
365 views
eHealth
365 views

What to Look for in Patient Solutions Software

Robert Cordray - August 17, 2017

The medical sector is one area where technology has had a significant impact, largely by providing tools that simplify many…