Kuhn and JAMA
Friday, December 30th, 2005Scientific journals are not sacred texts, and indeed are the battle grounds for contending factions and egos, not necessarily identical with any objective pursuit of truth. Not a new idea, but worth repeating now in the face of leftist assaults on for-profit pharmaceudical research. Leftists have moved into the leadership of the major medical journals with the intent of using the levers of academic prestige to move public policy against the market and towards state-subsidized academic/bureaucratic dominance of medicine. Politics dressed in lab coats.
But unbeknownst to the media, the journals at the top got there because of herd behavior by researchers, not because they are better than lower-tier journals at vetting research quality. Here’s why: Researchers submit their best work to the top journals, which can therefore afford to maintain their prestige by rejecting, not publishing, many high quality papers. That’s brand creation — not science. Most of their editorial effort goes into deciding which submitted papers are sufficiently newsworthy. Anonymous peer review by jealous competitors has its merits, but it has a tendency to select for fashionable if relatively unoriginal and inoffensive papers. Top medical journals compete for papers describing large clinical trials reporting small effects of treatments for diseases affecting many people, although these reports often do not substantively advance scientific knowledge, and many subsequently are invalidated.
[…]
If reporters understood that journals are magazines, not Holy Scripture, we might not be witnessing ever more onerous regulations inhibiting interactions between academic and industry science. Prestigious biomedical journals are good for our health — provided they stick to their core business of facilitating imperfect communication between researchers. Leave drug and device monitoring to the FDA — and theology to theologians.
While Kuhn recognized the delaying effects of career interests and personal investment in particular ways of understanding a phenomenon, he ultimately believed that there was real progress in understanding. The current generation of activist-academics have been indoctrinated in social constructionism and the belief that all is power and power is all.