I found a great quote and analogy from an essay published in Current Biology by Peter Lawrence titled The mismeasurement of science. This essay takes a look at how science is measured and examines the use of impact factors and other metrics that measure scientific progress for individual scientists, academic departments and institutions.
The quote is actually from Leo Szilard, the famous Manhattan project physicist. It comes from his short science fiction story The Mark Gable Foundation from The Voice of the Dolphins: And Other Stories (read on Google Books):
“You could set up a foundation with an annual endowment of thirty million dollars. Research workers in need of funds could apply for grants, if they could make a convincing case. Have ten committees, each composed of twelve scientists, appointed to pass on these applications. Take the most active scientists out of the laboratory and make them members of these committees. …First of all, the best scientists would be removed from their laboratories and kept busy on committees passing on applications for funds. Secondly the scientific workers in need of funds would concentrate on problems which were considered promising and were pretty certain to lead to publishable results. …By going after the obvious, pretty soon science would dry out. Science would become something like a parlor game. …There would be fashions. Those who followed the fashions would get grants. Those who wouldn’t would not.”
The analogy is Lawrence’s own and relates to song writers being assessed in the same way as scientists, an analogy I can relate to having came to science from the music industry.
“It is fun to imagine song writers being assessed in the way that scientists are today. Bureaucrats employed by DAFTA (Ditty, Aria, Fugue and Toccata Assessment) would count the number of songs produced and rank them by which radio stations they were played on during the first two weeks after release. The song writers would soon find that producing junky Christmas tunes and cosying up to DJs from top radio stations advanced their careers more than composing proper music. It is not so funny that, in the real world of science, dodgy evaluation criteria such as impact factors and citations are dominating minds, distorting behaviour and determining careers.”
Continue reading How to Retard Scientific Progress
Recent Comments