Life science research increasingly runs on software. A good fraction, perhaps even most of it, is made by academics, for academics: Rough around the edges, perhaps, but effective — not to mention free. But, is it of high quality?
HITS group leader and professor for computer sicence Alexandros Stamatakis has been developing and refining software tools for evolutionary biology for more than 15 years, including RAxML. He and his team tested and compared 16 different popular phylogenetic tools (plus, as a control, one from the field of astronomy), which collectively have been cited more than 90,000 times to find out if they meet the needed quality standards. The result: none of the 16 programs in the round-up, including Stamatakis’ own RAxML, aced all the tests. However, the study does not suggest that the programmers who wrote those tools did a bad job nor does the study suggest that the codes do not work properly. The HITS researchers merely recommend other researchers to exercise caution in using these tools and ask editors to keep potential errors in mind when reporting about research data.
The study therefore can be seen as quality assurance within the field of phylogenetics and delivers important impulses for fellow researchers.
The results of the survey have been published in Molecular Biology and Evolution.
HITS, the Heidelberg Institute for Theoretical Studies, was established in 2010 by physicist and SAP co-founder Klaus Tschira (1940-2015) and the Klaus Tschira Foundation as a private, non-profit research institute. HITS conducts basic research in the natural, mathematical, and computer sciences. Major research directions include complex simulations across scales, making sense of data, and enabling science via computational research. Application areas range from molecular biology to astrophysics. An essential characteristic of the Institute is interdisciplinarity, implemented in numerous cross-group and cross-disciplinary projects. The base funding of HITS is provided by the Klaus Tschira Foundation.