Has artificial intelligence become alchemy?

• Published in: Science (American Association for the Advancement of Science) 2018-05, Vol.360 (6388), p.478-478
• Main Author: Hutson, Matthew
• Format: Article
• Language: English
• ISSN: 0036-8075; 1095-9203
• DOI: 10.1126/science.360.6388.478

Machine learning needs more rigor, scientists argue. Ali Rahimi, a researcher in artificial intelligence (AI) at Google in San Francisco, California, has charged that machine learning algorithms, in which computers learn through trial and error, have become a form of "alchemy." Researchers, he says, do not know why some algorithms work and others don't, nor do they have rigorous criteria for choosing one AI architecture over another. Now, in a paper presented on 30 April at the International Conference on Learning Representations in Vancouver, Canada, Rahimi and his collaborators document examples of what they see as the alchemy problem and offer prescriptions for bolstering AI's rigor. The issue is distinct from AI's reproducibility problem, in which researchers can't replicate each other's results because of inconsistent experimental and publication practices. It also differs from the "black box" or "interpretability" problem in machine learning: the difficulty of explaining how a particular AI has come to its conclusions.