FlauBERT vs. CamemBERT: Understanding patient's answers by a French medical chatbot

• Published in: Artificial intelligence in medicine 2022-05, Vol.127, p.102264-102264, Article 102264
• Main Authors: Blanc, Corentin, Bailly, Alexandre, Francis, Élie, Guillotin, Thierry, Jamal, Fadi, Wakim, Béchara, Roy, Pascal
• Format: Article
• Language: English
• Subjects: CamemBERT; FlauBERT; Humans; Intent and slot prediction; Intention; Language; Language models; Life Sciences; Natural Language Processing; Natural Language Understanding; Neural network architectures; Neural Networks, Computer; Software
• ISSN: 0933-3657; 1873-2860
• DOI: 10.1016/j.artmed.2022.102264

In a number of circumstances, obtaining health-related information from a patient is time-consuming, whereas a chatbot interacting efficiently with that patient might help saving health care professional time and better assisting the patient. Making a chatbot understand patients' answers uses Natural Language Understanding (NLU) technology that relies on ‘intent’ and ‘slot’ predictions. Over the last few years, language models (such as BERT) pre-trained on huge amounts of data achieved state-of-the-art intent and slot predictions by connecting a neural network architecture (e.g., linear, recurrent, long short-term memory, or bidirectional long short-term memory) and fine-tuning all language model and neural network parameters end-to-end. Currently, two language models are specialized in French language: FlauBERT and CamemBERT. This study was designed to find out which combination of language model and neural network architecture was the best for intent and slot prediction by a chatbot from a French corpus of clinical cases. The comparisons showed that FlauBERT performed better than CamemBERT whatever the network architecture used and that complex architectures did not significantly improve performance vs. simple ones whatever the language model. Thus, in the medical field, the results support recommending FlauBERT with a simple linear network architecture. •Medical chatbots may help healthcare providers save time and orient patients.•Chatbots use Natural Language Understanding (NLU) to analyze patients' answers.•NLU helps building language models that predict intents and slots from sentences.•Two French language models were compared regarding intent and slot prediction.•FlauBERT outperformed CamemBERT with all neural network architectures used for intent and slot prediction.