An automated evaluation of broker compatibility for the Message Queuing Telemetry Transport protocol

• Published in: Journal of software : evolution and process 2023-07, Vol.35 (7), p.n/a
• Main Authors: Sochor, Hannes, Ferrarotti, Flavio, Ramler, Rudolf
• Format: Article
• Language: English
• Subjects: Automation; backward compatibility; Brokers; Compatibility; cross compatibility; Cybersecurity; Internet of Things; interoperability; Mathematical analysis; Messages; Queueing; security; Telemetry; testing
• ISSN: 2047-7473; 2047-7481
• DOI: 10.1002/smr.2410

Message Queuing Telemetry Transport (MQTT) is the most widely used protocol within the communication layer of the Internet of Things (IoT). Message brokers are a key component of the MQTT protocol and a single point of failure. Incompatibilities between different MQTT brokers or broker versions with their clients can cause critical failures and become a source of security risks. Thus, every MQTT broker change or update needs to be accompanied by an evaluation of the compatibility between the new and the previous broker. In this work, we develop an automated framework for compatibility evaluation of MQTT brokers, which can be easily generalized to other similar IoT components. We apply this framework to perform a comprehensive experiment conducted with 16 different versions of 6 popular MQTT brokers. We report inconsistencies in the behavior of different MQTT brokers and broker versions. Based on the experiment results, we calculate and provide a visualization of compatibility among the evaluated brokers in terms of their distance, which indicates the risk of incompatibilities when replacing a broker with another one. The calculation of distance measures can be adjusted by giving higher weights to important features. We use this method to show security‐related differences between the brokers. An automated test framework for compatibility evaluation of MQTT brokers has been developed and used to perform a comprehensive experiment with 16 different versions of 6 popular MQTT brokers. The detected inconsistencies serve as basis for visualizing the risk of incompatibility in terms of the distance between different MQTT brokers and broker versions. The approach can be focused on security‐related issues and generalized to other IoT components.