Unifying Parsing and Reflective Printing for Fully Disambiguated Grammars

• Published in: New generation computing 2020-07, Vol.38 (3), p.423-476
• Main Authors: Zhu, Zirun, Ko, Hsiang-Shang, Zhang, Yongzhe, Martins, Pedro, Saraiva, João, Hu, Zhenjiang
• Format: Article
• Language: English
• Subjects: Artificial Intelligence; Computer Hardware; Computer Science; Computer Systems Organization and Communication Networks; Consistency; Domain specific languages; Grammars; Optimization; Parsers; Printers; Software Engineering/Programming and Operating Systems
• ISSN: 0288-3635; 1882-7055
• DOI: 10.1007/s00354-019-00082-y

Language designers usually need to implement parsers and printers. Despite being two closely related programs, in practice they are often designed separately, and then need to be revised and kept consistent as the language evolves. It will be more convenient if the parser and printer can be unified and developed in a single program, with their consistency guaranteed automatically. Furthermore, in certain scenarios (like showing compiler optimisation results to the programmer), it is desirable to have a more powerful reflective printer that, when an abstract syntax tree corresponding to a piece of program text is modified, can propagate the modification to the program text while preserving layouts, comments, and syntactic sugar. To address these needs, we propose a domain-specific language BiYacc , whose programs denote both a parser and a reflective printer for a fully disambiguated context-free grammar. BiYacc is based on the theory of bidirectional transformations, which helps to guarantee by construction that the generated pairs of parsers and reflective printers are consistent. Handling grammatical ambiguity is particularly challenging: we propose an approach based on generalised parsing and disambiguation filters, which produce all the parse results and (try to) select the only correct one in the parsing direction; the filters are carefully bidirectionalised so that they also work in the printing direction and do not break the consistency between the parsers and reflective printers. We show that BiYacc is capable of facilitating many tasks such as Pombrio and Krishnamurthi’s ‘resugaring’, simple refactoring, and language evolution.