Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirements

This work focuses on the novel problem setting of generating graphs conditioned on a description of the graph's functional requirements in a downstream task. We pose the problem as a text-to-text generation problem and focus on the approach of fine-tuning a pretrained large language model (LLM)...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-11
Main Authors: Zachares, Peter A, Hovhannisyan, Vahan, Mosca, Alan, Yarin Gal
Format: Article
Language:English
Subjects:
Graphs
Knowledge representation
Large language models
Message passing
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This work focuses on the novel problem setting of generating graphs conditioned on a description of the graph's functional requirements in a downstream task. We pose the problem as a text-to-text generation problem and focus on the approach of fine-tuning a pretrained large language model (LLM) to generate graphs. We propose an inductive bias which incorporates information about the structure of the graph into the LLM's generation process by incorporating message passing layers into an LLM's architecture. To evaluate our proposed method, we design a novel set of experiments using publicly available and widely studied molecule and knowledge graph data sets. Results suggest our proposed approach generates graphs which more closely meet the requested functional requirements, outperforming baselines developed on similar tasks by a statistically significant margin.
ISSN:2331-8422