Deep learning for predicting patent application outcome: The fusion of text and network embeddings

• Published in: Journal of informetrics 2023-05, Vol.17 (2), p.101402, Article 101402
• Main Authors: Jiang, Hongxun, Fan, Shaokun, Zhang, Nan, Zhu, Bin
• Format: Article
• Language: English
• Subjects: Deep learning; Feature fusion; Network embedding; Patent application; Text embedding
• ISSN: 1751-1577; 1875-5879
• DOI: 10.1016/j.joi.2023.101402

•We design and evaluate a deep learning-based framework to predict patent application outcomes.•We are the first to propose to combine text mining and heterogenous network analysis for patent prediction.•Our method outperforms baseline methods in all performance metrics. Patents have been increasingly used as an instrument to study innovation strategies and financial performance of firms recently. Early prediction of patent application success can help firms make better decisions about their investment and innovation strategies. However, predicting patent application outcome is a difficult task that requires the understanding of both deep domain knowledge and complicated legal procedures. In this paper, we propose a novel deep learning framework to mine both the text content and context network, and then fuse these two aspects of features to train a forecasting model to predict the outcome of patent applications. To evaluate the proposed framework, we collect a real-world dataset from the United States Patent and Trademark Office (USPTO). Our method significantly outperforms previous models (e.g., Doc2vec, SciBERT, and PatentBERT) in various metrics, reaching an F1 score of 75.01 percent, and remains robust on different data samples and different scales. Ablation experiments verify that both text and network features help improve the performance of prediction models.