Deep neural-network prior for orbit recovery from method of moments

• Published in: Journal of computational and applied mathematics 2024-07, Vol.444, p.115782, Article 115782
• Main Authors: Khoo, Yuehaw, Paul, Sounak, Sharon, Nir
• Format: Article
• Language: English
• Subjects: 3D recovery in cryo-EM; Amortized learning; Method of moments; Multireference alignment; Neural-network; Orbit recovery problems
• ISSN: 0377-0427; 1879-1778
• DOI: 10.1016/j.cam.2024.115782

Orbit recovery problems are a class of problems that often arise in practice and various forms. In these problems, we aim to estimate an unknown function after being distorted by a group action and observed via a known operator. Typically, the observations are contaminated with a non-trivial level of noise. Two particular orbit recovery problems of interest in this paper are multireference alignment and single-particle cryo-EM modeling. In order to suppress the noise, we suggest using the method of moments approach for both problems while introducing deep neural network priors. In particular, our neural networks should output the signals and the distribution of group elements, with moments being the input. In the multireference alignment case, we demonstrate the advantage of using the NN to accelerate the convergence for the reconstruction of signals from the moments. Finally, we use our method to reconstruct simulated and biological volumes in the cryo-EM setting.