Simultaneous structure and texture image inpainting

• Published in: IEEE transactions on image processing 2003-08, Vol.12 (8), p.882-889
• Main Authors: Bertalmio, M., Vese, L., Sapiro, G., Osher, S.
• Format: Article
• Language: English
• Subjects: Algorithms; Applied sciences; Decomposition; Engineering profession; Exact sciences and technology; Filling; Image coding; Image communication; Image decomposition; Image processing; Image reconstruction; Image restoration; Information, signal and communications theory; Noise; Signal processing; Surface layer; Switches; Synthesis; Telecommunications and information theory; Texture
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2003.815261

An algorithm for the simultaneous filling-in of texture and structure in regions of missing image information is presented in this paper. The basic idea is to first decompose the image into the sum of two functions with different basic characteristics, and then reconstruct each one of these functions separately with structure and texture filling-in algorithms. The first function used in the decomposition is of bounded variation, representing the underlying image structure, while the second function captures the texture and possible noise. The region of missing information in the bounded variation image is reconstructed using image inpainting algorithms, while the same region in the texture image is filled-in with texture synthesis techniques. The original image is then reconstructed adding back these two sub-images. The novel contribution of this paper is then in the combination of these three previously developed components, image decomposition with inpainting and texture synthesis, which permits the simultaneous use of filling-in algorithms that are suited for different image characteristics. Examples on real images show the advantages of this proposed approach.