Nonlocal Random Walks Algorithm for Semi-Automatic 2D-to-3D Image Conversion

• Published in: IEEE signal processing letters 2015-03, Vol.22 (3), p.371-374
• Main Authors: Yuan, Hongxing, Wu, Shaoqun, Cheng, Peihong, An, Peng, Bao, Shudi
• Format: Article
• Language: English
• Subjects: 2D-to-3D conversion; Algorithms; Boundaries; Color; Conversion; depth boundaries; depth-map; Equations; Fine structure; Image edge detection; Materials; Mathematical model; nonlocal neighbors; nonlocal random walks; Pixels; Random walk; Random walk theory; Signal processing algorithms; Vectors
• ISSN: 1070-9908; 1558-2361
• DOI: 10.1109/LSP.2014.2359643

We propose a nonlocal random walks (NRW) algorithm to generate accurate depth from 2D images based on user interaction. First, a graphical model is proposed where edges are corresponding to links between local and nonlocal neighboring pixels. Local edges are weighted by a pixel dissimilarity measure, and spatial distances are incorporated into calculation of nonlocal weights. Second, user-defined values are mapped to probabilities that marked pixels have the maximum depth value, and the probabilities of unmarked pixels are obtained by NRW algorithm. Finally, the dense depth-map is recovered with the resulting probabilities. Since nonlocal principle is effective in preserving fine structures in images, we can recover sharp depth boundaries. Experiments on three images containing color bleeding areas demonstrate that our method achieves much high-quality results compared with the existing random walks (RW) based methods.