Intrinsic and extrinsic effects on image memorability

• Published in: Vision research (Oxford) 2015-11, Vol.116 (Pt B), p.165-178
• Main Authors: Bylinskii, Zoya, Isola, Phillip, Bainbridge, Constance, Torralba, Antonio, Oliva, Aude
• Format: Article
• Language: English
• Subjects: Attention; Context; Eye movements; Eye Movements - physiology; Female; Fine-grained categories; Humans; Image memorability; Male; Memory, Long-Term - physiology; Pattern Recognition, Visual - physiology; Scene dataset; Task Performance and Analysis; Visual distinctiveness; Young Adult
• ISSN: 0042-6989; 1878-5646
• DOI: 10.1016/j.visres.2015.03.005

[Display omitted] •Intrinsic differences in memorability exist at a fine-grained, within-category scale.•Image context and observer behavior predictably affect memorability.•Context effects are modeled using an information-theoretic framework.•Eye movements can be used to predict if an image will be remembered later. Previous studies have identified that images carry the attribute of memorability, a predictive value of whether a novel image will be later remembered or forgotten. Here we investigate the interplay between intrinsic and extrinsic factors that affect image memorability. First, we find that intrinsic differences in memorability exist at a finer-grained scale than previously documented. Second, we test two extrinsic factors: image context and observer behavior. Building on prior findings that images that are distinct with respect to their context are better remembered, we propose an information-theoretic model of image distinctiveness. Our model can automatically predict how changes in context change the memorability of natural images. In addition to context, we study a second extrinsic factor: where an observer looks while memorizing an image. It turns out that eye movements provide additional information that can predict whether or not an image will be remembered, on a trial-by-trial basis. Together, by considering both intrinsic and extrinsic effects on memorability, we arrive at a more complete and fine-grained model of image memorability than previously available.