Efficient indexing data structures for flash-based sensor devices

• Published in: ACM transactions on storage 2006-11, Vol.2 (4), p.468-503
• Main Authors: Lin, Song, Zeinalipour-Yazti, Demetrios, Kalogeraki, Vana, Gunopulos, Dimitrios, Najjar, Walid A.
• Format: Article
• Language: English
• ISSN: 1553-3077; 1553-3093
• DOI: 10.1145/1210596.1210601

Flash memory is the most prevalent storage medium found on modern wireless sensor devices (WSDs) . In this article we present two external memory index structures for the efficient retrieval of records stored on the local flash memory of a WSD. Our index structures, MicroHash and MicroGF (micro grid files) , exploit the asymmetric read/write and wear characteristics of flash memory in order to offer high-performance indexing and searching capabilities in the presence of a low-energy budget, which is typical for the devices under discussion. Both structures organize data and index pages on the flash media using a sorted by timestamp file organization. A key idea behind these index structures is that expensive random access deletions are completely eliminated. MicroHash enables equality searches by value in constant time and equality searches by timestamp in logarithmic time at a small cost of storing index pages on the flash media. Similarly, MicroGF enables spatial equality and proximity searches in constant time. We have implemented these index structures in nesC, the programming language of the TinyOS operating system. Our trace-driven experimentation with several real datasets reveals that our index structures offer excellent search performance at a small cost of constructing and maintaining the index.