Fast and Simple Compact Hashing via Bucketing

摘要

Compact hash tables store a set S of n key-value pairs, where the keys are from the universe U = {0,a?|,u-1}, and the values are v-bit integers, in close to B(u, n) + nv bits of space, where {b(u, n)} = loga,, binom(u,n) is the information-theoretic lower bound for representing the set of keys in S, and support operations insert, delete and lookup on S. Compact hash tables have received significant attention in recent years, and approaches dating back to Cleary [IEEE T. Comput, 1984], as well as more recent ones have been implemented and used in a number of applications. However, the wins on space usage of these approaches are outweighed by their slowness relative to conventional hash tables. In this paper, we demonstrate that compact hash tables based upon a simple idea of bucketing practically outperform existing compact hash table implementations in terms of memory usage and construction time, and existing fast hash table implementations in terms of memory usage (and sometimes also in terms of construction time). A related notion is that of a compact Hash ID map, which stores a set Sì, of n keys from U, and implicitly associates each key in Sì, with a unique value (its ID), chosen by the data structure itself, which is an integer of magnitude O(n), and supports inserts and lookups on Sì,, while using close to B(u,n) bits. One of our approaches is suitable for use as a compact Hash ID map.