Nucleotide String Indexing using Range Matching

08/06/2023
by   Alon Rashelbach, et al.
0

The two most common data-structures for genome indexing, FM-indices and hash-tables, exhibit a fundamental trade-off between memory footprint and performance. We present Ranger, a new indexing technique for nucleotide sequences that is both memory efficient and fast. We observe that nucleotide sequences can be represented as integer ranges and leverage a range-matching algorithm based on neural networks to perform the lookup. We prototype Ranger in software and integrate it into the popular Minimap2 tool. Ranger achieves almost identical end-to-end performance as the original Minimap2, while occupying 1.7× and 1.2× less memory for short- and long-reads, respectively. With a limited memory capacity, Ranger achieves up to 4.3× speedup for short reads compared to FM-Index, and up to 4.2× and 1.8× speedups for short- and long-reads, compared to hash-tables. Ranger opens up new opportunities in the context of hardware acceleration by reducing the memory footprint of long-seed indexes used in state-of-the-art alignment accelerators by up to 23× which results with 3× faster alignment and negligible accuracy degradation. Moreover, its worst case memory bandwidth and latency can be bounded in advance without the need to inflate DRAM capacity.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset