8000 Optimize index creation time by Ma-cat · Pull Request #1240 · infiniflow/infinity · GitHub

More Web Proxy on the site http://driver.im/

Optimize index creation time#1240

Merged

yuzhichang merged 18 commits intoinfiniflow:mainfrom

Ma-cat:create-index-optimize-merge

May 24, 2024

Commits on May 10, 2024

optimize external sort comparison and reduce index creation time by 10%
Ma-cat
committed

Commits on May 13, 2024

implement the loser tree and use the loser tree to replace the heap to achieve multi-way merge time and improve performance
Ma-cat
committed
refactor the loser tree to reduce the impact of function and copy on performance
Ma-cat
committed

Commits on May 14, 2024

Optimize io for creating index
Ma-cat
committed

Commits on May 15, 2024

spill file write with more buf for creating index
Ma-cat
committed

Commits on May 17, 2024

remove the predict thread and output thread, use mmap for sequential reading and merge execution, and try three mmap reading methods
Ma-cat
committed

Commits on May 20, 2024

refactor merge and predict, use CycleBuffer read more buf for merge and perdict
Ma-cat
committed

Commits on May 22, 2024

use queue to output merge results and add TermTupleList to reduce the output temporary data size
Ma-cat
committed

0