Posting list out of memory #2125
Unanswered
MarcosFP97
asked this question in
Q&A
Replies: 1 comment
-
|
Lucene does provide memory-efficient ways of traversing long postings... otherwise search would be impossible! However, this is not a common use case in Pyserini (Python). You'll have look in Anserini (Java) and see how it's directly calling the underlying Lucene methods. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi everyone,
I have previously indexed with Anserini the C4 collection. I am trying to recover the posting list for some TREC HM queries, but the problem is I am getting an "Out Of Memory Error" since some terms are very common but not stopwords. I thought about using search with pagination, but I saw it is not natively supported by Pyserini or Lucene. Any ideas on how to solve this?
Best,
Marcos
Beta Was this translation helpful? Give feedback.
All reactions