Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust retriever's (rrf) rank_window requirements with pagination. #124632

Open
benwtrent opened this issue Mar 12, 2025 · 1 comment
Open

Adjust retriever's (rrf) rank_window requirements with pagination. #124632

benwtrent opened this issue Mar 12, 2025 · 1 comment
Labels
>enhancement :Search Relevance/Ranking Scoring, rescoring, rank evaluation. Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch

Comments

@benwtrent
Copy link
Member

Description

Right now, for pagination to work at all and be consistent, we require gathering all the search results that will be ranked in total. Meaning rank_window must be larger than from+size and we then rank the set.

I wonder if we can improve this. It seems there is some performance to be gained. It gets tricky with RRF as its possible that we see a document later in the rank window that wasn't present before in the early pages, thus boosting it and reordering previous pages and subsequent pages.

So, this won't be simple, but I think we can get through the ordering weirdness by faking the ordering in later pages to keep things consistent (e.g. pretend we have seen pages before and recognize we are incorrectly reordering)

@benwtrent benwtrent added >enhancement needs:triage Requires assignment of a team area label :Search Relevance/Ranking Scoring, rescoring, rank evaluation. and removed needs:triage Requires assignment of a team area label labels Mar 12, 2025
@elasticsearchmachine elasticsearchmachine added the Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch label Mar 12, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search-relevance (Team:Search Relevance)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :Search Relevance/Ranking Scoring, rescoring, rank evaluation. Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch
Projects
None yet
Development

No branches or pull requests

2 participants