Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error using rerank twice #4967

Open
knaga35 opened this issue Mar 10, 2025 · 0 comments
Open

Error using rerank twice #4967

knaga35 opened this issue Mar 10, 2025 · 0 comments
Labels
bug Something isn't working unconfirmed

Comments

@knaga35
Copy link

knaga35 commented Mar 10, 2025

LocalAI version:

  • v2.23.0-cublas-cuda12

Environment, CPU architecture, OS, and Version:

  • Ubuntu 22.04 x86_64

Describe the bug

  • When using rerank twice on a chatbot created with Dify, an error may occur without response.
    -- The first time, it is simply reranked in the knowledge base.
    -- The second time, it is reranked in the Multi-path Retrieval mode. (It seems to be occurred the error.)

To Reproduce

  • Dify chatbot application
  1. Create knowledge
     Retrieval Setting : Vector Search
     Rerank Model : BAAI/bge-reranker-v2-m3

  2. Create a chatbot application
     Add the knowledge base in the context.
      Retrieval Setting : Rerank Model
      Rerank Model : BAAI/bge-reranker-v2-m3

  3. Enter content in the box to start debugging the Chatbot
     There is no problem depending on the content of the question, but the following error may occur.

Expected behavior

  • Some kind of response will be returned.

Logs

4:12AM INF Success ip=172.18.0.10 latency=25.650528ms method=POST status=200 url=/v1/rerank
4:12AM ERR Server error error="rpc error: code = Unknown desc = Exception calling application: 'Result' object has no attribute 'results'" ip=172.18.0.10 latency=12.944511ms method=POST status=500 url=/v1/rerank

Additional context

@knaga35 knaga35 added bug Something isn't working unconfirmed labels Mar 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working unconfirmed
Projects
None yet
Development

No branches or pull requests

1 participant