Skip to content

Issues: vllm-project/aibrix

v0.3.0 roadmap
#698 opened Feb 18, 2025 by Jeffwan
Open 8
Research & Industry Collaboration Invitation
#699 opened Feb 18, 2025 by Jeffwan
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

144 Open 283 Closed
144 Open 283 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[RFC]: Cache and Router refactoring for concurrent performance, concurrent safety and stateful routing. area/gateway area/heterogeneous priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
#868 opened Mar 14, 2025 by zhangjyr
@zhangjyr
Support linux for vllm cpu local development
#866 opened Mar 14, 2025 by nurali-techie
1
Antiaffinity in kvcache crd as temporary solution area/kv-cache
#864 opened Mar 14, 2025 by gangmuk
1
[Dist KV] vllm pods which do not have kvcache pods running in the same node crashes. area/kv-cache
#863 opened Mar 14, 2025 by gangmuk
@DwyaneShi
Pluggable Gateway
#861 opened Mar 14, 2025 by danehans
2
Documentation is not clearly defined on how to set the RateLimiting and how to measure the token consumption and how to enable the authentication for different users
#859 opened Mar 13, 2025 by vivekrsintc
1
Error: Invalid character 'u' looking for beginning of value
#858 opened Mar 13, 2025 by vivekrsintc
Automate local disk management and ai runtime model management area/runtime kind/feature Categorizes issue or PR as related to a new feature. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#854 opened Mar 12, 2025 by Jeffwan
Pod scale success,aibrix-controller-manager failed to parse metrics area/autoscaling kind/support Categorizes issue as a support question. triage/needs-information Indicates an issue needs more information in order to work on it.
#852 opened Mar 12, 2025 by ying2025
2
Depoy QwQ-32B model with aibrix v0.2.0 installed in K8S
#851 opened Mar 12, 2025 by geniuslc11
5
[RateLimit] TPM computation based on origin response
#848 opened Mar 11, 2025 by Stephen-X
Provide production grade overlay manifests area/installation kind/enhancement New feature or request priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#847 opened Mar 11, 2025 by Jeffwan
[RFC]: Make API Gateway interface OpenAI compatible area/gateway kind/enhancement New feature or request priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
#846 opened Mar 11, 2025 by Jeffwan
[Observation] Improve AIBrix control plane monitoring area/stability kind/feature Categorizes issue or PR as related to a new feature. priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete.
#845 opened Mar 11, 2025 by Jeffwan
[Docs] Provide AIBrix upgrade guidance area/installation kind/documentation Improvements or additions to documentation priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#844 opened Mar 11, 2025 by Jeffwan
[Feature] Support inference engine SGLang
#843 opened Mar 11, 2025 by Belyenochi
Ask for testing suggestions kind/support Categorizes issue as a support question. triage/needs-information Indicates an issue needs more information in order to work on it.
#842 opened Mar 10, 2025 by ying2025
7
OSError: /models/deepseek-r1 does not appear to have a file named configuration_deepseek.py. Checkout 'https://huggingface.co//models/deepseek-r1/tree/None' for available files.
#834 opened Mar 9, 2025 by Jeffwan
@Jeffwan
8
Some prompts with special character fail the benchmark script area/benchmark kind/bug Something isn't working priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#832 opened Mar 9, 2025 by Jeffwan
RayClusterFleet controllers shows some reconcilation issues
#831 opened Mar 8, 2025 by Jeffwan
1
Making prefix-cache-and-load-aware routing more general area/gateway area/performance kind/enhancement New feature or request kind/feature Categorizes issue or PR as related to a new feature. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
#814 opened Mar 7, 2025 by gangmuk
@Jeffwan @varungup90
2
Prefix sharing workload generation area/benchmark area/performance priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#813 opened Mar 7, 2025 by gangmuk
1
3
ModelAdapter seems to be working abnormally area/lora kind/support Categorizes issue as a support question. triage/needs-information Indicates an issue needs more information in order to work on it.
#801 opened Mar 5, 2025 by ying2025
1
Making max-tokens configurable in the benchmark client. area/benchmark
#797 opened Mar 5, 2025 by gangmuk
Recording request routing(target-pod) in the benchmark client area/benchmark
#796 opened Mar 5, 2025 by gangmuk
ProTip! no:milestone will show everything without a milestone.