Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

371 Open 1,381 Closed
371 Open 1,381 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] 部署qwen2.5-vl-7b之后，如果想传入视频的话，部署命令需要调整什么吗？
#3249 opened Mar 13, 2025 by lmingze
3 tasks
[Bug] InternVL_2.5-78B-MPO-AWQ parallel run failed
#3248 opened Mar 13, 2025 by philipwan
3 tasks
1
[Feature] add serve model with no huggingface request
#3245 opened Mar 12, 2025 by devops724
4
[Bug] 部署的qwen2.5 vl 7b之后，跑着跑着报错，接口调用失败怎么回事？
#3244 opened Mar 12, 2025 by lmingze
3 tasks
@CUHKSZzxy
是否支持VLM 输出logprobs
#3243 opened Mar 12, 2025 by hxyghostor
@CUHKSZzxy
6
使用batch推理进行多轮对话
#3238 opened Mar 11, 2025 by 2kxx
1
[Bug] NPU下Qwen2.5-VL推理报错
#3237 opened Mar 10, 2025 by tcye
3 tasks done
@jinminxi104 @yao-fengchen
5
[Bug] 批量推理时显示eos stop_words_list 长度超限，最后(core dumped)
#3233 opened Mar 8, 2025 by Kismeu
1 of 3 tasks
@irexyc
1
Support for Flash Attention 3 for Ampere, Ada, and Hopper in LMDeploy
#3232 opened Mar 8, 2025 by radna0
@lzhangzz
[Bug] 使用profile_restful_api.py测试api_server时出现若干bug
#3231 opened Mar 8, 2025 by cccccya
3 tasks
@grimoire
1
[Bug] 使用lmdeploy serve proxy 分发服务管理下游服务，导致stream模式丢失
#3227 opened Mar 7, 2025 by Gierry
3 tasks
@AllentDan
3
VLM的serve支持请求分发/负载均衡吗？
#3226 opened Mar 7, 2025 by yaogang2060
@AllentDan
7
[Bug]使用wsl的Ubuntu22.04系统，lmdeploy任何版本使用pytorch引擎部署，加载权重文件非常卡，单个权重文件(144s/it),32B-AWQ启动 一次需要10分钟
#3225 opened Mar 6, 2025 by Gierry
3 tasks done
@grimoire
7
[Bug] no chat-template for QwQ 32B AWQ
#3224 opened Mar 6, 2025 by HuChundong
3 tasks
@AllentDan
4
lmdeploy + batch inference是推理加速的极限吗？
#3222 opened Mar 6, 2025 by nzomi
@lvhan028
1
[Bug] libharpcuda.so.0: cannot open shared object file: No such file or directory
#3211 opened Mar 4, 2025 by 3mpt
3 tasks
@RunningLeon
1
[Bug]在910B上量化后部署好无法正常访问
#3201 opened Mar 3, 2025 by jxz542189
3 tasks done
@jinminxi104
1
[HELP] 求好心人帮忙量化 DeepSeek-R1-Distill-Qwen-32B 到 int8
#3200 opened Mar 1, 2025 by SolomonLeon
1
LMDeploy Lite vs LLM Compressor
#3199 opened Mar 1, 2025 by radna0
3
[Feature] 看起来ledeploy好像天然支持替换矩阵乘法的计算。deepGEMM 刚刚发布了。怎么用
#3191 opened Feb 26, 2025 by xiezhipeng-git
[Feature] accelerate QwenEncoder
#3185 opened Feb 25, 2025 by abc8350712
多轮对话的batch推理
#3184 opened Feb 25, 2025 by wzczc
1
enable_prefix_caching LMDeploy vs vLLM
#3182 opened Feb 24, 2025 by radna0
@lvhan028
2
[Bug] 将InternVL2_5-26B-AWQ转换成turbomind之后使用turbomind引擎 部署 api请求图片解析，参数传递url与base64均报错-无法进行图片识别
#3169 opened Feb 21, 2025 by Gierry
@lvhan028
[Bug] serve does nothing when launching Mistral Small 3 AWQ
#3167 opened Feb 20, 2025 by anunknowperson
3 tasks done
2
ProTip! What’s not been updated in a month: updated:<2025-02-12.