-
Notifications
You must be signed in to change notification settings - Fork 507
Pull requests: InternLM/lmdeploy
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
support loading model with user input params (turbomind)
enhancement
New feature or request
#3204
opened Mar 3, 2025 by
irexyc
Loading…
support setting devices for turbomind backend
improvement
#3203
opened Mar 3, 2025 by
irexyc
Loading…
Tool reasoning parsers and streaming function call
BC-breaking
improvement
#3198
opened Feb 28, 2025 by
AllentDan
Loading…
fix: replace inf with max or min finite value, then do softmax
#3059
opened Jan 21, 2025 by
KenForever1
Loading…
support Turbomind ep
enhancement
New feature or request
#2883
opened Dec 12, 2024 by
irexyc
Loading…
Support Medusa speculative decoding
enhancement
New feature or request
#2859
opened Dec 5, 2024 by
AllentDan
Loading…
Refactor turbomind attention by precomputing rotary embed
improvement
#2801
opened Nov 25, 2024 by
irexyc
Loading…
[Feature] Support llava onevision
enhancement
New feature or request
#2783
opened Nov 21, 2024 by
deepindeed2022
Loading…
support qwen2-vl with turbomind backend
enhancement
New feature or request
#2720
opened Nov 6, 2024 by
irexyc
Loading…
Run loop.run_until_complete in another thread
improvement
#2701
opened Nov 4, 2024 by
AllentDan
Loading…
[Feature] Support vision module w8a8 inference
improvement
#2308
opened Aug 14, 2024 by
AllentDan
Loading…
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.