Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build triton_trt_llm image in debug mode #691

Open
nzarif opened this issue Feb 5, 2025 · 0 comments
Open

Build triton_trt_llm image in debug mode #691

nzarif opened this issue Feb 5, 2025 · 0 comments

Comments

@nzarif
Copy link

nzarif commented Feb 5, 2025

Hi,

I am following the this doc and used this command to build Triton image with trt_llm backend from source:

DOCKER_BUILDKIT=1 docker build -t triton_trt_llm -f dockerfile/Dockerfile.trt_llm_backend .
I am intrested in building the tensorrtllm backend in debug mode so when launching Triton I can attach to the tensorrt_llm backend processes using gdb. In order to so I need to build tensorrt_llm backend from source in debug mode. I can not find any debug mode flags in the Dockerfile or the build scripts. Is there a way to build trtllm_backend in debug mode so when running gdb can attach to it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant