Skip to content

Commit 78149af

Browse files
epicfilemcnultyteleprint-me
authored andcommitted
server : fix local model name in server (ggml-org#4420)
1 parent 044f9b4 commit 78149af

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

examples/server/server.cpp

+1
Original file line numberDiff line numberDiff line change
@@ -2382,6 +2382,7 @@ json oaicompat_completion_params_parse(
23822382
llama_params["__oaicompat"] = true;
23832383

23842384
// Map OpenAI parameters to llama.cpp parameters
2385+
llama_params["model"] = json_value(body, "model", std::string("uknown"));
23852386
llama_params["prompt"] = format_chatml(body["messages"]); // OpenAI 'messages' to llama.cpp 'prompt'
23862387
llama_params["cache_prompt"] = json_value(body, "cache_prompt", false);
23872388
llama_params["temperature"] = json_value(body, "temperature", 0.8);

0 commit comments

Comments
 (0)