Skip to content

Commit 035f56a

Browse files
ngxsonServeurpersoCom
authored andcommitted
also set LLAMA_ARG_HOST
1 parent 6bda0d4 commit 035f56a

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tools/server/server-models.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -204,6 +204,7 @@ void server_presets::render_args(server_model_meta & meta) {
204204
}
205205
// 3. control args (from router)
206206
// set control values
207+
preset.options[control_args["LLAMA_ARG_HOST"]] = "127.0.0.1";
207208
preset.options[control_args["LLAMA_ARG_PORT"]] = std::to_string(meta.port);
208209
preset.options[control_args["LLAMA_ARG_ALIAS"]] = meta.name;
209210
if (meta.in_cache) {

0 commit comments

Comments
 (0)