Skip to content

Conversation

@ngxson
Copy link
Collaborator

@ngxson ngxson commented Dec 1, 2025

Trying to fix #16487 (comment)

In some cases, the first argument from the parent process doesn't reflect the binary path. So, we always resolve the binary path manually to make sure that it works.

@ngxson ngxson marked this pull request as ready for review December 1, 2025 22:37
@ngxson ngxson requested a review from ggerganov as a code owner December 1, 2025 22:37
@ngxson ngxson force-pushed the xsn/server_explicit_exec_path branch from 58cfded to 895aabb Compare December 1, 2025 22:41
int argc,
char ** argv,
char ** envp) : base_params(params) {
char ** envp) : base_params(params), server_binary_path(get_server_exec_path().string()) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When get_server_exec_path throws, should we instead fallback to using argv[0] as the server binary path?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes that's a good idea, I added it in 0dbf1e7

@ngxson ngxson merged commit 682e665 into ggml-org:master Dec 2, 2025
27 of 65 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Feature request: allow load/unload models on server

2 participants