Skip to content

Support for setting root_path when running llama_cpp.server #1420

@jharonfe

Description

@jharonfe

The llama_cpp.server can encounter an issue serving /docs when run behind a proxy. This is documented by fastapi here. Is it currently possible to configure the server to update the root_path via the server cli ? I did not see anything in the documentation or cli help info. If not, would it be possible to add this functionality, such as a --root_path option ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions