Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: docker-compose healthcheck test uses curl but curl is not in the image #9295

Open
sherif-fanous opened this issue Mar 16, 2025 · 2 comments · May be fixed by #9737
Open

[Bug]: docker-compose healthcheck test uses curl but curl is not in the image #9295

sherif-fanous opened this issue Mar 16, 2025 · 2 comments · May be fixed by #9737
Labels
bug Something isn't working

Comments

@sherif-fanous
Copy link

sherif-fanous commented Mar 16, 2025

What happened?

I deployed v1.63.11-stable and noticed that the docker-compose.yaml file added a healthcheck so proceeded to add the healthcheck to my docker-compose file but to my surprize the container was being reported as unhealthy after restarting it with the curl based test command.

I "execed" into the container and ran the following command

zsh ❯ docker exec -it litellm bash

bash-5.2# curl http://localhost:4000/health/liveliness
bash: curl: command not found

I did however find that wget is already included in the image so I updated the healthcheck as follows

test:
  [
    "CMD-SHELL",
    "wget --quiet --tries=1 http://localhost:4000/health/liveliness || exit 1",
  ]

With the wget based test the container is now healthy

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.63.11

Twitter / LinkedIn details

No response

@sherif-fanous sherif-fanous added the bug Something isn't working label Mar 16, 2025
@rthomasv3
Copy link

Seeing the same issue, but wget doesn't seem to be included in the image for me either.

@elisasimoni
Copy link

try create another docker using the image of this docker and before pulling the image install curl command like this:

FROM ghcr.io/berriai/litellm:main:latest (select your version)

RUN apk add --no-cache curl

WORKDIR /app

COPY config.yaml .

EXPOSE 8080

CMD ["litellm", "--port", "8080", "--config", "config.yaml"]

agajdosi added a commit to agajdosi/litellm that referenced this issue Apr 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants