-
Notifications
You must be signed in to change notification settings - Fork 26.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
support torch-speech #32537
support torch-speech #32537
Conversation
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
I'm surprised we need both git-lfs and pypi-kenlm for torch-speech - they seem unrelated to speech models (particularly git-lfs). Do you know which parts of the code were failing without these? |
@@ -2,13 +2,14 @@ FROM python:3.10-slim | |||
ENV PYTHONDONTWRITEBYTECODE=1 | |||
USER root | |||
ARG REF=main | |||
RUN apt-get update && apt-get install -y time git pkg-config make git-lfs | |||
RUN apt-get update && apt-get install -y time git g++ pkg-config make git-lfs |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do we need g++ for pypi-kenlm?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, didn't work without. same as in torch-tf-light
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
(oopsie, I did a fire and forget, 100% forgot to double-check the result of the changes)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If we are installing torch-audio we might force install before to get cpu
@@ -2,13 +2,14 @@ FROM python:3.10-slim | |||
ENV PYTHONDONTWRITEBYTECODE=1 | |||
USER root | |||
ARG REF=main | |||
RUN apt-get update && apt-get install -y time git pkg-config make git-lfs | |||
RUN apt-get update && apt-get install -y time git g++ pkg-config make git-lfs | |||
ENV UV_PYTHON=/usr/local/bin/python | |||
RUN pip install uv && uv venv && uv pip install --no-cache-dir -U pip setuptools GitPython | |||
RUN uv pip install --no-cache-dir --upgrade 'torch' --index-url https://download.pytorch.org/whl/cpu |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
RUN uv pip install --no-cache-dir --upgrade 'torch' --index-url https://download.pytorch.org/whl/cpu | |
RUN uv pip install --no-cache-dir --upgrade 'torch' 'torchaudio' --index-url https://download.pytorch.org/whl/cpu | |
follow up on #32389 to support torch-speech, we need to install
git-lfs
andpypi-kenlm
currently causing failures on docker image like here
CC @ArthurZucker @gante