Skip to content

Trying Keras 3 w/ tf2.16 again #1390

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 25, 2024
Merged

Trying Keras 3 w/ tf2.16 again #1390

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
217ca02
Revert "Revert "Keras 3 w/ tf2.16" (#1387)"
djherbis Apr 25, 2024
10da456
Fix libtpu.so location for tf2.16
djherbis Apr 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 2 additions & 6 deletions tpu/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,16 +65,12 @@ RUN pip install tensorflow_hub https://storage.googleapis.com/cloud-tpu-tpuvm-ar
papermill jupyterlab python-lsp-server[all] "jupyter-lsp==1.5.1" \
pandas matplotlib opencv-python-headless librosa accelerate diffusers scikit-learn transformers \
seaborn timm albumentations einops pyarrow fastparquet opencv-python \
"keras>3" keras-cv keras-nlp \
kagglehub && \
/tmp/clean-layer.sh

# b/318672157 Install Keras 3 for loading models.
# We ignore dependencies for now since tf2.15 should work despite pip saying it won't.
RUN pip install --no-dependencies "keras>3" keras-cv keras-nlp && \
/tmp/clean-layer.sh

# Tensorflow libtpu:
RUN curl --output /lib/libtpu.so https://storage.googleapis.com/cloud-tpu-tpuvm-artifacts/libtpu/${TF_LIBTPU_VERSION}/libtpu.so
RUN curl --output /usr/local/lib/python3.10/site-packages/libtpu/libtpu.so https://storage.googleapis.com/cloud-tpu-tpuvm-artifacts/libtpu/${TF_LIBTPU_VERSION}/libtpu.so

# Kaggle Model Hub patches:
ADD patches/kaggle_module_resolver.py /usr/local/lib/${PYTHON_VERSION_PATH}/site-packages/tensorflow_hub/kaggle_module_resolver.py
Expand Down
4 changes: 2 additions & 2 deletions tpu/config.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ PYTHON_WHEEL_VERSION=cp310
PYTHON_VERSION_PATH=python3.10
# gsutil ls gs://cloud-tpu-tpuvm-artifacts/tensorflow
# https://cloud.google.com/tpu/docs/supported-tpu-configurations#libtpu_versions
TENSORFLOW_VERSION=2.15.0
TF_LIBTPU_VERSION=1.9.0
TENSORFLOW_VERSION=2.16.1
TF_LIBTPU_VERSION=1.10.1
TF_LINUX_WHEEL_VERSION=manylinux_2_17_x86_64.manylinux2014_x86_64
JAX_VERSION=0.4.23
# gsutil ls gs://pytorch-xla-releases/wheels/tpuvm/* | grep libtpu | grep -v -E ".*rc[0-9].*"
Expand Down