Merge remote-tracking branch 'upstream/master' into ci/testing/use-pytest

Author: smokestacklightnin

.github/workflows/docs.yml

@@ -0,0 +1,52 @@
+name: Deploy docs
+on:
+  workflow_dispatch:
+  push:
+    branches:
+      - 'master'
+  pull_request:
+permissions:
+  contents: write
+jobs:
+  deploy:
+    runs-on: ubuntu-latest
+    steps:
+      - name: Checkout repo
+        uses: actions/checkout@v4
+
+      - name: Configure Git Credentials
+        run: |
+          git config user.name github-actions[bot]
+          git config user.email 41898282+github-actions[bot]@users.noreply.github.com
+        if: (github.event_name != 'pull_request')
+
+      - name: Set up Python 3.9
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.9'
+          cache: 'pip'
+          cache-dependency-path: |
+            setup.py
+            requirements-docs.txt
+
+      - name: Save time for cache for mkdocs
+        run: echo "cache_id=$(date --utc '+%V')" >> $GITHUB_ENV
+
+      - name: Caching
+        uses: actions/cache@v4
+        with:
+          key: mkdocs-material-${{ env.cache_id }}
+          path: .cache
+          restore-keys: |
+            mkdocs-material-
+
+      - name: Install Dependencies
+        run: pip install -r requirements-docs.txt
+
+      - name: Deploy to GitHub Pages
+        run: mkdocs gh-deploy --force
+        if: (github.event_name != 'pull_request')
+
+      - name: Build docs to check for errors
+        run: mkdocs build
+        if: (github.event_name == 'pull_request')

README.md

@@ -107,7 +107,9 @@ other *untested* combinations may also work.
 
 tensorflow-transform                                                            | apache-beam[gcp] | pyarrow | tensorflow        | tensorflow-metadata | tfx-bsl |
 ------------------------------------------------------------------------------- | -----------------| --------|-------------------|---------------------|---------|
-[GitHub master](https://github.com/tensorflow/transform/blob/master/RELEASE.md) | 2.47.0           | 10.0.0  | nightly (2.x)     | 1.15.0              | 1.15.1  |
+[GitHub master](https://github.com/tensorflow/transform/blob/master/RELEASE.md) | 2.65.0           | 10.0.1  | nightly (2.x)     | 1.17.1              | 1.17.1  |
+[1.17.0](https://github.com/tensorflow/transform/blob/v1.17.0/RELEASE.md)       | 2.65.0           | 10.0.1  | 2.17              | 1.17.1              | 1.17.1  |
+[1.16.0](https://github.com/tensorflow/transform/blob/v1.16.0/RELEASE.md)       | 2.60.0           | 10.0.1  | 2.16              | 1.16.1              | 1.16.1  |
 [1.15.0](https://github.com/tensorflow/transform/blob/v1.15.0/RELEASE.md)       | 2.47.0           | 10.0.0  | 2.15              | 1.15.0              | 1.15.1  |
 [1.14.0](https://github.com/tensorflow/transform/blob/v1.14.0/RELEASE.md)       | 2.47.0           | 10.0.0  | 2.13              | 1.14.0              | 1.14.0  |
 [1.13.0](https://github.com/tensorflow/transform/blob/v1.13.0/RELEASE.md)       | 2.41.0           | 6.0.0   | 2.12              | 1.13.1              | 1.13.0  |

RELEASE.md

@@ -10,6 +10,47 @@
 
 ## Deprecations
 
+# Version 1.17.0
+
+## Major Features and Improvements
+
+*   N/A
+
+## Bug Fixes and Other Changes
+
+*   Depends on `tensorflow 2.17`
+*   Depends on `protobuf>=4.25.2,<6.0.0` for Python 3.11 and on `protobuf>4.21.6,<6.0.0` for 3.9 and 3.10.
+*   Depends on `apache-beam[gcp]>=2.53.0,<3` for Python 3.11 and on
+    `apache-beam[gcp]>=2.50.0,<2.51.0` for 3.9 and 3.10.
+*   macOS wheel publishing is temporarily paused due to missing ARM64 support.
+
+## Breaking Changes
+
+*   N/A
+
+## Deprecations
+
+*   N/A
+
+# Version 1.16.0
+
+## Major Features and Improvements
+
+*   N/A
+
+## Bug Fixes and Other Changes
+
+*   Depends on `tensorflow 2.16`
+*   Relax dependency on Protobuf to include version 5.x
+
+## Breaking Changes
+
+*   N/A
+
+## Deprecations
+
+*   N/A
+
 # Version 1.15.0
 
 ## Major Features and Improvements

docs/api_docs/python/tft-beam-analyzer-cache.md

@@ -0,0 +1,3 @@
+# TensorFlow Transform `tft.beam.analyzer_cache` Module
+
+::: tensorflow_transform.beam.analyzer_cache

docs/api_docs/python/tft-beam-experimental.md

@@ -0,0 +1,3 @@
+# TensorFlow Transform `tft.beam.experimental` Module
+
+::: tensorflow_transform.beam.experimental

docs/api_docs/python/tft-beam.md

@@ -0,0 +1,3 @@
+# TensorFlow Transform `tft.beam` Module
+
+::: tensorflow_transform.beam

docs/api_docs/python/tft-coders.md

@@ -0,0 +1,3 @@
+# TensorFlow Transform `tft.coders` Module
+
+::: tensorflow_transform.coders

docs/api_docs/python/tft-experimental.md

@@ -0,0 +1,3 @@
+# TensorFlow Transform `tft.experimental` Module
+
+::: tensorflow_transform.experimental

docs/api_docs/python/tft.md

@@ -0,0 +1,3 @@
+# TensorFlow Transform `tft` Module
+
+::: tensorflow_transform

docs/get_started.ipynb

@@ -386,7 +386,7 @@
         "## Data Formats and Schema\n",
         "\n",
         "TFT Beam implementation accepts two different input data formats. The\n",
-        "\"instance dict\" format (as seen in the example above and [simple.ipynb](https://www.tensorflow.org/tfx/tutorials/transform/simple) \u0026 [simple_example.py](https://github.com/tensorflow/transform/blob/master/examples/simple_example.py))\n",
+        "\"instance dict\" format (as seen in the example above and [simple.ipynb](https://tensorflow.github.io/tfx/tutorials/transform/simple) \u0026 [simple_example.py](https://github.com/tensorflow/transform/blob/master/examples/simple_example.py))\n",
         "is an intuitive format and is suitable for small datasets while the TFXIO\n",
         "([Apache Arrow](https://arrow.apache.org)) format provides improved performance\n",
         "and is suitble for large datasets.\n",
@@ -562,15 +562,15 @@
         "## Compatibility with TensorFlow\n",
         "\n",
         "`tf.Transform` provides support for exporting the `transform_fn` as\n",
-        "a SavedModel, see the [simple tutorial](https://www.tensorflow.org/tfx/tutorials/transform/simple) for an example. The default behavior before the `0.30` release\n",
+        "a SavedModel, see the [simple tutorial](https://tensorflow.github.io/tfx/tutorials/transform/simple) for an example. The default behavior before the `0.30` release\n",
         "exported a TF 1.x SavedModel. Starting with the `0.30` release, the default\n",
         "behavior is to export a TF 2.x SavedModel unless TF 2.x behaviors are explicitly\n",
         "disabled (by calling `tf.compat.v1.disable_v2_behavior()`).\n",
         "\n",
         "If using TF 1.x concepts such as `tf.estimator` and `tf.Sessions`, you can retain the previous behavior by passing `force_tf_compat_v1=True` to\n",
-        "[`tft_beam.Context`](https://www.tensorflow.org/tfx/transform/api_docs/python/tft_beam/Context)\n",
+        "[`tft_beam.Context`](https://tensorflow.github.io/api_docs/python/tft-beam/#tensorflow_transform.beam.Context)\n",
         "if using `tf.Transform` as a standalone library or to the\n",
-        "[Transform](https://www.tensorflow.org/tfx/api_docs/python/tfx/components/Transform)\n",
+        "[Transform](https://tensorflow.github.io/tfx/api/v1/components/#tfx.v1.components.Transform)\n",
         "component in TFX.\n",
         "\n",
         "When exporting the `transform_fn` as a TF 2.x SavedModel, the `preprocessing_fn`\n",
@@ -580,7 +580,7 @@
         "[here](https://beam.apache.org/documentation/sdks/python-pipeline-dependencies/#multiple-file-dependencies).\n",
         "\n",
         "Known issues with using `tf.Transform` to export a TF 2.x SavedModel are\n",
-        "documented [here](https://www.tensorflow.org/tfx/transform/tf2_support)."
+        "documented [here](../tf2_support)."
       ]
     },
     {
@@ -618,7 +618,7 @@
         "and can also give `tfxio.TensorAdapterConfig`, including inferred\n",
         "`tfxio.TensorRepresentations`.\n",
         "\n",
-        "Those `TFXIO`s can be found in package `tfx_bsl` ([`tfx_bsl.public.tfxio`](https://www.tensorflow.org/tfx/tfx_bsl/api_docs/python/tfx_bsl/public/tfxio)).\n"
+        "Those `TFXIO`s can be found in package `tfx_bsl` ([`tfx_bsl.public.tfxio`](https://tensorflow.github.io/tfx-bsl/api_docs/python/tfxio/)).\n"
       ]
     },
     {
@@ -753,7 +753,7 @@
         "    from the type and shape information. One can get the Schema either by\n",
         "    using a helper function we provide to translate from TF parsing specs\n",
         "    (shown in this example), or by running\n",
-        "    [TensorFlow Data Validation](https://www.tensorflow.org/tfx/tutorials/data_validation/tfdv_basic).\n",
+        "    [TensorFlow Data Validation](https://tensorflow.github.io/tfx/tutorials/data_validation/tfdv_basic).\n",
         "  - a list of column names, in the order they appear in the CSV file. Note\n",
         "    that those names must match the feature names in the Schema."
       ]
@@ -1047,7 +1047,7 @@
         "id": "OllPVQJl2dRx"
       },
       "source": [
-        "To see how to use these artifacts refer to the [Advanced preprocessing tutorial](https://www.tensorflow.org/tfx/tutorials/transform/census)."
+        "To see how to use these artifacts refer to the [Advanced preprocessing tutorial](https://tensorflow.github.io/tfx/tutorials/transform/census)."
       ]
     }
   ],