Skip to content

[Bug]: copy_tests_from_docs should not raise error #34474

Closed
@liferoad

Description

@liferoad

What happened?

copy_tests_from_docs in https://github.com/apache/beam/blob/master/sdks/python/setup.py breaks the python Beam package build from the released zip file.

python -m build --sdist
* Creating isolated environment: venv+pip...
* Installing packages in isolated environment:
  - cython>=3.0,<4
  - distlib==0.3.7
  - grpcio-tools==1.62.1
  - jinja2>=2.7.1,<4.0.0
  - mypy-protobuf==3.5.0
  - numpy>=1.14.3,<2.3.0
  - pyyaml>=3.12,<7.0.0
  - setuptools
  - wheel>=0.36.0
  - yapf==0.29.0
* Getting build dependencies for sdist...
<string>:34: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
b''
Traceback (most recent call last):
  File "/usr/local/google/home/xqhu/tmp/test-beam/beam-2.64.0/sdks/python/beam_env/lib/python3.12/site-packages/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
    main()
  File "/usr/local/google/home/xqhu/tmp/test-beam/beam-2.64.0/sdks/python/beam_env/lib/python3.12/site-packages/pyproject_hooks/_in_process/_in_process.py", line 373, in main
    json_out["return_val"] = hook(**hook_input["kwargs"])
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/google/home/xqhu/tmp/test-beam/beam-2.64.0/sdks/python/beam_env/lib/python3.12/site-packages/pyproject_hooks/_in_process/_in_process.py", line 317, in get_requires_for_build_sdist
    return hook(config_settings)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/tmp/build-env-ucqkcfle/lib/python3.12/site-packages/setuptools/build_meta.py", line 337, in get_requires_for_build_sdist
    return self._get_build_requires(config_settings, requirements=[])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/tmp/build-env-ucqkcfle/lib/python3.12/site-packages/setuptools/build_meta.py", line 304, in _get_build_requires
    self.run_setup()
  File "/tmp/build-env-ucqkcfle/lib/python3.12/site-packages/setuptools/build_meta.py", line 320, in run_setup
    exec(code, locals())
  File "<string>", line 292, in <module>
  File "<string>", line 215, in copy_tests_from_docs
RuntimeError: Could not locate yaml docs in /usr/local/google/home/xqhu/tmp/test-beam/beam-2.64.0/website/www/site/content/en/documentation/sdks or /usr/local/google/home/xqhu/tmp/test-beam/beam-2.64.0/sdks/python/apache_beam/yaml/docs.

website/www/site/content/en/documentation/sdks does not exist in the released Beam source zip file.

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions