Create conda env for Chapter 3 fails to build scikit-learn-0.24.2

[kai-majerus]

Apple M1, Ventura 13.4.1

Running the given command conda env create -f mlewp-chapter03.yml gives the below error.

I tried changing setuptools version to 59.6.0 (<60) as suggested by the error, but I get the same outcome.

Pip subprocess error:
  error: subprocess-exited-with-error

  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [34 lines of output]
      <string>:17: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
      Partial import of sklearn during the build process.
      <string>:116: DeprecationWarning:

        `numpy.distutils` is deprecated since NumPy 1.23.0, as a result
        of the deprecation of `distutils` itself. It will be removed for
        Python >= 3.12. For older Python versions it will remain present.
        It is recommended to use `setuptools < 60.0` for those Python versions.
        For more details, see:
          https://numpy.org/devdocs/reference/distutils_status_migration.html


      Traceback (most recent call last):
        File "/Users/kaimajerus/miniforge3/envs/mlewp-chapter03/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/Users/kaimajerus/miniforge3/envs/mlewp-chapter03/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/Users/kaimajerus/miniforge3/envs/mlewp-chapter03/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 149, in prepare_metadata_for_build_wheel
          return hook(metadata_directory, config_settings)
        File "/private/var/folders/bm/q77j4spj5nsbdchm0916yf5r0000gn/T/pip-build-env-q4oecenc/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 373, in prepare_metadata_for_build_wheel
          self.run_setup()
        File "/private/var/folders/bm/q77j4spj5nsbdchm0916yf5r0000gn/T/pip-build-env-q4oecenc/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 503, in run_setup
          super().run_setup(setup_script=setup_script)
        File "/private/var/folders/bm/q77j4spj5nsbdchm0916yf5r0000gn/T/pip-build-env-q4oecenc/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 318, in run_setup
          exec(code, locals())
        File "<string>", line 301, in <module>
        File "<string>", line 293, in setup_package
        File "/private/var/folders/bm/q77j4spj5nsbdchm0916yf5r0000gn/T/pip-build-env-q4oecenc/overlay/lib/python3.10/site-packages/numpy/distutils/core.py", line 24, in <module>
          from numpy.distutils.command import config, config_compiler, \
        File "/private/var/folders/bm/q77j4spj5nsbdchm0916yf5r0000gn/T/pip-build-env-q4oecenc/overlay/lib/python3.10/site-packages/numpy/distutils/command/config.py", line 19, in <module>
          from numpy.distutils.mingw32ccompiler import generate_manifest
        File "/private/var/folders/bm/q77j4spj5nsbdchm0916yf5r0000gn/T/pip-build-env-q4oecenc/overlay/lib/python3.10/site-packages/numpy/distutils/mingw32ccompiler.py", line 27, in <module>
          from distutils.msvccompiler import get_build_version as get_build_msvc_version
      ModuleNotFoundError: No module named 'distutils.msvccompiler'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

failed

CondaEnvException: Pip failed

[AndyMc629]

Sorry about this, will take a look ASAP. @kai-majerus any chance you fixed it? I'm now getting the same error (wasn't before).

[AndyMc629]

Found a potentially related issue on my M2, auto-sklearn can't install properly as it expects a linux kernel. On my old macbook I think I was able to get away with forcing (somehow) and x86_64 install, won't work here. Will find a workaround and send up. In meantime, this minimal conda yaml will get the other examples working [) pyspark ones, working on that too).

mlewp-chapter03-hotfix copy.yml.txt

[AndyMc629]

This branch is where i'm working on fix. 80-create-conda-env-for-chapter-3-fails-to-build-scikit-learn-0242

[AndyMc629]

Ok so now have updated the yml file to work for all ch3 examples except the autosklearn example (issues now with autosklearn and macos and windows) so I now have a docker based example there.