the "cc-compiler-darwin_arm64" toolchain cannot be detected when install CommandLineTools and Xcode.app is not installed. #13514

kekxv · 2021-05-25T14:18:45Z

the "cc-compiler-darwin_arm64" toolchain cannot be detected when install CommandLineTools and Xcode.app is not installed.

What operating system are you running Bazel on?

MacOS(M1)

What's the output of `bazel info release`?

release 4.1.0

use bazel (/opt/homebrew/Cellar/bazel/4.1.0... (9 files, 29.9MB))

  bazel git:(master) bazel shutdown
Extracting Bazel installation...
  bazel git:(master) bazel build //examples/cpp/...
Starting local Bazel server and connecting to it...
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/version_check.bzl:68:14:
Current running Bazel is ahead of bazel-toolchains repo. Please update your pin to bazel-toolchains repo in your WORKSPACE file.
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/checked_in.bzl:103:14: rbe_ubuntu1804_java11 not using checked in configs as detect_java_home was set to True
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/version_check.bzl:68:14:
Current running Bazel is ahead of bazel-toolchains repo. Please update your pin to bazel-toolchains repo in your WORKSPACE file.
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/checked_in.bzl:103:14: rbe_ubuntu1604_java8 not using checked in configs as detect_java_home was set to True
ERROR: /Volumes/work/bazelbuild/bazel/examples/cpp/BUILD:9:10: Target '//examples/cpp:hello-world' depends on toolchain '@local_config_cc//:cc-compiler-darwin_arm64', which cannot be found: no such target '@local_config_cc//:cc-compiler-darwin_arm64': target 'cc-compiler-darwin_arm64' not declared in package '' defined by /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/local_config_cc/BUILD'
ERROR: Analysis of target '//examples/cpp:hello-world' failed; build aborted: Analysis failed
INFO: Elapsed time: 44.611s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (18 packages loaded, 50 targets configured)
  bazel git:(master) git sho
  bazel git:(master) git pull
hint: Pulling without specifying how to reconcile divergent branches is
hint: discouraged. You can squelch this message by running one of the following
hint: commands sometime before your next pull:
hint:
hint:   git config pull.rebase false  # merge (the default strategy)
hint:   git config pull.rebase true   # rebase
hint:   git config pull.ff only       # fast-forward only
hint:
hint: You can replace "git config" with "git config --global" to set a default
hint: preference for all repositories. You can also pass --rebase, --no-rebase,
hint: or --ff-only on the command line to override the configured default per
hint: invocation.
remote: Enumerating objects: 103, done.
remote: Counting objects: 100% (103/103), done.
remote: Compressing objects: 100% (28/28), done.
remote: Total 72 (delta 49), reused 58 (delta 36), pack-reused 0
Unpacking objects: 100% (72/72), 9.63 KiB | 159.00 KiB/s, done.
From https://github.com/bazelbuild/bazel
   5a647bb..024deb5  master     -> origin/master
Updating 5a647bb..024deb5
Fast-forward
 src/main/java/com/google/devtools/build/lib/analysis/BaseRuleClasses.java                  | 12 ++++++---
 src/main/java/com/google/devtools/build/lib/analysis/RuleConfiguredTargetBuilder.java      |  2 +-
 src/main/java/com/google/devtools/build/lib/analysis/RuleContext.java                      |  4 +--
 .../com/google/devtools/build/lib/analysis/constraints/RuleContextConstraintSemantics.java |  2 +-
 src/main/java/com/google/devtools/build/lib/analysis/starlark/FunctionTransitionUtil.java  |  2 +-
 .../java/com/google/devtools/build/lib/analysis/starlark/StarlarkRuleClassFunctions.java   | 10 ++++++--
 src/main/java/com/google/devtools/build/lib/analysis/test/InstrumentedFilesCollector.java  |  2 +-
 src/main/java/com/google/devtools/build/lib/packages/Attribute.java                        | 29 +++++++++++++++++++++
 src/main/java/com/google/devtools/build/lib/packages/DependencyFilter.java                 |  7 +-----
 src/main/java/com/google/devtools/build/lib/packages/RuleClass.java                        | 20 +++++++++++----
 .../java/com/google/devtools/build/lib/analysis/StarlarkAttrTransitionProviderTest.java    | 61 ---------------------------------------------
 src/test/shell/integration/target_compatible_with_test.sh                                  | 16 +++++++++++-
 12 files changed, 83 insertions(+), 84 deletions(-)
  bazel git:(master) bazel build //examples/cpp/...
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/version_check.bzl:68:14:
Current running Bazel is ahead of bazel-toolchains repo. Please update your pin to bazel-toolchains repo in your WORKSPACE file.
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/checked_in.bzl:103:14: rbe_ubuntu1804_java11 not using checked in configs as detect_java_home was set to True
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/version_check.bzl:68:14:
Current running Bazel is ahead of bazel-toolchains repo. Please update your pin to bazel-toolchains repo in your WORKSPACE file.
DEBUG: /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/bazel_toolchains/rules/rbe_repo/checked_in.bzl:103:14: rbe_ubuntu1604_java8 not using checked in configs as detect_java_home was set to True
ERROR: /Volumes/work/bazelbuild/bazel/examples/cpp/BUILD:9:10: Target '//examples/cpp:hello-world' depends on toolchain '@local_config_cc//:cc-compiler-darwin_arm64', which cannot be found: no such target '@local_config_cc//:cc-compiler-darwin_arm64': target 'cc-compiler-darwin_arm64' not declared in package '' defined by /private/var/tmp/_bazel_caesar/3dbd51b498342f1222f4220c3d8fbd0a/external/local_config_cc/BUILD'
ERROR: Analysis of target '//examples/cpp:hello-world' failed; build aborted: Analysis failed
INFO: Elapsed time: 0.143s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (1 packages loaded, 3 targets configured)
  bazel git:(master)

The text was updated successfully, but these errors were encountered:

kekxv · 2021-05-25T14:19:05Z

#13509 (comment)

kekxv · 2021-05-25T14:28:32Z

if you want work.you can chang the file $(bazel info output_base)/external/local_config_cc/BUILD:

vim $(bazel info output_base)/external/local_config_cc/BUILD

 48 cc_toolchain_suite(
 49     name = "toolchain",
 50     toolchains = {
 51         "darwin|clang": ":cc-compiler-darwin",
 52         "darwin_arm64|clang": ":cc-compiler-darwin",                // add
 53         "darwin": ":cc-compiler-darwin",
 54         "darwin_arm64": ":cc-compiler-darwin",                      // add
 55         "armeabi-v7a|compiler": ":cc-compiler-armeabi-v7a",
 56         "armeabi-v7a": ":cc-compiler-armeabi-v7a",
 57     },
 58 )

 60 cc_toolchain(                                  // add
 61     name = "cc-compiler-darwin_arm64",         // add
 62     toolchain_identifier = "local",            // add
 63     toolchain_config = ":local",               // add
 64     all_files = ":compiler_deps",              // add
 65     ar_files = ":compiler_deps",               // add
 66     as_files = ":compiler_deps",               // add
 67     compiler_files = ":compiler_deps",         // add
 68     dwp_files = ":empty",                      // add
 69     linker_files = ":compiler_deps",           // add
 70     objcopy_files = ":empty",                  // add
 71     strip_files = ":empty",                    // add
 72     supports_param_files = 1,                  // add
 73     module_map = ":module.modulemap",          // add
 74 )                                              // add
 75 cc_toolchain(
 76     name = "cc-compiler-darwin",
 77     toolchain_identifier = "local",
 78     toolchain_config = ":local",
 79     all_files = ":compiler_deps",
 80     ar_files = ":compiler_deps",
 81     as_files = ":compiler_deps",
 82     compiler_files = ":compiler_deps",
 83     dwp_files = ":empty",
 84     linker_files = ":compiler_deps",
 85     objcopy_files = ":empty",
 86     strip_files = ":empty",
 87     supports_param_files = 1,
 88     module_map = ":module.modulemap",
 89 )

meteorcloudy · 2021-05-25T14:32:35Z

The cause of this bug is that the cpu value darwin_arm64 didn't propagate correctly to the BUILD file. Will send a fix soon.

khanhtc1202 · 2021-06-17T04:10:48Z

Hi @meteorcloudy, is there any update on this issue, will it be fixed in v4.2? Just saw the PR is closed without merge. 👀

meteorcloudy · 2021-06-17T08:19:35Z

@khanhtc1202 The fix is imported at b4b0c32, we don't just merge PR on github but import it to Google's internal codebase then export it github.

meteorcloudy · 2021-06-17T08:19:58Z

We'll have to cherry-pick this is 4.2 though.

This allow the basic unix toolchain to work on Apple silicon without Xcode installed. Fixes #13514 Closes #13515. PiperOrigin-RevId: 375711139

This allow the basic unix toolchain to work on Apple silicon without Xcode installed. Fixes bazelbuild#13514 Closes bazelbuild#13515. PiperOrigin-RevId: 375711139

May also require a fix or patch to the cc config: bazelbuild/bazel#13514 (comment)

juancresc · 2022-02-24T12:38:11Z

this is still an issue

juancresc · 2022-02-24T12:42:32Z

After doing what @kekxv suggested, I got this:

(mlp) ➜  tensorflow git:(master) ✗ bazel build --jobs=10 --compilation_mode=opt --copt=-march=native tensorflow  --verbose_failures        
WARNING: Option 'java_toolchain' is deprecated
WARNING: Option 'host_java_toolchain' is deprecated
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=176
INFO: Reading rc options for 'build' from /Users/mysuser/Documents/lib/tensorflow/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /Users/mysuser/Documents/lib/tensorflow/.bazelrc:
  'build' options: --define framework_shared_object=true --java_toolchain=//tensorflow/tools/toolchains/java:tf_java_toolchain --host_java_toolchain=//tensorflow/tools/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library
INFO: Reading rc options for 'build' from /Users/mysuser/Documents/lib/tensorflow/.tf_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/Users/mysuser/mambaforge/envs/mlp/bin/python3 --action_env PYTHON_LIB_PATH=/Users/mysuser/mambaforge/envs/mlp/lib/python3.8/site-packages --python_path=/Users/mysuser/mambaforge/envs/mlp/bin/python3
INFO: Reading rc options for 'build' from /Users/mysuser/Documents/lib/tensorflow/.bazelrc:
  'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils
INFO: Found applicable config definition build:short_logs in file /Users/mysuser/Documents/lib/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /Users/mysuser/Documents/lib/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:macos in file /Users/mysuser/Documents/lib/tensorflow/.bazelrc: --apple_platform_type=macos --copt=-DGRPC_BAZEL_BUILD --copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14
DEBUG: Rule 'io_bazel_rules_docker' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1596824487 -0400"
DEBUG: Repository io_bazel_rules_docker instantiated at:
  /Users/mysuser/Documents/lib/tensorflow/WORKSPACE:23:14: in <toplevel>
  /Users/mysuser/Documents/lib/tensorflow/tensorflow/workspace0.bzl:110:34: in workspace
  /private/var/tmp/_bazel_mysuser/7d4fd1924864d2d6fce922e4404d7479/external/bazel_toolchains/repositories/repositories.bzl:35:23: in repositories
Repository rule git_repository defined at:
  /private/var/tmp/_bazel_mysuser/7d4fd1924864d2d6fce922e4404d7479/external/bazel_tools/tools/build_defs/repo/git.bzl:199:33: in <toplevel>
INFO: Analyzed target //tensorflow:tensorflow (0 packages loaded, 0 targets configured).
INFO: Found 1 target...
ERROR: /private/var/tmp/_bazel_mysuser/7d4fd1924864d2d6fce922e4404d7479/external/com_google_absl/absl/types/BUILD.bazel:153:11: Compiling absl/types/bad_optional_access.cc [for host] failed: missing input file 'external/local_config_cc/module.modulemap', owner: '@local_config_cc//:module.modulemap'
ERROR: /private/var/tmp/_bazel_mysuser/7d4fd1924864d2d6fce922e4404d7479/external/com_google_absl/absl/types/BUILD.bazel:153:11: Compiling absl/types/bad_optional_access.cc [for host] failed: 1 input file(s) do not exist
Target //tensorflow:tensorflow failed to build
ERROR: /Users/mysuser/Documents/lib/tensorflow/tensorflow/core/framework/BUILD:1400:31 Middleman _middlemen/_S_Stensorflow_Score_Sframework_Cattr_Uvalue_Uproto_Utext-BazelCppSemantics_build_arch_darwin_arm64-opt failed: 1 input file(s) do not exist
INFO: Elapsed time: 0.337s, Critical Path: 0.03s
INFO: 11 processes: 11 internal.
FAILED: Build did NOT complete successfully

keith · 2022-02-24T17:52:54Z

Your error here is very different:

ERROR: /private/var/tmp/_bazel_mysuser/7d4fd1924864d2d6fce922e4404d7479/external/com_google_absl/absl/types/BUILD.bazel:153:11: Compiling absl/types/bad_optional_access.cc [for host] failed: missing input file 'external/local_config_cc/module.modulemap', owner: '@local_config_cc//:module.modulemap'
ERROR: /private/var/tmp/_bazel_mysuser/7d4fd1924864d2d6fce922e4404d7479/external/com_google_absl/absl/types/BUILD.bazel:153:11: Compiling absl/types/bad_optional_access.cc [for host] failed: 1 input file(s) do not exist
Target //tensorflow:tensorflow failed to build
ERROR: /Users/mysuser/Documents/lib/tensorflow/tensorflow/core/framework/BUILD:1400:31 Middleman _middlemen/_S_Stensorflow_Score_Sframework_Cattr_Uvalue_Uproto_Utext-BazelCppSemantics_build_arch_darwin_arm64-opt failed: 1 input file(s) do not exist

juancresc · 2022-02-24T17:59:43Z

@keith indeed

keith · 2022-02-24T18:01:05Z

It looks like something else about your environment might have issues, can you verify the command line tools are up to date? You might also try cleaning the workspace after you update them. Otherwise can you file a new issue with repro steps?

SuperBo · 2022-03-04T23:15:45Z

@juancrescente , Try using bazel 5.0.0 instead of 4.2.2 when building tensorflow. I think the fix is merged into 5.0.0 version, not 4.2.2

kekxv mentioned this issue May 25, 2021

4.1.0 toolchain failure with bazelisk 1.3.9 on Mac OS X 10.15.7 #13509

Closed

meteorcloudy mentioned this issue May 25, 2021

Fix unix toolchain for macos arm64 platform #13515

Closed

bazel-io closed this as completed in b4b0c32 May 25, 2021

meteorcloudy mentioned this issue Jun 17, 2021

Release 4.2 - June 2021 #13558

Closed

9 tasks

simonfall mentioned this issue Jun 22, 2021

Fix Darwin ARM64 build (macOS/M1 support) ray-project/ray#16621

Closed

6 tasks

katre pushed a commit that referenced this issue Jul 12, 2021

Fix unix toolchain for macos arm64 platform

e9de54a

This allow the basic unix toolchain to work on Apple silicon without Xcode installed. Fixes #13514 Closes #13515. PiperOrigin-RevId: 375711139

meteorcloudy mentioned this issue Jul 14, 2021

Fix unix toolchain for macos arm64 platform #13683

Merged

This was referenced Aug 8, 2021

Cannot build cpp-tutorial on Apple M1 #13813

Closed

bazel build failed in mac #13833

Closed

uri-canva mentioned this issue Aug 19, 2021

bazel_4 fails to build on aarch64-darwin NixOS/nixpkgs#134758

Closed

This was referenced Feb 15, 2022

Make libTensorFlow C++ library work for the latest M1 Mac tensorflow/tensorflow#52160

Closed

Build for macos_arm64 on m1 fails with missing toolchain tensorflow/tensorflow#49905

Closed

jbedard added a commit to jbedard/dev-infra that referenced this issue Feb 23, 2022

chore(build): add darwin_arm64 support

ac385bd

May also require a fix or patch to the cc config: bazelbuild/bazel#13514 (comment)

jbedard mentioned this issue Feb 23, 2022

build: add darwin_arm64 support angular/dev-infra#429

Closed

jbedard added a commit to jbedard/dev-infra that referenced this issue Feb 23, 2022

build: add darwin_arm64 support

59ed6bf

May also require a fix or patch to the cc config: bazelbuild/bazel#13514 (comment)

gadagashwini mentioned this issue Mar 28, 2022

Failed to build libtensorflow (v2.8.0 + bazel 4.2.1) from source on Apple M1 tensorflow/tensorflow#55369

Closed

cjoverbay mentioned this issue Mar 31, 2022

Normal Installation Fails tensorflow/gnn#22

Closed

lqiu96 mentioned this issue Feb 8, 2023

chore: Fix pre-commit. googleapis/sdk-platform-java#1294

Merged

michaelbeaumont mentioned this issue Mar 17, 2023

build(mk): fix Envoy build for darwin arm64 kumahq/kuma#6290

Merged

6 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

the "cc-compiler-darwin_arm64" toolchain cannot be detected when install CommandLineTools and Xcode.app is not installed. #13514

the "cc-compiler-darwin_arm64" toolchain cannot be detected when install CommandLineTools and Xcode.app is not installed. #13514

kekxv commented May 25, 2021

kekxv commented May 25, 2021

kekxv commented May 25, 2021

meteorcloudy commented May 25, 2021

khanhtc1202 commented Jun 17, 2021

meteorcloudy commented Jun 17, 2021

meteorcloudy commented Jun 17, 2021

juancresc commented Feb 24, 2022

juancresc commented Feb 24, 2022

keith commented Feb 24, 2022

juancresc commented Feb 24, 2022

keith commented Feb 24, 2022 •

edited

Loading

SuperBo commented Mar 4, 2022 •

edited

Loading

the "cc-compiler-darwin_arm64" toolchain cannot be detected when install CommandLineTools and Xcode.app is not installed. #13514

the "cc-compiler-darwin_arm64" toolchain cannot be detected when install CommandLineTools and Xcode.app is not installed. #13514

Comments

kekxv commented May 25, 2021

What operating system are you running Bazel on?

What's the output of bazel info release?

kekxv commented May 25, 2021

kekxv commented May 25, 2021

meteorcloudy commented May 25, 2021

khanhtc1202 commented Jun 17, 2021

meteorcloudy commented Jun 17, 2021

meteorcloudy commented Jun 17, 2021

juancresc commented Feb 24, 2022

juancresc commented Feb 24, 2022

keith commented Feb 24, 2022

juancresc commented Feb 24, 2022

keith commented Feb 24, 2022 • edited Loading

SuperBo commented Mar 4, 2022 • edited Loading

What's the output of `bazel info release`?

keith commented Feb 24, 2022 •

edited

Loading

SuperBo commented Mar 4, 2022 •

edited

Loading