Skip to content

[Execute Infrastructure] Optimize parallel third-party submodule initialization - #79679

Open
cangtianhuang wants to merge 1 commit into
PaddlePaddle:developfrom
cangtianhuang:fix/submodule-parallel
Open

[Execute Infrastructure] Optimize parallel third-party submodule initialization#79679
cangtianhuang wants to merge 1 commit into
PaddlePaddle:developfrom
cangtianhuang:fix/submodule-parallel

Conversation

@cangtianhuang

Copy link
Copy Markdown
Contributor

PR Category

Execute Infrastructure

PR Types

Improvements

Description

  • OpenVINO 子模块初始化增加并行参数:
    - COMMAND git submodule update --init --depth=1 third_party/openvino
    + COMMAND git submodule update --init --jobs=8 --depth=1 third_party/openvino
  • OpenVINO 分支的递归子模块初始化增加并行参数:
    - COMMAND git submodule update --init --recursive
    + COMMAND git submodule update --init --recursive --jobs=8
  • 非 OpenVINO 子模块由逐个更新改为收集路径后一次并行更新:
    - execute_process(COMMAND git submodule update --init --recursive ${submodule})
    + execute_process(
    +   COMMAND git submodule update --init --recursive --jobs=8
    +           ${submodule_update_paths})
  • 增加 git submodule status 失败处理,并保留错误码进入统一错误处理:
    - RESULT_VARIABLE result_var)
    + RESULT_VARIABLE submodule_status_result)
    + if(NOT submodule_status_result EQUAL 0)
    +   set(result_var ${submodule_status_result})
    + endif()

是否引起精度变化

@cangtianhuang

Copy link
Copy Markdown
Contributor Author

/re-run all-failed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants