Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flexible and easy to use HSDP setting #19504

Merged
merged 29 commits into from
Jun 6, 2024
Merged

Flexible and easy to use HSDP setting #19504

merged 29 commits into from
Jun 6, 2024

Commits on Jan 17, 2024

  1. Add fsdp_size for FSDPStrategy

    @Liyang90
    Liyang90 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    312caee View commit details
    Browse the repository at this point in the history

  2. fix import

    @Liyang90
    Liyang90 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    45c1123 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 authored Feb 20, 2024
    Configuration menu
    Copy the full SHA
    0ddc51d View commit details
    Browse the repository at this point in the history

  2. Add flexible HSDP in fabric

    @Liyang90
    Liyang90 committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    c952536 View commit details
    Browse the repository at this point in the history

  3. minor update

    @Liyang90
    Liyang90 committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    8fc2404 View commit details
    Browse the repository at this point in the history

  4. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    da3900f View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 authored Mar 1, 2024
    Configuration menu
    Copy the full SHA
    8311be1 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. Use device_mesh arg to set flexible HSDP with a Tuple

    @Liyang90
    Liyang90 committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    d1d719a View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2024

  1. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    3315893 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 authored Mar 5, 2024
    Configuration menu
    Copy the full SHA
    4652b74 View commit details
    Browse the repository at this point in the history

  3. minor fix

    @Liyang90
    Liyang90 committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    4049f60 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. add simple docs

    @awaelchli
    awaelchli committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    9c14afe View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. correct doc string

    @Liyang90
    Liyang90 committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    1f2c3ff View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. set as explicit args in FSDPStrategy

    @Liyang90
    Liyang90 committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    07f7c1b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 authored Apr 4, 2024
    Configuration menu
    Copy the full SHA
    2ab0423 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    899e032 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. update fsdp tests

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    4259df2 View commit details
    Browse the repository at this point in the history

  2. Type check error

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    dbe22f3 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    2320a4e View commit details
    Browse the repository at this point in the history

  4. merge

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    b0d4783 View commit details
    Browse the repository at this point in the history

  5. type check

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    9d7dfbe View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    483f745 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed May 16, 2024
    Configuration menu
    Copy the full SHA
    ba0b10b View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 authored Jun 5, 2024
    Configuration menu
    Copy the full SHA
    d2d9fe8 View commit details
    Browse the repository at this point in the history

  2. simplify imports

    @awaelchli
    awaelchli committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    bd03b05 View commit details
    Browse the repository at this point in the history

  3. extend test

    @awaelchli
    awaelchli committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    11bc4ee View commit details
    Browse the repository at this point in the history

  4. add changelog

    @awaelchli
    awaelchli committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    c6a052c View commit details
    Browse the repository at this point in the history

  5. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    00efbcf View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into hybrid_fsdp_stage

    @awaelchli
    awaelchli committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    949d36f View commit details
    Browse the repository at this point in the history