Skip to content

negative samplings #24

Open
Open
negative samplings#24

Description

@Wangchuan0
Wangchuan0
opened on Jun 3, 2023

Hello, if you train directly according to your steps, which one of IB, PB, SN will it turn out? If I want to test the results of different negative samples, how can I change the code
57444c4a0f1d42c6e8c1ade7097c58d
0f11625312930971ff42bf7b08777fc

Activity

  1. intfloat commented on Jun 5, 2023

    @intfloat
    intfloat
    on Jun 5, 2023
    Owner

    --pre-batch 0 means it does not use pre-batch negatives.

    Remove --use-self-negative if you do not want to use self-negatives.

    In batch negatives are always used since they are almost free anyway.

  2. Wangchuan0 commented on Jun 5, 2023

    @Wangchuan0
    Wangchuan0
    on Jun 5, 2023
    Author

    PB 0改成1是使用的意思吗

  3. Wangchuan0 commented on Jun 5, 2023

    @Wangchuan0
    Wangchuan0
    on Jun 5, 2023
    Author

    那我跑的结果应该是IB +SN,结果跟你的差的好大。我只改了batch size。求解答

  4. intfloat commented on Jun 5, 2023

    @intfloat
    intfloat
    on Jun 5, 2023
    Owner

    batch size 就是对结果影响最大的参数，batch size小了，对比学习的效果就会下降

  5. Wangchuan0 commented on Jun 5, 2023

    @Wangchuan0
    Wangchuan0
    on Jun 5, 2023
    Author

    okok，谢谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions