Skip to content

Conversation

@xusuyong
Copy link
Contributor

@xusuyong xusuyong commented May 6, 2024

PR types

New features

PR changes

Others

Describe

@paddle-bot
Copy link

paddle-bot bot commented May 6, 2024

Thanks for your contribution!

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CausalMSELoss的权重计算过程应该需要把NTK考虑进来,因为源论文的causalmseloss在NTK是否开启有两种实现方式

x: [2.0, False]
fourier:
dim: 256
scale: 1.0
Copy link
Collaborator

@HydrogenSulfate HydrogenSulfate May 7, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dim: 256
scale: 1.0
random_weight:
mean: 0.5
Copy link
Collaborator

@HydrogenSulfate HydrogenSulfate May 7, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

iters_per_epoch: ${TRAIN.iters_per_epoch}
learning_rate: 1.0e-3
gamma: 0.9
decay_steps: 2000
Copy link
Collaborator

@HydrogenSulfate HydrogenSulfate May 7, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

HydrogenSulfate

This comment was marked as outdated.

Copy link
Collaborator

@HydrogenSulfate HydrogenSulfate left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM,辛苦提交PR

@HydrogenSulfate HydrogenSulfate merged commit 55118fc into PaddlePaddle:develop May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants