Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

block number in 1.3. #495

Open
Edwardmark opened this issue Oct 23, 2024 · 1 comment
Open

block number in 1.3. #495

Edwardmark opened this issue Oct 23, 2024 · 1 comment

Comments

@Edwardmark
Copy link

Hi, thanks for your great work! What is the number of blocks in v1.3? is it still the same of v1.2? It seems strage not double the block number like stdit.

@LinB203
Copy link
Member

LinB203 commented Oct 23, 2024

Yes, since we adopted the 3D attention architecture for 1.2, we don't need to double the number of layers.
You can find the number of layers here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants