Updated Albert model Card #37753

souvikchand · 2025-04-24T12:44:43Z

What does this PR do?

Updates ALBERT model card as per #36979

Before submitting

This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
Did you read the contributor guideline,
Pull Request section?
Was this discussed/approved via a Github issue or the forum? [Community contributions] Model cards #36979
to it if that's the case.
Did you make sure to update the documentation with your changes? Here are the
documentation guidelines, and
here are tips on formatting docstrings.
Did you write any new necessary tests?

Who can review?

@stevhliu Please check the PR and see if it's alright 😄

github-actions · 2025-04-24T12:44:55Z

Hi 👋, thank you for opening this pull request! The pull request is converted to draft by default. The CI will be paused while the PR is in draft mode. When it is ready for review, please click the Ready for review button (at the bottom of the PR page). This will assign reviewers and trigger CI.

stevhliu

Nice, thanks for your contribution!

docs/source/en/model_doc/albert.md

stevhliu

Thanks, just a few more minor details :)

docs/source/en/model_doc/albert.md

souvikchand · 2025-05-01T07:39:21Z

@stevhliu, I have done suggested changes. please review and let me know if it is ok 😄

stevhliu · 2025-05-19T15:38:56Z

Hey, sorry for the delay! PR looks good to me, feel free to mark it as ready for review whenever you're ready 🙂

HuggingFaceDocBuilderDev · 2025-05-19T15:52:25Z

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

stevhliu · 2025-06-10T16:08:18Z

Hi, would you mind rebasing your branch?

added the quotes in <hfoption id="Pipeline"> Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

updated checkpoints Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

changed !Tips description Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

updated text Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

updated transformer-cli implementation Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

changed text Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

removed repeated description Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

removed lines

updated pipeline code

updated auto model code, removed quantization as model size is not large, removed the attention visualizer part

updated notes Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

reduced a repeating point in notes

updated transformer-CLI Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

removed extra notes Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

souvikchand · 2025-06-13T21:24:09Z

@stevhliu, I guess I made the rebase. Since I am new to this can you please confirm if I have made it?
Also sorry for the delay 😓

stevhliu

Thanks and no problem, this looks good!

druvdub · 2025-06-16T18:24:00Z

docs/source/en/model_doc/albert.md

+- **Cross-layer parameter sharing:** Instead of learning separate parameters for each transformer layer, ALBERT shares parameters across layers, further reducing the number of learnable weights.
+
+ALBERT uses absolute position embeddings (like BERT) so padding is applied at right. Size of embeddings is 128 While BERT uses 768. ALBERT can processes maximum 512 token at a time. 
+>>>>>>> 7ba1110083 (Update docs/source/en/model_doc/albert.md)


Hey @stevhliu, I found some merge conflict artifacts that weren't removed during the PR merge. These lines are still showing in the docs. Should I open a new PR to clean these up?

I am making a PR for the docs for auto classes, so I could push the fix with that?

Oops, good catch! Can you just raise a separate PR to fix the merge conflict artifacts please?

github-actions bot marked this pull request as draft April 24, 2025 12:44

souvikchand mentioned this pull request Apr 24, 2025

[Community contributions] Model cards #36979

Closed

stevhliu reviewed Apr 24, 2025

View reviewed changes

stevhliu reviewed Apr 30, 2025

View reviewed changes

docs/source/en/model_doc/albert.md Outdated Show resolved Hide resolved

docs/source/en/model_doc/albert.md Outdated Show resolved Hide resolved

souvikchand marked this pull request as ready for review June 4, 2025 06:10

souvikchand and others added 15 commits June 14, 2025 02:29

Updated Albert model Card

bb39f3e

Update docs/source/en/model_doc/albert.md

479f947

added the quotes in <hfoption id="Pipeline"> Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update docs/source/en/model_doc/albert.md

9887961

updated checkpoints Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update docs/source/en/model_doc/albert.md

ffabc6a

changed !Tips description Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update docs/source/en/model_doc/albert.md

c8d5a27

updated text Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update docs/source/en/model_doc/albert.md

420ccd8

updated transformer-cli implementation Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update docs/source/en/model_doc/albert.md

f05b675

changed text Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update docs/source/en/model_doc/albert.md

8270d4d

removed repeated description Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update albert.md

3995b1f

removed lines

Update albert.md

755b879

updated pipeline code

Update albert.md

1f14b79

updated auto model code, removed quantization as model size is not large, removed the attention visualizer part

Update docs/source/en/model_doc/albert.md

3f85944

updated notes Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update albert.md

f4621c5

reduced a repeating point in notes

Update docs/source/en/model_doc/albert.md

880b962

updated transformer-CLI Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

Update docs/source/en/model_doc/albert.md

ef41998

removed extra notes Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

souvikchand force-pushed the patch-albert branch from 4db5b2d to ef41998 Compare June 13, 2025 21:09

stevhliu approved these changes Jun 13, 2025

View reviewed changes

stevhliu merged commit d5d007a into huggingface:main Jun 13, 2025
10 checks passed

druvdub reviewed Jun 16, 2025

View reviewed changes

druvdub mentioned this pull request Jun 16, 2025

Remove merge conflict artifacts in Albert model doc #38849

Merged

2 tasks

Updated Albert model Card #37753

Updated Albert model Card #37753

Uh oh!

Conversation

souvikchand commented Apr 24, 2025

What does this PR do?

Before submitting

Who can review?

Uh oh!

github-actions bot commented Apr 24, 2025

Uh oh!

stevhliu left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

stevhliu left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

souvikchand commented May 1, 2025

Uh oh!

stevhliu commented May 19, 2025

Uh oh!

HuggingFaceDocBuilderDev commented May 19, 2025

Uh oh!

stevhliu commented Jun 10, 2025

Uh oh!

souvikchand commented Jun 13, 2025

Uh oh!

stevhliu left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

druvdub Jun 16, 2025

Choose a reason for hiding this comment

Uh oh!

druvdub Jun 16, 2025

Choose a reason for hiding this comment

Uh oh!

stevhliu Jun 16, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!