Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add gptj modeling in TGI #2366

Closed
wants to merge 1 commit into from
Closed

add gptj modeling in TGI #2366

wants to merge 1 commit into from

Conversation

sywangyi
Copy link
Contributor

@sywangyi sywangyi commented Aug 7, 2024

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
@sywangyi
Copy link
Contributor Author

sywangyi commented Aug 7, 2024

@danieldk @yao-matrix please help review

@sywangyi
Copy link
Contributor Author

sywangyi commented Aug 7, 2024

image
GPTJ is used in mlperf. so enable in it tgi

drbh added a commit that referenced this pull request Aug 8, 2024
* add gptj modeling

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* fix: update docs for model addition

* fix: adjust syntax typo

* fix: adjust syntax typo again

---------

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Wang, Yi A <yi.a.wang@intel.com>
@drbh
Copy link
Collaborator

drbh commented Aug 8, 2024

closing because these commits were included in this PR: #2372 (to run CI). Thank you for the contribution! 🙏

@drbh drbh closed this Aug 8, 2024
yuanwu2017 pushed a commit to yuanwu2017/tgi-gaudi that referenced this pull request Sep 26, 2024
* add gptj modeling

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* fix: update docs for model addition

* fix: adjust syntax typo

* fix: adjust syntax typo again

---------

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Wang, Yi A <yi.a.wang@intel.com>
@sywangyi sywangyi deleted the gptj branch November 4, 2024 00:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants