int4 description #113
Merged
int4 description #113
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Added INT4 finetuning description to README.md
sarthaklangde
suggested changes
Apr 6, 2023
Added separate README.md to int4 finetuning folder and changed links
Added typo fixes to README.md
sarthaklangde
suggested changes
Apr 6, 2023
examples/int4_finetuning/README.md
Outdated
|
|
||
| With INT4 fine-tuning, xTuring offers several benefits: | ||
|
|
||
| 1. Reduced Memory Footprint: The INT4 precision reduces the memory requirements to just ~5GB of VRAM, allowing you to fine-tune LLMs on hardware with lower memory capacities. |
There was a problem hiding this comment.
Suggested change
| 1. Reduced Memory Footprint: The INT4 precision reduces the memory requirements to just ~5GB of VRAM, allowing you to fine-tune LLMs on hardware with lower memory capacities. | |
| 1. Reduced memory gootprint: The INT4 precision reduces the memory requirements to just ~5GB of VRAM, allowing you to fine-tune LLMs on hardware with lower memory capacities. |
examples/int4_finetuning/README.md
Outdated
|
|
||
| With INT4 fine-tuning, xTuring offers several benefits: | ||
|
|
||
| 1. Reduced Memory Footprint: The INT4 precision reduces the memory requirements to just ~5GB of VRAM, allowing you to fine-tune LLMs on hardware with lower memory capacities. |
There was a problem hiding this comment.
Is it 5GB or 6GB? I see both numbers mentioned.
There was a problem hiding this comment.
I've asked and it is closer to 6GB, will change
Added information checks and typo fixes for README.md
Added information about VRAM to main README.md
Added licence information to main README.md
Fixed licence line in README.md
sarthaklangde
approved these changes
Apr 6, 2023
sarthaklangde
approved these changes
Apr 6, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.