Skip to content

Commit

Permalink
Merge pull request tatsu-lab#18 from eltociear/patch-1
Browse files Browse the repository at this point in the history
Update README.md
  • Loading branch information
rtaori authored Mar 15, 2023
2 parents d4d4ba4 + f222e56 commit 032f6e2
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ The inner circle of the plot represents the root verb of the instructions, and t
[<img src="assets/parse_analysis.png" width="750" />](./assets/parse_analysis.png)

## Fine-tuning
We fine-tune our model using standard huggingface training code with the following hyperparameters:
We fine-tune our model using standard Hugging Face training code with the following hyperparameters:

| Hyperparameter | Value |
|----------------|-------|
Expand All @@ -101,7 +101,7 @@ We fine-tune our model using standard huggingface training code with the followi
| Max length | 512 |
| Weight decay | 1 |

We are waiting for huggingface to officially support the llama models (i.e. this [PR](https://github.com/huggingface/transformers/pull/21955) to be merged) before we release a stable version of the finetuning code.
We are waiting for Hugging Face to officially support the llama models (i.e. this [PR](https://github.com/huggingface/transformers/pull/21955) to be merged) before we release a stable version of the finetuning code.

### Authors
All grad students below contributed equally and the order is determined by random draw.
Expand Down

0 comments on commit 032f6e2

Please sign in to comment.