Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ChenxinAn-fdu authored May 9, 2024
1 parent 35dd47e commit 3382f0e
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -162,9 +162,9 @@ This section contains the data and code for validating ChunkLlama on different t

```bash
cd ppl
python test_ppl.py --seq_len 16384 --scale 13b (7b/13b/70b) --data_path pg19_llama3.validation.bin
python test_ppl.py --seq_len 16384 --scale 13b (7b/13b/70b) --data_path pg19_llama2.validation.bin
```
where `--seq_len 16384` denotes the length of input prompts. We use tokenized the tokenized validation split of PG19 provided by [longlora](https://github.com/dvlab-research/LongLoRA). The raw data and tokenized data which can directly be loaded are available [here]().
where `--seq_len 16384` denotes the length of input prompts. We use tokenized the tokenized validation split of PG19 processed by [longlora](https://github.com/dvlab-research/LongLoRA). The raw data and tokenized data are in `ppl` folder.

#### Passkey Retrieval
We provide a manner to test the passkey retrieval accuracy. For example,
Expand Down

0 comments on commit 3382f0e

Please sign in to comment.