Update README.md

HKUNLP · Apr 25, 2024 · 4b8ce52 · 4b8ce52
1 parent 5efbc21
commit 4b8ce52
Showing 1 changed file with 4 additions and 2 deletions.
diff --git a/README.md b/README.md
@@ -108,17 +108,19 @@ pip install flash-attn --no-build-isolation (FlashAttention >= 2.5.0)
 | [Llama-2-7b-hf (4k)](https://huggingface.co/meta-llama/Llama-2-7b-hf)               |     32k      | 
 | [Llama-2-13b-hf (4k )](https://huggingface.co/meta-llama/Llama-2-13b-hf)            |     32k      |
 | [Llama-2-70b-hf (4k)](https://huggingface.co/meta-llama/Llama-2-70b-hf)             |     128k     | 
+| [Meta-Llama-3-8B (8k)](https://huggingface.co/meta-llama/Meta-Llama-3-8B)            |     96k      |
+| [Meta-Llama-3-70B (8k)](https://huggingface.co/meta-llama/Meta-Llama-3-70B)           |    200k+    | 
 | [Together's LLaMA-2-7b-32k](https://huggingface.co/togethercomputer/LLaMA-2-7B-32K) |     200k     | 
 | SFT Models                                                                          |              |
 | [Llama-2-7b-chat-hf (4k)](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf)     |     32k      |
 | [Llama-2-13b-chat-hf (4k)](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf)   |     32k      |
 | [Llama-2-70b-chat-hf (4k)](https://huggingface.co/meta-llama/Llama-2-70b-chat-hf)   |     128k     |
+| [Meta-Llama-3-8B-Instruct (8k)](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)   |     96k      |
+| [Meta-Llama-3-70B-Instruct (8k)](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) |     200k+     |
 | [Vicuna-1.5-7b-16k](https://huggingface.co/lmsys/vicuna-7b-v1.5-16k)                |     200k     |
 | [Vicuna-1.5-13b-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k)              |     200k     |
 | [Mixtral 8x7b & Mistral 7b](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)        |     200k+     |
 | [Qwen1.5](https://huggingface.co/Qwen/Qwen1.5-14B-Chat) 中文                        |      200k     |
-| [ChunkLlama-sft-7b-16k (ours)](https://huggingface.co/L4NLP/todo)                   |     100k     |
-| [ChunkLlama-sft-13b-16k (ours)](https://huggingface.co/L4NLP/todo)                  |     100k     |
 
 3. Deploy your own demo.
 We provide three examples of how to employ DCA on popular LLMs in `run_chunkllama_100k.py`, `run_together_200k.py` and `run_vicuna_200k.py`.