Update language-modeling README.md, add trust_remote_code for flan-t5…

…-xl (#1422)
huggingface · Oct 17, 2024 · 8d75936 · 8d75936
1 parent cf1cbd1
commit 8d75936
Show file tree

Hide file tree

Showing 2 changed files with 4 additions and 1 deletion.
diff --git a/examples/language-modeling/README.md b/examples/language-modeling/README.md
@@ -868,7 +868,8 @@ python3 ../gaudi_spawn.py --world_size 8 --use_mpi peft_poly_seq2seq_with_genera
     --per_device_eval_batch_size 4 \
     --bf16 \
     --use_hpu_graphs_for_inference \
-    --use_hpu_graphs_for_training
+    --use_hpu_graphs_for_training \
+    --trust_remote_code
 ```
 
 

diff --git a/examples/text-generation/README.md b/examples/text-generation/README.md
@@ -633,6 +633,8 @@ First, you should install the requirements:
 pip install -r requirements_lm_eval.txt
 ```
 
+> [!NOTE]
+> If custom models on hub is being used, please set env variable HF_DATASETS_TRUST_REMOTE_CODE=true instead of arg --trust_remote_code with the installed lm_eval version and dependency datasets==2.21.0
 
 ### Examples