update gguf docs

[metascroy]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/794

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Pending

As of commit de27ed4 with merge base 05a2f45 ():

NEW FAILURE - The following job has failed:

• Run the aoti runner with CUDA using stories / test-runner-aot-cuda / linux-job (gh)
  RuntimeError: Command docker exec -t f44d9c8decfcfd677d28b914d5c902ac2944f2139af408231484b7bf07e51fa4 /exec failed with exit code 134

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[metascroy]

@mikekgfb what are these lines doing:

[shell default]: HF_TOKEN="${SECRET_HF_TOKEN_PERIODIC}" huggingface-cli login
[shell default]: TORCHCHAT_ROOT=${PWD} ./scripts/install_et.sh

They show up in the rendered markdown.

[mikekgfb]

These are commands for our CI which extracts the shell commands and runs them to ensure that the instructions in the docs work. Because we don't install et in the commands in the document (assuming that those have already been performed), we need to do it in a side channel.

shoul be commented out, I'll add that

[mikekgfb]

Thank you!

[mikekgfb]

These are commands for our CI which extracts the shell commands and runs them to ensure that the instructions in the docs work. Because we don't install et in the commands in the document (assuming that those have already been performed), we need to do it in a side channel.

shoul be commented out, I'll add that