Update on "Support llama3.1"

Summary: Add scaled RoPE

Test Plan: Test official checkpoint and gives meaningful result.

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D60129927](https://our.internmc.facebook.com/intern/diff/D60129927)

[ghstack-poisoned]

Author: larryliu0820

examples/models/llama2/rope.py

@@ -48,8 +48,8 @@ def precompute_freqs_cis(
     )
     t = torch.arange(end, device=freqs.device)  # pyre-ignore
     if use_scaled:
-        freqs = apply_scaling(freqs)
-    freqs = torch.outer(t, freqs).float()  # pyre-ignorex   x
+        freqs = apply_scaling(freqs)  # pyre-ignore
+    freqs = torch.outer(t, freqs).float()
     freqs_cos = torch.cos(freqs)
     freqs_sin = torch.sin(freqs)
     return freqs_cos, freqs_sin