Small change so token embeddings aren't looked up for past tokens during inference#24

lucidrains merged 1 commit intolucidrains:mainlucidrains/native-sparse-attention-pytorch:mainfrom

Pasewark:token_inference_fixPasewark/native-sparse-attention-pytorch:token_inference_fixCopy head branch name to clipboard