Fix a bug in tying OPT embeddings #1

WoosukKwon · 2023-02-25T00:27:11Z

This PR fixes a bug in supporting OPT-350m/OPT-6.7b/OPT-13b and OPT-IML models.

The bug happened because our model code didn't include some methods that were required to tie the input and output embeddings.

add rope scaling as a cli arg so openai server can load rope scaled models

Fix key cache block shape.

Deterministic OpenVINO inference

merge code

BA-78554: Jurassic 2.5 * worked on jurasic2.5 configuration file, updated jurassic2_5 modeling file to support alternating experts/attn layers * finished working the forward pass of jurassic3.py * finished working the forward pass of jurassic3.py * finished working the forward pass of jurassic3.py * jurassic_3 modeling file works, uses dummy weights initialized by "dummy" flag. Tokenizer raises issues, for now copying the mixtral tokenizer * changed default tokenizer vocab values, loading of custom .pt weight files works. * removed notebook * merging master to jurassic-2.5 to reset head * Merge branch 'master' into jurassic-2.5 * align to master Approved-by: Tomer Asida Approved-by: Mor Zusman

Triton compilation fix

Group Gemm Version

rebase to vllm main branch with nki_flash_attn

bug fix: variable number of max decode tokens within batch (vllm-project#73)

Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>

* count Model Runner * compute logits * compute logits * compute logits * compute logits * compute logits * logits_processor.py * logits_processor.py * logits_processor.py * logits_processor.py * exit after get_logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit before prune * exit before prune * exit before prune * exit before prune * exit after prune * exit after prune * exit after prune * exit after prune * exit after prune * exit after prune * exit after prune * print sampling indices * print sampling indices * print sampling indices * print sampling indices * index select * index select * index select * index select * index select * index select * index select * sampling index * fix allgather * fix allgather * fix allgather * fix allgather * print hidden_states * print ranks * exit before logits_processor * print before crash * print in order * print in order * print in order * print before logits_processor * print before logits_processor * print before logits_processor * print before logits_processor * print before compute_logits * print before compute_logits * print hidden states before compute_logits * print hidden states before compute_logits * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * narrow hidden_states * narrow hidden_states * narrow hidden_states * narrow hidden_states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * remove norm * remove layer norm * find bug * find bug * find bug * find the bug * print in scientific mode * print hidden_states * debug * debug * Revert to 1402c2c * Revert to aec448d * revert * debug * debug * debug * debug * debug * debug * debug * debug * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * investigate c * investigate c * investigate c * inspect logits processor * inspect logits processor * remove exit() * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * find inconsistency * find kv_cache difference * find kv_cache difference * print function call stack * print function call stack * understand kv_cache inconsistency * modify config.py to incorporate SP * fuse all-to-all communications of qkv * check pipeline parallelism * remove exits * remove exit * handle (TP=2, SP=4) * fix prepare input * track down PP hang * track down PP hang * exit after LogitsProcessor * exit before attention * exit before attention * propagate over all layers to fix PP hang * propagate over all layers to fix PP hang * hidden_or_intermediate_states does not have to be torch.Tensor * postpone PP hang, it requires removal of all barriers * remove synchronizations from prepare_input * remove synchronizations from prepare_input * remove synchronizations from prepare_input * remove synchronizations from prepare_input * remove synchronizations from prepare_input * remove synchronizations from prepare_input * print function call stack in execute_model * hard-code number of layers = 2 * prune barriers to enable cuda graph * prune barrieres to enable cuda graph * prune barriers to enable cuda graph capture * prune barriers to enable cuda graph capture * prune barriers to enable cuda graph capture * prune barriers to enable cuda graph capture * prune barriers to enable cuda graph capture * fix (TP=1, SP=8) * find the hang in (TP=1, SP=8) * find the hang in (TP=1, SP=8) * find the hang in (TP=1, SP=8) * remove exit() * remove traceback * remove prints * remove if hidden_states.shape[0] > 0: * allow input with 0 tokens for RowParallelLinear * comment out output projection * solve the bug in RowParallelLinear for inputs with 0 tokens * solve the bug in RowParallelLinear for inputs with 0 tokens * return input if # tokens is 0 * working version before * working version * remove comments in LlamaAttention * remove barriers from worker/model_runner.py * clean benchmark_serving.py * clean communication_op.py * clean async_llm_engine.py * clean distributed_gpu_executor.py * clean llm_engine.py * clean multiproc_gpu_executor.py * clean rag_gpu_executor.py * clean lora/layers.py * clean worker_base.py * clean worker.py * clean vocab_parallel_embedding.py * clean logits_processor.py * clean logits_processor.py * clean logits_processor.py * clean multiproc_gpu_executor.py * clean linear.py * clean linear.py * clean parallel_state.py * test clean logits_processor * take test back * clean llama.py * clean llama.py * clean parallel_state.py * clean llama.py

commit ba99eaf6d955721cb30d7f309c59a8c30c082cb1 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 22:59:51 2025 -0800 reduce Ulysses overhead commit 8cdea0b361a6b794e65778ec142fe448e584e74e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 21:44:13 2025 -0800 reduce Ulysses overhead commit 2fa6efba84b063dc88a609429c16741f2a785809 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 21:40:35 2025 -0800 reduce Ulysses overhead commit 2efaf7443f077d414bb0d8d87c74288c5bf08b5d Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 21:28:53 2025 -0800 reduce Ulysses overhead commit 52f86ea20bd5dd1f2cb9c682a6aff894099de235 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 21:22:05 2025 -0800 reduce Ulysses overhead commit ef87ba4a6c6f9302d13e6e346a1c5676805fc6e0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 21:15:37 2025 -0800 reduce Ulysses overhead commit bac0d8fdfd1649268a73e446140a26decac33345 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 21:13:21 2025 -0800 reduce Ulysses overhead commit 9be6363aa9d3d1c30f3a8f7157a020d424715ac4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 21:09:24 2025 -0800 reduce Ulysses overhead commit 6ab09ece362e3ed5b34d260b7bf2a938a27aa954 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 20:25:29 2025 -0800 reduce Ulysses overhead commit 05e1768b8c4b44bce7b500f64e15b0bd798db33a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 19:59:16 2025 -0800 reduce Ulysses overhead commit f33399861962daf6d2634772fc19db2c51481506 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 19:54:28 2025 -0800 reduce Ulysses overhead commit d1564da0761e859fcf27e5d5881d76f1517f666e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 19:52:10 2025 -0800 reduce Ulysses overhead commit da7ad1c86fbf4bcb6091c57342ad4e2c80032d31 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 19:29:21 2025 -0800 reduce Ulysses overhead commit 991d09eeeabe1328410b16a8f610fe819c59cede Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 19:22:20 2025 -0800 reduce Ulysses overhead commit 9cc3d74ee4bdea0f33e5b3512dfe42d31140a5a9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 19:07:49 2025 -0800 reduce Ulysses overhead commit 6293a22997f9f187e5a88423e06caff1cf69a1bb Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 19:01:51 2025 -0800 reduce Ulysses overhead commit 7baa586384757272c07284e4f880cd3311e9bb95 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 18:55:40 2025 -0800 reduce Ulysses overhead commit 1a7c605eabc66fb0ad72bd3db17d91d93dae2766 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 18:51:39 2025 -0800 reduce Ulysses overhead commit 8816533dfb49367bfcc4185a1f4246c736ebfae4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 18:39:45 2025 -0800 make N a global variable commit 52b01e94887b218af77ec89a773189d8c29950f3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Feb 12 17:09:52 2025 -0800 remove Ulysses overhead commit ae4f64d219a40c586b1c230501513e87acd690ef Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 22:48:41 2025 -0800 narrow input_ids & positions in causal forward commit 484d266f394c2a5c1bf2771a7a42789a6eb24270 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 22:43:18 2025 -0800 narrow input_ids & positions in causal forward commit af8521262c84da1e52342657ba7dc15a7e56b681 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 22:36:52 2025 -0800 narrow input_ids & positions in causal forward commit 405c00546f3adb8067d3ebd5d2d3e85b8a5c696c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 17:25:14 2025 -0800 find bug commit 106a5e37f8b630709aaa7b4d29e34c2eafc00a2b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 17:19:52 2025 -0800 find bug commit becab359c9a4f03ad9f418f5818b294447e868e4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 17:12:28 2025 -0800 find bug commit 93f64111a9d3e622f9fd70981a73dd6427f2bf9c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:50:48 2025 -0800 find bug commit f11d5511674701c874429112a18882d60675f8a6 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:48:37 2025 -0800 find bug commit 914003e8b0430c99697d85ce495c322ce559c830 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:44:13 2025 -0800 find bug commit 19067286fd95552d5215113ed9f64c9b4cdb6eb4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:39:08 2025 -0800 find bug commit eb8b5a8ee4d5468ccd0bde88b9f3ace01c26fe07 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:26:53 2025 -0800 find bug commit 5cd6d48ebacd18786fda5cc3156f7c36d72c2045 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:23:04 2025 -0800 find bug commit 84212c4da7de79ce097712868438ed843182016b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:20:00 2025 -0800 find bug commit ee9d9579cfbc58475a08f3c09cc7a7d915d7e909 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:16:47 2025 -0800 find bug commit a2c5d8f59d926f0881f24eb954736d2a5c4a39b5 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:13:45 2025 -0800 find bug commit 04c0d7c8957358c0363d0912d8021d4a632392ad Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:08:36 2025 -0800 find bug commit a00635d00a3189453ecc7489f14be7ecf1442f98 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 16:04:33 2025 -0800 find bug commit 386948a2b84dc7ca89ef462daa71955f7dce1228 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:59:09 2025 -0800 find bug commit 3712cd5a6ea9628ea67581f859f7b4c1e612bb31 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:55:21 2025 -0800 find bug commit 528e75aaab471f56f39a41e95db3f37c17116104 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:51:14 2025 -0800 find bug commit 50eefb671221e359032b07537fd7b33ef453017c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:49:14 2025 -0800 find bug commit c22704ed7e95f111218bf3702d418b72d5ee22e6 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:46:25 2025 -0800 find bug commit 96d14c1f314472e2ae7cad894aa769f43e180ea9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:44:21 2025 -0800 find bug commit 254d8b8c2961f79066b9b9401170feca48dbf951 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:42:03 2025 -0800 find bug commit 4d51692b904a374490621537a00ac439d8ab3787 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:34:38 2025 -0800 find bug commit 942cbaf2429967d15e22ff5603daa1dc511a3ee5 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 15:22:09 2025 -0800 find bug commit 19c96e004e83fd37e51bf36fd6cac5526a4130f6 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 14:50:03 2025 -0800 move Ulysses all-to-all into Flash Attention commit b0b1a765e5a4984705f20108a9132ea887710f6c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 14:45:28 2025 -0800 move Ulysses all-to-all into Flash Attention commit 2d190d8838ff9c93b96ad311d41a2381ac7be67c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 14:45:05 2025 -0800 move Ulysses all-to-all into Flash Attention commit c74ea2f367696cd90aaef51e516af0271aef76a4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 14:42:41 2025 -0800 move Ulysses all-to-all into Flash Attention commit a3042d7eec8fb37a6d2d6ca3edb6aabdb6bc111e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:41:51 2025 -0800 move Ulysses all-to-all into Flash Attention commit ef1732cf116209c666e1eaba6406cc6415004087 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:36:41 2025 -0800 move Ulysses all-to-all into Flash Attention commit ff31bb38cc3abca7357169b330262bea244ee743 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:33:55 2025 -0800 move Ulysses all-to-all into Flash Attention commit 862b3db3bde8494b843c153deb873857b58b2708 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:31:48 2025 -0800 move Ulysses all-to-all into Flash Attention commit e8a680617bde73c872dc9ee965c1fbf082d14f09 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:27:59 2025 -0800 move Ulysses all-to-all into Flash Attention commit 2c76e0d2a675d6f90bff942c33fd0ae7a9fbe7cb Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:27:37 2025 -0800 move Ulysses all-to-all into Flash Attention commit 9913425513dea3e9f5e49c0a9cb2162923c6b8ee Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:25:11 2025 -0800 move Ulysses all-to-all into Flash Attention commit 12bb83291dd45d78d8a14a2c021a6b249a23bfab Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:22:34 2025 -0800 move Ulysses all-to-all into Flash Attention commit 4db0dcd028a776b8ae99dfa92d9206bbccccebc8 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:11:38 2025 -0800 move Ulysses all-to-all into Flash Attention commit a5d1acff703ec4a4c5c36680bf7379d6e552b95e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:09:35 2025 -0800 move Ulysses all-to-all into Flash Attention commit 4fa584a396186c402f302db4fecce17abe7da476 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:07:27 2025 -0800 move Ulysses all-to-all into Flash Attention commit 61983a6e05d94381d3bed0b681697c4d19121fee Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:03:49 2025 -0800 move Ulysses all-to-all into Flash Attention commit 3396eff77d12c19bbda723e8156def7f6dad3f04 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 13:01:09 2025 -0800 move Ulysses all-to-all into Flash Attention commit d8b5e97444476f8f4254a253150c56ce654eefd9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:54:58 2025 -0800 move Ulysses all-to-all into Flash Attention commit 6ee4506a6849a4ba4dbc6e893bd41bb811ccdacb Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:49:59 2025 -0800 move Ulysses all-to-all into Flash Attention commit bb09c486a8e56a4c3ac5f86bc1375511659aa3c9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:44:24 2025 -0800 move Ulysses all-to-all into Flash Attention commit 6943666d21a75c5d935d55631fd67ce6fcecccc2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:40:42 2025 -0800 move Ulysses all-to-all into Flash Attention commit 2c10d53f2431004a45ef7fc2261d7b745ea62aa3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:38:31 2025 -0800 move Ulysses all-to-all into Flash Attention commit b497951683579c1ea110cdacc87bcb940070bf19 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:23:27 2025 -0800 move Ulysses all-to-all into Flash Attention commit 4aceb7b6ace1d5dd8f04fb37651147a835b104e9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:21:39 2025 -0800 move Ulysses all-to-all into Flash Attention commit 3de017124e23caef5a461edbfaceb45efc6be3da Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 12:15:16 2025 -0800 move Ulysses all-to-all into Flash Attention commit 9f0f1e7ea187f750b6379806d0803f3a0a958485 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 11:37:22 2025 -0800 move Ulysses all-to-all into Flash Attention commit 9931880cf1c37e901290ff2ac464158ddb900267 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:30:08 2025 -0800 find bug commit 134198e150f9ee128fb847dfe36530553b73eac0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:29:42 2025 -0800 find bug commit a799d3ff2761c6e570ca538a2ad9cc013c42a5f0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:26:50 2025 -0800 find bug commit ea0c0140a0842ce8694c308559407f7990efc9e6 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:25:49 2025 -0800 find bug commit 17e2a1c381d676eca09b06331250fc8e4d8ef118 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:23:11 2025 -0800 find bug commit acca5d6ee354654eaef19cc2070ec8cb22fa4e47 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:21:21 2025 -0800 find bug commit dd0a243606ac44ea1b2262ce78cc3f07495d8945 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:17:17 2025 -0800 find bug commit 27514587861c508311d8a9064478b677e5c2c03e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:13:31 2025 -0800 find bug commit 265e84cffd15b95c92f9fe6c5704673415f562f7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:10:07 2025 -0800 find bug commit 61778921d338dc9d4669b9fba1449a8c2ee84a46 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 01:06:33 2025 -0800 find bug commit 24540472b97bf5b510c05f5724a58578a51f5f89 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:59:44 2025 -0800 find bug commit 4e77349497968855050ad51e8f82a57dc4d1f490 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:55:01 2025 -0800 find bug commit e9d66b43687e17246812394fd3c2bd606c43b41d Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:52:56 2025 -0800 find bug commit ff30961f2af239466cef61407405ad004bb2d178 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:50:17 2025 -0800 implement Ulysses within Attention commit 8c1059e467ce6c77679c830535c5a08e62e26429 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:45:36 2025 -0800 implement Ulysses within Attention commit e8a9fee02b794ddd281ea6c9618b3e6d0482c890 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:38:34 2025 -0800 implement Ulysses within Attention commit d96dc96cba4c8198ab17b830ad7d32a326ef9601 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:33:32 2025 -0800 implement Ulysses within Attention commit af569dd6b735b9b696b54ab5183ea3b49c173ead Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Feb 11 00:19:09 2025 -0800 implement Ulysses within Attention commit 9c011b8e075cadab3722b09e8d299212746b33fb Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 23:04:12 2025 -0800 move Ulysses into Attention commit 236cc1efdf51bfa0faab1ecda2d77eff4a7cd15e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 23:01:58 2025 -0800 move Ulysses into Attention commit a5cf9d42d48c5c542b9f6cc8a965e8e04d62f588 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:59:33 2025 -0800 move Ulysses into Attention commit 6289429cde40a6d58da6bf5e243f7f8f8495061c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:52:24 2025 -0800 move Ulysses into Attention commit 33d0436b6a314fb094f8579fea32ac518273b89b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:50:32 2025 -0800 move Ulysses into Attention commit 762c8b94d74461eb6942a29f4df7e01f9f196e33 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:48:24 2025 -0800 move Ulysses into Attention commit afec9ce0042fd1e490d19d29e8bd6c574b709837 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:35:57 2025 -0800 move Ulysses into Attention commit 9cf772d23be7bc96efa7f23ac05245c5fb2a11e2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:30:40 2025 -0800 move Ulysses into Attention commit 488040b472f28441da5b9abc4cde9c8f3befb0c5 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:29:26 2025 -0800 move Ulysses into Attention commit 722118ca2ae50f32ce7f00cc39c7f96806fe6595 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:25:26 2025 -0800 move Ulysses into Attention commit 201eeffae0f2466d3eca7dc39bf7412e543c3018 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:23:10 2025 -0800 move Ulysses into Attention commit 6036b3d9730655de385b0cf860406fd98b271817 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:20:18 2025 -0800 move Ulysses into Attention commit efb8ced40f1eba4ac0fd09f4efd77d5d9d98167a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:12:24 2025 -0800 move Ulysses into Attention commit 8161e2f7c58136829b7459bd443bed627c1dc204 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 22:12:14 2025 -0800 move Ulysses into Attention commit 361e3c8b69b5401f7387de8562751a99635ffbee Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 21:57:02 2025 -0800 move Ulysses into Attention commit 118b8a2a3bfc61cbfd34f876316107412af0f1ad Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 21:36:37 2025 -0800 move Ulysses into Attention commit 76df8cf58f8443528fef1a7679d5405705b0e9fe Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 20:53:47 2025 -0800 move Ulysses into Attention commit 6b4640abf042aa93694533c9d9243205c80c943c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 20:51:15 2025 -0800 move Ulysses into Attention commit 494f3693a8f2cb39f4f4e7cb560393028b7f4e97 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 20:44:46 2025 -0800 move Ulysses into Attention commit e7b461fff630c285dc321aae346362a2c7cccc91 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 20:38:51 2025 -0800 debug attention commit 903527b5c730dbbc7f88ce3f9830366d7cd1bce8 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 20:34:36 2025 -0800 debug 70B commit a387680e293488d55b92df5e3f2b5b9722ba3ba3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 14:49:41 2025 -0800 move Ulysses into the Attention function commit dfb94e8b4ab33d87248953e3c47b92fe8e041201 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 14:38:19 2025 -0800 move Ulysses into the Attention function commit c707c9d2cb6a2055afe3d331f375700e1c494e4b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 14:01:30 2025 -0800 move Ulysses into the Attention function commit cb3caf650df72f86ce9e20f4390a8ebce6880a29 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:49:34 2025 -0800 move Ulysses into the Attention function commit c028021079411353624bfd434cc0d7bda089c11a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:46:50 2025 -0800 move Ulysses into the Attention function commit 7da44d00fdb5f09fb7409131aea4dac43cc7b94f Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:37:06 2025 -0800 move Ulysses into the Attention function commit a06576ea56dc3d94a594f3ea6da621da20f1f0d1 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:36:17 2025 -0800 move Ulysses into the Attention function commit 5b18cc05052ef26c11b1147716d36551da9974fb Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:16:01 2025 -0800 move Ulysses into the Attention function commit 76de9d91c9bb3402fa72bc96db936024a7358631 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:08:04 2025 -0800 move Ulysses into the Attention function commit ccfc88a1e64566bd7357bf4f4532d0579d439dd4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:02:48 2025 -0800 move Ulysses into the Attention function commit 5633a8a3225edc732f609b39149125291a2d083f Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 13:02:27 2025 -0800 move Ulysses into the Attention function commit 477ad09c0491281d053ce304f4738b04d8e20b30 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:53:19 2025 -0800 move Ulysses into the Attention function commit d7c08fb5c6db167c5043e112f32cd13b39f7f3a1 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:50:31 2025 -0800 move Ulysses into the Attention function commit f9b94e0bc5f00d85da8e4b6e2dbabd84212bd0da Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:45:46 2025 -0800 move Ulysses into the Attention function commit 8f57d3e818b96ed02afd9a0a606c91c635b24e76 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:37:31 2025 -0800 move Ulysses into the Attention function commit ce33cdfe40c62ed34019602d761eea24ba8577fb Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:32:51 2025 -0800 move Ulysses into the Attention function commit 1889c9b03cd153e462a67dc135ad648f67bb435a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:29:24 2025 -0800 move Ulysses into the Attention function commit 5712f174c433b693cb3642c348bf9f776c29efe4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:23:17 2025 -0800 move Ulysses into the Attention function commit af92c4aa44bcd1163b7bb5386a8cef62ff27cffe Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:18:21 2025 -0800 move Ulysses into the Attention function commit 25b7fc618ba36466d5383a756ef11d62750edee1 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 12:12:24 2025 -0800 move Ulysses into the Attention function commit 47abe72dc5272790972a7d081e59558ad361a4ae Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 03:00:29 2025 -0800 move Ulysses into the Attention function commit 6ea59623192065a0ce218d340d809a1c1fa96d62 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:59:00 2025 -0800 move Ulysses into the Attention function commit e210659c8400eb3f4186c87d29c60fa821891c18 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:38:55 2025 -0800 move Ulysses into the Attention function commit bd74706d1e8708d769f1749b6274c61d92363fb2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:35:27 2025 -0800 move Ulysses into the Attention function commit 7f67b15325bc20f706b0c5ecf1f3712478eccbb1 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:31:58 2025 -0800 move Ulysses into the Attention function commit 52e36605b0c74e0c34a0629eff6f282e8127eef2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:30:11 2025 -0800 move Ulysses into the Attention function commit baa7d811005522ea524220803440f957284a46b0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:27:51 2025 -0800 move Ulysses into the Attention function commit a9a9bcc5c05512eda483bf820803373e0ba1ed4b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:24:44 2025 -0800 move Ulysses into the Attention function commit 0e972a39b5dd810eb63606712d8baec3c3b9ce63 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:22:52 2025 -0800 move Ulysses into the Attention function commit a9af6419b7bf291ff9297d2f29c31073237bcf34 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:15:42 2025 -0800 move Ulysses into the Attention function commit 7875e93ff364556797d484b2777046dde5c7c982 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:12:27 2025 -0800 move Ulysses into the Attention function commit 3da41bfc97205db027987076ee1b947fb875f8ec Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:08:55 2025 -0800 move Ulysses into the Attention function commit 2d1b1b349efc688fc34af664b951a9dae1140714 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:03:03 2025 -0800 make N_ranks a tensor commit 8975c5547b0d17ddb542ef077e8e37b1a5c06eb0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 02:02:17 2025 -0800 make N_ranks a tensor commit facbe9580b799acce14fda4c28f3aba12ae9106e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:56:15 2025 -0800 make N_ranks a tensor commit f89750d81f7544cb9c9e44cfbc2f567a6aba5afd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:55:25 2025 -0800 make N_ranks a tensor commit 5c068d01039ca8c5eb06b0cc139e3c93dd479aee Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:54:18 2025 -0800 make N_ranks a tensor commit 9400aaf0858246cbcc0fcb2a9abea419516d4d87 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:52:19 2025 -0800 make N_ranks a tensor commit 6a49e048731346fc2251b04b1a594c6479b495e3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:50:36 2025 -0800 make N_ranks a tensor commit 95ead51896dc500f8b08381c839bfd53a30dd290 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:47:56 2025 -0800 make N_ranks a tensor commit d4f2684a721a8476a6d4ba12399e314005ddbdcf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:45:07 2025 -0800 make N_ranks a tensor commit d30630335ffcafefacb6ad80858f7fe9f55798ee Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:42:31 2025 -0800 make N_ranks a tensor commit 605c5210fda509faef5e0f42cd1df02beddf1ae9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:37:18 2025 -0800 make N_ranks a tensor commit bac0ec89ab2dcab5d98831070da7983b4cd035e9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:35:05 2025 -0800 make N_ranks a tensor commit ef858d1f4b8482c22b22fc96491a1ed8dcdea378 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:32:41 2025 -0800 make N_ranks a tensor commit 97eec2aace082937c438d15b8c06868bf5f402a7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:27:37 2025 -0800 make N_ranks a tensor commit b37a6227ee30d18bc74a961cbe6d8976a80a3d63 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:14:01 2025 -0800 make N_ranks a tensor commit 0ad28d964afec290619d7f05c692a25cf838d963 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:05:05 2025 -0800 make N_ranks a tensor commit a5857ae52892c332b0e784ce48ca066697d3b955 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 01:03:28 2025 -0800 make N_ranks a tensor commit 7066516876475379eb7908b31ef415200e7e9dfc Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:59:19 2025 -0800 make N_ranks a tensor commit fe80fa2a66631380f5acd4fc7ede7bfe0e59b222 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:58:36 2025 -0800 make N_ranks a tensor commit 4545cb9816719643d2ce2d4adbbecdd815eaff96 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:57:03 2025 -0800 make N_ranks a tensor commit 4e43dd681454422c5031a4b7321333749087ce4b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:55:15 2025 -0800 make N_ranks a tensor commit 285b3f78ae95cf7213d91c3aeee1c7d700d6a0c2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:49:38 2025 -0800 make N_ranks a tensor commit 9a5362b8dd19e6a9d46416d84a84104c4d31d843 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:43:33 2025 -0800 make N_ranks a tensor commit 884c15581a3919153cc814513120d82f75a26df2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:40:09 2025 -0800 make N_ranks a tensor commit 0dce92d6369eb284e8c977381f08dc52b54a4d90 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:35:37 2025 -0800 make N_ranks a tensor commit 28a691a674cf1f297f2d820e6a6066ee020bfb96 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:19:19 2025 -0800 print input_ids & positions shape commit d63f1ee023e70be1b050090566ad102da32f6927 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:16:37 2025 -0800 print input_ids & positions shape commit d0b2f37ceb681bb71891c153771b18fb07c0fd01 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:14:40 2025 -0800 print input_ids & positions shape commit b1a3984258dc604ac8db0b5706720dc268725b37 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:12:16 2025 -0800 print input_ids & positions shape commit 00755f96cc29b46199d88c74ad84252a61bef8de Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:09:45 2025 -0800 print input_ids & positions shape commit 7cdf141348ae1fcbe4ea1767cbea022b760ca17a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:08:18 2025 -0800 print input_ids & positions shape commit 4450f87818b9d25efe195a1c1dc7c2df616c7e62 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:06:11 2025 -0800 print input_ids & positions shape commit bb1b445ed35ce712acfed106d0edc9c7f8f44e2a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Mon Feb 10 00:04:04 2025 -0800 print input_ids & positions shape commit 6b844b0c7546a6df0788b5ed3b162e7554000c3a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 21:53:01 2025 -0800 print input_ids & positions shape commit ccf670f256f737b31dd0dea155fa1caa5de3697f Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 21:02:33 2025 -0800 print input_ids & positions shape commit 3caa92df3e35ff70434a207fdddca6a85c3b593f Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 20:52:51 2025 -0800 print input_ids & positions shape commit 0720ddd79ff7a4e38ea9da0c27138e6b435e075b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 19:52:51 2025 -0800 print input_ids & positions shape commit 6bde1718a4721d1cfd4b77cd0b5b102c0ed6ec0d Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 19:47:56 2025 -0800 print input_ids & positions shape commit 27f1de765e4dd33577f8e984178c4ca31ad84db6 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 19:40:58 2025 -0800 print input_ids & positions shape commit 931ed9b237f7ef99f748d9f9e270776072fc2c27 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 19:29:49 2025 -0800 print input_ids & positions shape commit e87f3dae4abc305937b5f2f3affae810f6ea8579 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 19:23:53 2025 -0800 print input_ids & positions shape commit 768db9c1ae141546bdf75d6f59002aa8a3a9625d Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 19:20:25 2025 -0800 print input_ids & positions shape commit 7f261809957e44a22ecc2d9baa2200b568c30017 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 19:13:34 2025 -0800 print input_ids & positions shape commit db5cb5ba530318940456bc174a2d4f4b32b3784e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:59:47 2025 -0800 print input_ids & positions shape commit 42728e55cce400e08154c5942b6ade805ee42b0b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:58:01 2025 -0800 print input_ids & positions shape commit 97eafb0b9d3d749ef5d996cc4d5f35e61c920d1b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:56:11 2025 -0800 print input_ids & positions shape commit 0b4e24822ab58395055984b32f69e39a43595441 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:53:28 2025 -0800 print input_ids & positions shape commit 1565baecd80694df8ee6abf55273c4150ea68c29 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:49:55 2025 -0800 print input_ids & positions shape commit c7d059a36c8d7df089fc9e1b5663301c677beb71 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:48:34 2025 -0800 print input_ids & positions shape commit 20d7f1b2baee258f49593a20ee43d513a3e48a73 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:43:16 2025 -0800 print input_ids & positions shape commit f4232b062cbcff518dc48de1bcad2052526b670a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:39:01 2025 -0800 print input_ids & positions shape commit 179d0306f9aa742e2df15a98b75232edcee622fc Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:37:11 2025 -0800 print input_ids & positions shape commit b00b2caa476e3318b5ecb5aebcc81b847a750c96 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:34:33 2025 -0800 print input_ids & positions shape commit 98572eca873d83c8cf0e383e924c2877bdace929 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 18:27:46 2025 -0800 print input_ids & positions shape commit 29dd3484ca24425e859ab158b40f337cedaa90cf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 16:35:39 2025 -0800 set hidden_states = 1 commit 231598d51305bbd737191592de8fb0fd72fc79f6 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 16:32:23 2025 -0800 set hidden_states = 1 commit b018c575cd9faffc87fee2ebf9c127c585e786dd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 16:25:42 2025 -0800 capture 512 only commit 56768cb7c176898a41a2e6234141556411db1a56 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 16:09:59 2025 -0800 print model_output commit e3e99bc357e15376c4ab3f6c79492b117d224a33 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 16:08:22 2025 -0800 print model_output commit 5c7cb22ce8f01b697cd0f31f36bb9791bb8dce38 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 16:04:18 2025 -0800 find bug commit 46e98cc6c92dc73572ef072bb6cb8343944748ac Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 15:51:30 2025 -0800 print input data commit 5723d5c3942142ce297b1f634d7638b5a0f303d7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 15:45:25 2025 -0800 try all-to-all commit 6a2638bd89310ce27778a3f1d917f25575bb6ec8 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 15:43:54 2025 -0800 try all-to-all commit 2be049f7afca248121e6e8a0a5b7d34cf475f0e7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 15:42:09 2025 -0800 try all-to-all commit b54dc0a797b84ad392910bc4ccfdc04362d5d2af Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sun Feb 9 15:38:25 2025 -0800 try all-to-all commit 46b03d5e7eebfed814554d9d8452773e2a398aca Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:31:16 2025 -0800 implement narrow commit 6281259c585a667e6056d3640157600c3f77f65a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:27:56 2025 -0800 implement narrow commit 5cff97eee20c15b823ec7b7dcabec184b53096ae Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:23:26 2025 -0800 implement narrow commit bab3ee8575f08cc1b2500983d4a1b29464ea3fa8 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:17:21 2025 -0800 implement narrow commit 8bc22fd1d4472b5f48366c36735cdb181fc4ecfb Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:15:01 2025 -0800 implement narrow commit 3a290ffdb24378e99bad8c38b757b2487ac9ece3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:12:16 2025 -0800 implement narrow commit a681f6b1dc866d3f6ece7c2bd9f62fc8427920bf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:08:11 2025 -0800 implement narrow commit 25b79e5471b2c37db5ebf24b2e96940675380e62 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 22:04:03 2025 -0800 implement narrow commit 61ed70cd43d957e151fccd803b9382a04696b862 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:59:43 2025 -0800 implement narrow commit 0546b834bbec1c33cc85c29609377deedafe1671 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:55:47 2025 -0800 implement narrow commit 6058b6395dd8ec32542b5579c655350954fc8753 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:53:27 2025 -0800 implement narrow commit 24eedbb525e450c51303a69f49d872048b7d15b8 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:50:03 2025 -0800 implement narrow commit d6492008e1d498b5d3b693e4fd472dad42705c62 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:47:29 2025 -0800 implement narrow commit 7e95a8aa666314ef3c9afe468b31afbbcaeaa525 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:44:51 2025 -0800 implement narrow commit 6b7f6bfd8e685bee1072649eeaae610c7d571bdd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:42:25 2025 -0800 implement narrow commit 67f37d0f015b45e521ff780e7c75667cbfa4f819 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:38:48 2025 -0800 implement narrow commit 7a2365e9240808281ebda96a76a3494ab2fa43c3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:36:04 2025 -0800 implement narrow commit e1241eaf3e3f0d854107db1cda89069aeae08834 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:32:37 2025 -0800 implement narrow commit b3c9b0e12d076591113bd20a7579a9f89c8a6d3e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:26:59 2025 -0800 implement narrow commit 252dc26356cf7c3d4c40f71291cca5eb26b89e83 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:19:34 2025 -0800 implement narrow commit 08c272e617439bec8b48b15818379b6cb61a9d42 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:08:51 2025 -0800 implement narrow commit 59d1efb32f7f2a5b0859a347d7741e73ef13686f Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 21:03:30 2025 -0800 implement narrow commit ca1465c76aac65fcbeb7cb07b78521eaaf55aba3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 20:59:30 2025 -0800 implement narrow commit 27d9da31cfbff1bec188303da76f5902ec637cc7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:57:04 2025 -0800 test all_gather commit 8dfbc78e9d5c942a044b03f96743440faf209f1a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:55:31 2025 -0800 test all_gather commit 554b9dcd81385624d93e570d1c3b220730b1ebbf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:49:56 2025 -0800 parallelize rotary_embed across SP commit 9302443d44a3eed01198f5ca4d93238adcd9fb3d Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:44:40 2025 -0800 parallelize rotary_embed across SP commit fb858d94c45ea2cf05b7e70aa0591d517b6938fd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:43:00 2025 -0800 parallelize rotary_embed across SP commit 8996e3c9380c61beefd5afd928b5abead09a8eab Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:38:31 2025 -0800 parallelize rotary_embed across SP commit bbe4a46a0763abeb3ccf796c4bc91dda777b1872 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:36:49 2025 -0800 Revert "test all_gather" This reverts commit eec988365f0402ef10d9e2f36c734712d81ab719. commit eec988365f0402ef10d9e2f36c734712d81ab719 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:35:41 2025 -0800 test all_gather commit 5988fcddedede8e13d0930ab7a37d21b25735c4d Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:30:31 2025 -0800 test all_gather commit e62b6b2282592f7ba19992f663d3fc5b00f40c80 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:27:16 2025 -0800 test all_gather commit adc49e14bd75f2bede0e5ba88dd3581065c245bf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:25:36 2025 -0800 test all_gather commit f6a46c03e513f57eade9e18e1cdb9c0a66ae56ab Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:23:53 2025 -0800 test all_gatherg commit 4fb7c7155faa5232a3ecbddba4f503dae9ad965b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:18:43 2025 -0800 now build up Ulysses from inside commit aa44f7cc5d7f8c18c39be69e6e0b400e4f1f775c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:17:08 2025 -0800 now build up Ulysses from inside commit 00eab4fd6291ab227afb44489df3692d0b0a6d24 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:15:25 2025 -0800 now build up Ulysses from inside commit ec6f8503ec114c5ac2e3a08fb9bf773097c4d9df Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:13:27 2025 -0800 now build up Ulysses from inside commit 5d8deb48af032b656c9dcfce6e99205b603673e4 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:11:44 2025 -0800 now build up Ulysses from inside commit 9acc54bc8b96d3d3e7ee0ef80ee6052b443b44fd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 03:01:18 2025 -0800 now build up Ulysses from inside commit 825bf734df7d52aed4d9035aa15c6754e7da4dd7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:58:50 2025 -0800 now build up Ulysses from inside commit 74338dd2361e79016e7bb4deedbecc0c96d34ea8 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:55:14 2025 -0800 now build up Ulysses from inside commit bf7268aa7b600df2066c78222fe1ba840ef35383 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:53:12 2025 -0800 now build up Ulysses from inside commit e18f4058b4a7b7bfc05a142659a3c13f9be2b58a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:50:44 2025 -0800 now build up Ulysses from inside commit 9227b2b243e9a0fb2ee9c9b7de09fe527460a417 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:48:03 2025 -0800 now build up Ulysses from inside commit 13ce70b931548608426fa0d21a0cc579325366bf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:44:46 2025 -0800 now build up Ulysses from inside commit 58a4202ed786bf3531b5eadf7524e2db1f7b55f6 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:39:54 2025 -0800 now build up Ulysses from inside commit fb917985ca7bfbe1056fbbbb57dae776f117a8ab Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:37:11 2025 -0800 now build up Ulysses from inside commit a17a77ecd47970bc7707da03c610cc3332291856 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:34:46 2025 -0800 now build up Ulysses from inside commit 986a52dd76e080756eb6dba0085513afea9321a3 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:31:28 2025 -0800 now build up Ulysses from inside commit 2ef2744188f2eb1faad5d2c63627d4ab5412e4bf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:28:52 2025 -0800 now build up Ulysses from inside commit 7614abb6b3430d523a347a9012ae7a7fb1021c06 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:24:49 2025 -0800 now build up Ulysses from inside commit 67d77ff9d2cfdf4a9a87a152bbb5ceb1dd38e435 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:19:04 2025 -0800 now build up Ulysses from inside commit 4ccb880a1be8f651a79c63844cc1762a58087d84 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:17:00 2025 -0800 now build up Ulysses from inside commit d9249dab62f014e8ffa88c6806c87a4624da6713 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:12:01 2025 -0800 now build up Ulysses from inside commit 715e202b8a1104e38e2745c90efa06b16e3965cc Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 02:09:30 2025 -0800 now build up Ulysses from inside commit f648a28bab4c073ecd1a7cf5bc80874e48e1c322 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:52:47 2025 -0800 now build up Ulysses from inside commit 0a11360f9b4a085c86d8797fbeea77e16ecbf705 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:48:04 2025 -0800 now build up Ulysses from inside commit d7f0f56af2024ae85ec37e86a5eaeb492585ed2f Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:43:20 2025 -0800 now build up Ulysses from inside commit 266f8c4256fea4db2cf3c8bedeb4a580d4b57d3b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:41:59 2025 -0800 now build up Ulysses from inside commit 59670d6efa4e5e2f8804ac4daebbb47ef6868255 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:36:03 2025 -0800 now build up Ulysses from inside commit 3b46a6026f02f8e41087b63fecdc0fec5285990a Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:20:32 2025 -0800 now build up Ulysses from inside commit 0251316c8dab934fb9f98761b6de81b6c54b4957 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:16:46 2025 -0800 now build up Ulysses from inside commit e18f77cb0a72ce6e8bf0900489788095a76acaab Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:09:28 2025 -0800 now build up Ulysses from inside commit c9dae3ed6821a47165d8591ee768aea155b730bf Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:07:27 2025 -0800 now build up Ulysses from inside commit 10a1c725494900aa258d1e57d33827be13718bfd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:05:40 2025 -0800 now build up Ulysses from inside commit 62bda3f266f09a9f7a2547b7bff73274f848ff11 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:03:49 2025 -0800 now build up Ulysses from inside commit 6151b63639e61dce2609a92f9b1fcdd90094d0d0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 01:01:32 2025 -0800 now build up Ulysses from inside commit f782bda4d8723f5ed89ae01f65e05cc3992e0cf8 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:59:54 2025 -0800 now build up Ulysses from inside commit f07d556f7a1ef9c1c54f6fc4208729b5f9f4b929 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:54:57 2025 -0800 now build up Ulysses from inside commit c5aaa1aeaabc44f4eefb9601404d63485e2613c7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:52:39 2025 -0800 now build up Ulysses from inside commit 406a79c04dc73a29531fdb20bec9e8ace63d1951 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:49:52 2025 -0800 now build up Ulysses from inside commit c79493ee73ea992a686c9b2306b91d13a77663d0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:46:15 2025 -0800 now build up Ulysses from inside commit 5fff2af89db184ec51ad2b3a3415201030012182 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:43:27 2025 -0800 now build up Ulysses from inside commit 639cdf400fdf90147c28da2a6877798561304e4e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:41:50 2025 -0800 now build up Ulysses from inside commit a858d1131e3c72b50622da3e83bfedb348746aaa Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:38:42 2025 -0800 now build up Ulysses from inside commit b8698535073d404a969f306ada71ac9ed09fd3dd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:33:47 2025 -0800 now build up Ulysses from inside commit 2ab7f8153b5dcf20050288133063ca26a1f1d51c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:30:05 2025 -0800 now build up Ulysses from inside commit 473d8320c21c465379b778b44d2c9f5bb210937c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:21:57 2025 -0800 now build up Ulysses from inside commit c67c780c8e35df871bde924b9b4c4875ac736a06 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:18:00 2025 -0800 now build up Ulysses from inside commit 373728de33f4fa2bfb5dfec8ba29182d15a342c0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:15:23 2025 -0800 now build up Ulysses from inside commit 9e4485f1a5dc601e42b16a130152e9594444c8e9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:08:25 2025 -0800 now build up Ulysses from inside commit 994e4cd4e916120f23bf5a6589af31a2a3e74d04 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:05:00 2025 -0800 now build up Ulysses from inside commit 94a631f32cb6c097d476d6cf35902af8c307be4b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Sat Feb 8 00:00:49 2025 -0800 now build up Ulysses from inside commit 853356085818d2d6c00447f254f6c024306a6829 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:59:55 2025 -0800 now build up Ulysses from inside commit 5eac3bd4621782e2567f4164fbc303c2560081a1 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:53:53 2025 -0800 now build up Ulysses from inside commit 0f9e631e6bcabf02cc98afc88cf8690caeed88b1 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:51:33 2025 -0800 now build up Ulysses from inside commit c2339b005258e0df439c6008ea44f9cd0a9580cc Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:48:44 2025 -0800 now build up Ulysses from inside commit 610a1c5baa6bcd741ce0e687e3ebcc3a9bd9f210 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:35:15 2025 -0800 now build up Ulysses from inside commit a6aa1b4fe3f2fc88acb42fe5629608d023b29da2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:32:50 2025 -0800 remove ulysses down to attention commit 642d1cb1422f586ae8f3399e700cff175b01521e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:25:17 2025 -0800 remove ulysses down to attention commit 551d279a3e458e8dbcf4fe8766e7a70d329e73d2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:24:25 2025 -0800 remove ulysses down to attention commit 254c48a976679830da4d32e7d88f83a09156f716 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:22:16 2025 -0800 remove ulysses down to attention commit 8af5d220803adf5c8b25c65dcba7f6b463d2ee34 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:19:24 2025 -0800 remove layers commit 9f83c57b9b9f1a8d4f9cd03d708c61c10976ac57 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:11:56 2025 -0800 remove conditionals for 0 tokens commit 95908f490bfafd82755bd222c13882ec56e42e48 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Feb 7 23:05:21 2025 -0800 start graph capture size from SP commit 98ad4e33c355ea7c3855f2211d4cf240380aa088 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Thu Jan 30 01:38:43 2025 -0800 set logits to None only for the V0 engine commit 47186b3ec41bf25f346311237472dc18a94994ca Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Thu Jan 30 01:31:17 2025 -0800 debug V0+Ulysses commit f7a216df8e7d6d5f54dd323402ab7d51bd701bc5 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Thu Jan 30 01:29:13 2025 -0800 debug V0+Ulysses commit f39164b0e962f8182cea2fbec846da76e3090ab7 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Thu Jan 30 01:22:25 2025 -0800 remove clutter commit 5f5320c45a7a579270d7b2ce9623da8ae5c4394e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Thu Jan 30 01:20:08 2025 -0800 remove clutter commit eda3fb6ad8ed5f725b21b50c37a4aee161337cc0 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Thu Jan 30 01:02:20 2025 -0800 debug Ulysses+V1 commit ee156d848a1e77de9b3ca11b8ec81799bd63897e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 23:30:18 2025 -0800 debug V1+Ulysses commit fe58cf2663db0a2aae2d325f6ef447bf8647aa82 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 23:23:58 2025 -0800 debug Ulysses+V1 commit ddb152fc90b6329297277303a2a11235a8cf2afd Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 23:20:09 2025 -0800 debug Ulysses+V1 commit ffb029db1fd5ecd83de9ab061107f64057356e3c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 23:15:04 2025 -0800 debug v1+Ulysses commit c1e1191eba2f86578b3302c507f646e89954b21e Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 23:12:52 2025 -0800 debug v1+Ulysses commit 47cc848b40c386cf20c89d50130e43c52d8283f5 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 23:11:53 2025 -0800 debug v1+Ulysses commit 90c3a30bc7e90c5ddb7b0e1654ea7fb53315c08c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 22:59:10 2025 -0800 debug V1+Ulysses commit 3c87b3226933f6dd5ef8eebc077e4ca97090e325 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 16:53:40 2025 -0800 debug V1+Ulysses commit efa4077b892bc77fde5cf03de7c2a1e120c6bcd2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 16:49:09 2025 -0800 debug V1 & Ulysses commit c76ebc8cd3c959b824fc3d2b73828000c401f482 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 16:46:26 2025 -0800 debug V1 & Ulysses commit bceb9197bbe51df7a8cf76eec63d2e81a4993245 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 16:42:08 2025 -0800 debug V1 & Ulysses commit 31c24e75e307887b1468d3800b402f9b62a8b8b5 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 16:33:17 2025 -0800 debug V1 & Ulysses commit 1f3a807dca64307075a605a0e442b8d09dabb2ce Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 16:28:24 2025 -0800 debug V1 & Ulysses commit 99926bcaffaf2f3b5ff340ed059d6115450f8966 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 16:23:00 2025 -0800 debug V1 & Ulysses commit 9557770f21d2f8ca9ad869c6bfefc950a8ff268b Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Wed Jan 29 00:00:14 2025 -0800 debug Ulysses within V1 engine commit dde9ab91fadcc207e75bc502a885010940c7444c Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Jan 28 18:25:30 2025 -0800 debug Ulysses implementation into V1 engine commit d2a8eb1ebdee3d5a5270553855ac6ca734e58fa2 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Jan 28 18:20:29 2025 -0800 implement Ulysses into V1 engine commit 724c36341ab8a9da25bab329e923144e17f9c032 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Jan 28 18:14:40 2025 -0800 fix Ulysses implementation commit df4f02ba8bbfa38635cf9c6d44e216dba0c5b755 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Jan 28 17:45:08 2025 -0800 debug V1 implementation of Ulysses commit 2ec1224b3518e50f1aa2de95f6b73f7b99003a93 Merge: 5204ff5c 7a86d08f Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Tue Jan 28 13:54:08 2025 -0800 Merge branch 'main_v0.6.6.post1_ulysses' into main_v0.7.0 commit 7a86d08f7ff7c84d939abe82619c4d1da3c99ad9 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Jan 17 21:44:03 2025 -0800 implement sequence parallelism into V1 commit 0b8d12f74903cd899209a9b984d513a2b5c41875 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Jan 17 21:41:56 2025 -0800 implement sequence parallelism into V1 commit 0d12bdaca0ac37c5b5af8e8f514c9fc83c0cb4b5 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Fri Jan 17 21:40:37 2025 -0800 implement sequence parallelism into V1 commit 3c6b7df6dfd8b80c9748c0e59741c6a4bcf88425 Author: Mert Hidayetoglu <mert.hidayetoglu@snowflake.com> Date: Thu Jan 9 17:58:59 2025 -0800 Ulysses clean (#1) * count Model Runner * compute logits * compute logits * compute logits * compute logits * compute logits * logits_processor.py * logits_processor.py * logits_processor.py * logits_processor.py * exit after get_logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit after get logits * exit before prune * exit before prune * exit before prune * exit before prune * exit after prune * exit after prune * exit after prune * exit after prune * exit after prune * exit after prune * exit after prune * print sampling indices * print sampling indices * print sampling indices * print sampling indices * index select * index select * index select * index select * index select * index select * index select * sampling index * fix allgather * fix allgather * fix allgather * fix allgather * print hidden_states * print ranks * exit before logits_processor * print before crash * print in order * print in order * print in order * print before logits_processor * print before logits_processor * print before logits_processor * print before logits_processor * print before compute_logits * print before compute_logits * print hidden states before compute_logits * print hidden states before compute_logits * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * print hidden_states_ in Llama Model * narrow hidden_states * narrow hidden_states * narrow hidden_states * narrow hidden_states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * print hidden states * remove norm * remove layer norm * find bug * find bug * find bug * find the bug * print in scientific mode * print hidden_states * debug * debug * Revert to 1402c2cefb9053754ce036eca9e57b38b8611604 * Revert to aec448d3d6507766fbebb26bf46b987b687434e8 * revert * debug * debug * debug * debug * debug * debug * debug * debug * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * exclude 0-size tensor from computation * investigate c * investigate c * investigate c * inspect logits processor * inspect logits processor * remove exit() * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * shuffle, reshuffle * find inconsistency * find kv_cache difference * find kv_cache difference * print function call stack * print function call stack * understand kv_cache inconsistency * modify config.py to incorporate SP * fuse all-to-all communications of qkv * check pipeline parallelism * remove exits * remove exit * handle (TP=2, SP=4) * fix prepare input * track down PP hang * track down PP hang * exit after LogitsProcessor * exit before attention * exit before attention * propagate over all layers to fix PP hang * propagate ov…

init(deepseek): enable DeepSeek V3/R1 initial support for XPU

…oads (#1…" This reverts commit 51826d5.

Much changes wow

make async tokenization method the same as the sync versions

…nner (#1…" This reverts commit bb0a311.

…nner (#1…" This reverts commit bb0a311. Signed-off-by: Chen Zhang <zhangch99@outlook.com>

Fix OPT errors

44735b4

WoosukKwon merged commit cbf8779 into main Feb 25, 2023

WoosukKwon deleted the fix-opt branch February 25, 2023 00:29

murongweibo mentioned this pull request Jul 11, 2023

NCCL Error 5: invalid usage #427

Closed

TheBloke mentioned this pull request Jul 20, 2023

Can't launch OpenAI API server on newly installed vLLM in Docker - fastchat not found #537

Closed

CZT0 referenced this pull request in semedia-tech/vllm Sep 11, 2023

#1 测试部署vllm

cc4f1ce

orangetin referenced this pull request in togethercomputer/vllm-ttgi Sep 14, 2023

Merge pull request #1 from winglian/longchat-args

b9012fb

add rope scaling as a cli arg so openai server can load rope scaled models

xiangyuT pushed a commit to xiangyuT/vllm that referenced this pull request Oct 18, 2023

Add function invoke call for underlying models (vllm-project#1)

9895bbd

bigPYJ1151 added a commit to bigPYJ1151/vllm that referenced this pull request Oct 30, 2023

Merge pull request vllm-project#1 from bigPYJ1151/fix_ans

b5e7066

Fix key cache block shape.

l1cacheDell pushed a commit to CaspianFang/vllm that referenced this pull request Nov 15, 2023

blora LlaMa support vllm-project#1

424df61

shanshanpt mentioned this pull request Nov 17, 2023

Run long conetxt error : CUDA error: an illegal memory access was encountered #1700

Closed

junior-zsy mentioned this pull request Nov 20, 2023

Error with 32k Long Text in chatglm2-6b-32k Model #1725

Closed

hongxiayang referenced this pull request in hongxiayang/vllm Feb 13, 2024

Fix a bug in tying OPT embeddings (#1)

2cb721d

kvikk mentioned this pull request Feb 15, 2024

ERROR: Could not build wheels for vllm, which is required to install pyproject.toml-based projects #2735

Closed

ilya-lavrenov referenced this pull request in ilya-lavrenov/vllm Feb 19, 2024

Merge pull request #1 from ilya-lavrenov/cpu-works

e3d65e0

Deterministic OpenVINO inference

daniel-geon-park added a commit to gmlwns2000/vllm-timber that referenced this pull request Apr 15, 2024

Merge pull request vllm-project#1 from DeepAuto-AI/geon-dev

d9d746e

merge code

afeldman-nm mentioned this pull request Apr 30, 2024

Adding support for encoder-decoder models, like T5 or BART #187

Closed

dlopes78 mentioned this pull request May 8, 2024

[Bug]: VLLM + tritonserver #4695

Closed

fmmoret mentioned this pull request May 8, 2024

[Bug]: Chunked prefill returning gibberish in some cases. #4697

Closed

Bellk17 added a commit to Bellk17/vllm that referenced this pull request May 10, 2024

Merge pull request vllm-project#1 from Bellk17/main

b36d574

Triton compilation fix

yuhuixu1993 mentioned this pull request Jun 2, 2024

[Bug]: loading squeezellm model #5190

Closed

afeldman-nm mentioned this pull request Jun 3, 2024

[Bug]: VLLM_ATTENTION_BACKEND set to ROCM_FLASH only in GHA environment, overriding automatic backend selection; this breaks other kernel unit tests. #5208

Closed

ykim362 referenced this pull request in ykim362/vllm Jun 17, 2024

Wenxh/fp8 on a100 v5 (#1)

aca4a33

Group Gemm Version

xiejibing mentioned this pull request Jun 24, 2024

[Bug]: vLLM 0.4.2 8xH100 init failed #5785

Closed

llmpros mentioned this pull request Jun 27, 2024

[Frontend]: Support base64 embedding #5935

Merged

Juelianqvq mentioned this pull request Jul 3, 2024

[Bug]: Flashinfer stuck with CUDA Graph #6086

Closed

oliver-li mentioned this pull request Jul 5, 2024

[Bug]: NCCL hangs and causes timeout #5484

Closed

This was referenced Jul 5, 2024

Support W4A8 quantization for vllm #5218

Merged

[Bug]: call for stack trace for "Watchdog caught collective operation timeout" #6042

Closed

ccolas mentioned this pull request Jan 24, 2025

[Bug]: AssertionError when using automatic prefix caching and prompt_logprobs #8268

Closed

1 task

liangfu pushed a commit to liangfu/vllm that referenced this pull request Feb 13, 2025

Merge pull request vllm-project#1 from gnovack/aoyu/neuron-v1

a330e7f

rebase to vllm main branch with nki_flash_attn

maxdebayser referenced this pull request in maxdebayser/vllm Feb 13, 2025

Merge pull request #1 from IBM/main

421fb72

bug fix: variable number of max decode tokens within batch (vllm-project#73)

yeqiugt mentioned this pull request Feb 16, 2025

[Bug]: Use 3 node with 8*H100 to serve Deepseek R1 model, error is pthread_create failed: Resource temporarily unavailable #13354

Closed

1 task

HelenaSak mentioned this pull request Feb 19, 2025

[Bug]: watchdog thread terminated with exception: CUDA error: an illegal memory access was encountered #8177

Open

1 task

AntonBalagaev mentioned this pull request Feb 25, 2025

[Doc]: guided grammar example lack parameter guided_decoding_backend #13847

Open

b8zhong added a commit to b8zhong/vllm that referenced this pull request Feb 28, 2025

remove args in benchmarks (vllm-project#1)

50644b1

Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>

russellb mentioned this pull request Mar 3, 2025

[V1][Core] Support for Structured Outputs #12388

Merged

dbyoung18 pushed a commit to dbyoung18/vllm that referenced this pull request Mar 13, 2025

Merge pull request vllm-project#1 from rogerxfeng8/dbyoung/deepseek

0b80c57

init(deepseek): enable DeepSeek V3/R1 initial support for XPU

ctdavi mentioned this pull request Mar 25, 2025

[Doc]: Steps to run vLLM on your RTX5080 or 5090! #14452

Open

1 task

Hellisotherpeople mentioned this pull request Apr 1, 2025

[Feature]: Support "required" option in tool_choice #13002

Closed

1 task

robertgshaw2-redhat added a commit that referenced this pull request Apr 2, 2025

Revert "Add minimum version for huggingface_hub to enable Xet downl…

ba72da2

…oads (#1…" This reverts commit 51826d5.

ahadnagy pushed a commit to ahadnagy/vllm that referenced this pull request Apr 7, 2025

Merge pull request vllm-project#1 from remi-or/last-changes

3ba05cd

Much changes wow

alokkrsahu mentioned this pull request Apr 9, 2025

[Bug]: meta-llama/Llama-4-Scout-17B-16E-Instruct compatibility #16330

Closed

1 task

jifa513 mentioned this pull request Apr 10, 2025

[Bug]: Error: Failed to initialize the TMA descriptor 700 #13961

Open

1 task

qiuhaining mentioned this pull request Apr 10, 2025

[Bug]: corrupted double-linked list (not small) Aborted #16412

Open

1 task

southfreebird mentioned this pull request Apr 11, 2025

[Bug]: Medusa speculation hangs when tp > 1 #16477

Open

1 task

QuanhuiGuan mentioned this pull request Apr 14, 2025

[Bug]: CUDA error: an illegal memory access was encountered #16398

Open

1 task

maxdebayser referenced this pull request in maxdebayser/vllm Apr 14, 2025

Merge pull request #1 from maxdebayser/truncation-control

4be4e0d

make async tokenization method the same as the sync versions

MiterV1 mentioned this pull request Apr 17, 2025

[Bug]: metrics: get metrics num_gpu_blocks's value is none. #16560

Closed

1 task

yyu6969 pushed a commit to yyu6969/vllm that referenced this pull request Apr 22, 2025

vllm-project#1

847a3a2

ekmekovski mentioned this pull request Apr 29, 2025

[Bug]: Cannot use GPTQ quantized model with newer version #17367

Closed

1 task

sgsdxzy mentioned this pull request May 4, 2025

[Bug]: Unable to run Qwen3 on Turing GPUs after upgrading to torch 2.7.0 #17639

Open

1 task

hao-cold mentioned this pull request May 13, 2025

[Bug]: CUDA error: an illegal instruction was encountered #18045

Open

1 task

Spycsh mentioned this pull request May 14, 2025

[Feature]: Elastic KV memory management based on usage #18125

Open

1 task

markmc mentioned this pull request May 21, 2025

[Bug][Failing Test]: Distributed Comm Ops - distributed/test_shm_broadcast.py #18492

Closed

1 task

heheda12345 added a commit that referenced this pull request May 23, 2025

Revert "Revert "[v1] Support multiple KV cache groups in GPU model ru…

f3f04d5

…nner (#1…" This reverts commit bb0a311.

heheda12345 added a commit that referenced this pull request May 23, 2025

Revert "Revert "[v1] Support multiple KV cache groups in GPU model ru…

7d0dc8d

…nner (#1…" This reverts commit bb0a311. Signed-off-by: Chen Zhang <zhangch99@outlook.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Fix a bug in tying OPT embeddings #1

Fix a bug in tying OPT embeddings #1

Uh oh!

WoosukKwon commented Feb 25, 2023

Uh oh!

Uh oh!

Uh oh!

Fix a bug in tying OPT embeddings #1

Fix a bug in tying OPT embeddings #1

Uh oh!

Conversation

WoosukKwon commented Feb 25, 2023

Uh oh!

Uh oh!