feat: remove dead code (metavoiceio#23)

* remove: dead ode * update: README.md --------- Co-authored-by: sid <sid@themetavoice.xyz>
Pkpk11 · Feb 8, 2024 · a52ac77 · a52ac77
1 parent 11428f9
commit a52ac77
Show file tree

Hide file tree

Showing 3 changed files with 4 additions and 70 deletions.
diff --git a/README.md b/README.md
@@ -9,7 +9,7 @@ MetaVoice-1B is a 1.2B parameter base model trained on 100K hours of speech for
 
 We’re releasing MetaVoice-1B under the Apache 2.0 license, *it can be used without restrictions*.
 
-Try out [demo](https://ttsdemo.themetavoice.xyz/)!
+Try out the [demo](https://ttsdemo.themetavoice.xyz/)!
 
 ## Installation
 ```bash
@@ -36,7 +36,7 @@ python fam/llm/sample.py --huggingface_repo_id="metavoiceio/metavoice-1B-v0.1" -
 python fam/llm/serving.py --huggingface_repo_id="metavoiceio/metavoice-1B-v0.1"
 ```
 
-3. Use it on HuggingFace
+3. Use it via [HuggingFace](https://huggingface.co/metavoiceio)
 
 ## Soon
 - Long form TTS

diff --git a/fam/llm/mixins/gpt2loading.py b/fam/llm/mixins/gpt2loading.py
diff --git a/fam/llm/model.py b/fam/llm/model.py
@@ -10,11 +10,7 @@
 from torch.nn import functional as F
 
 from fam.llm.layers import Block, LayerNorm, RMSNorm
-from fam.llm.mixins import (
-    CausalInferenceMixin,
-    GPT2LoadingMixin,
-    NonCausalInferenceMixin,
-)
+from fam.llm.mixins import CausalInferenceMixin, NonCausalInferenceMixin
 
 END_OF_TEXT_TOKEN = 1537
 
@@ -80,7 +76,7 @@ def _check_speaker_emb_dims(
     return speaker_embs
 
 
-class GPT(nn.Module, NonCausalInferenceMixin, CausalInferenceMixin, GPT2LoadingMixin):
+class GPT(nn.Module, NonCausalInferenceMixin, CausalInferenceMixin):
     def __init__(self, config: GPTConfig, speaker_emb_dim: Optional[int] = None):
         """
         Initialize the GPT model.