8Gb Vram optimized, Win11 support + Web UI + optimized transformer +40% more frames on 8Gb

README.md

@@ -1,4 +1,110 @@
-# LTX-2
+# LTX-2 Optimized (8GB of VRAM Edition) + Web UI
+
+This repository contains a **modified and optimized version of the LTX-2 Video Generation Model**, designed specifically to run on consumer hardware with as little as **8GB of VRAM**. 
+
+It includes a fully-featured **Gradio Web Interface** to make generating videos, managing presets, and applying LoRAs easy without needing to remember complex command-line arguments.
+## Web UI v2
+<img width="2260" height="1078" alt="image" src="https://github.com/user-attachments/assets/5a9f5dce-f313-44a3-bbbe-10eccc002191" />
+
+## Web UI v4
+<img width="949" height="575" alt="scr221" src="https://github.com/user-attachments/assets/2e3a6c51-51b8-4487-b64d-a7d2c41d794a" />
+
+## CinemaMaker UI
+<img width="612" height="343" alt="cm" src="https://github.com/user-attachments/assets/0f5f2dca-bacd-4f5f-a627-505ad3751277" />
+
+* https://youtu.be/eGOq0hUiri4
+* https://youtu.be/HAQqzPdDIj0
+
+
+
+## 🚀 Features
+
+*   **8GB VRAM Optimization:** Runs locally on cards like the RTX 3070/4060Ti using FP8 quantization and memory management tweaks.
+*   **Windows 11 support!!!** You can even run it on Windows (not supported in the original model).
+*   **User-Friendly Web UI:** Control everything from your browser.
+*   **Smart "Safe Mode":** The UI automatically limits the frame count based on selected resolution to prevent Out-Of-Memory (OOM) errors. (If you do not have 8GB of free VRAM, try decreasing the frame count.)
+*   **Real-time Logging:** View the generation progress and console output directly in the web interface.
+*   **Advanced Features:**
+    *   **Image Conditioning:** Upload reference images.
+    *   **LoRA Support:** Checkbox selection for Camera Control.
+    *   **Seed Control:** Reproducible generations.
+
+## 📥 Model Download & Setup
+
+To run this, you need to download the specific FP8 distilled checkpoints and the Text Encoder.
+
+**1. Create a `models` directory in the root folder:**
+```bash
+mkdir models
+mkdir models/loras
+```
+
+**2. Download the models:**
+* [`ltx-2-19b-distilled-fp8.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-19b-distilled-fp8.safetensors) - [Download](https://huggingface.co/Lightricks/LTX-2/resolve/main/ltx-2-19b-distilled-fp8.safetensors)
+* [`ltx-2-spatial-upscaler-x2-1.0.safetensors`](https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-spatial-upscaler-x2-1.0.safetensors) - [Download](https://huggingface.co/Lightricks/LTX-2/resolve/main/ltx-2-spatial-upscaler-x2-1.0.safetensors)
+* [`Gemma 3`](https://huggingface.co/google/gemma-3-12b-it-qat-q4_0-unquantized/tree/main)
+```
+./models/
+    ltx-2-19b-distilled-fp8.safetensors	
+    ltx-2-spatial-upscaler-x2-1.0.safetensors
+
+./models/gemma3/
+    gemma-3 files
+
+./models/loras/
+    LoRA files here
+```
+**3. Install all required modules:**
+```
+required modules
+pip install -e packages/ltx-pipelines
+pip install -e packages/ltx-core
+
+Python 3.12.8
+accelerate==1.10.1
+torch==2.8.0+cu128
+torchaudio==2.8.0+cu128
+torchvision==0.23.0+cu128
+xformers==0.0.32.post2
+...
+```
+**🖥️ Usage**
+Run the web interface with a single command:
+```Bash
+python web_ui_v2.py
+
+or
+
+python web_ui_v4.py
+```
+
+**📊 Performance & Presets (8GB of VRAM)**
+* The Web UI includes an "8GB VRAM Safe Mode" checkbox. When enabled, it enforces the following limits to ensure you don't crash your GPU. Est. inference time on RTX 3070 Ti laptop GPU ~300sec for all presets.
+```
+| Resolution  | Max Frames i2v| t2v  | Est. Time (3070ti laptop 8gb vram) |
+| :---------- | :------------ |:---- |:---------------------------------- |
+| 1280 x 704  | 177           | 257  | ~300..400 sec                      |
+| 1536 x 1024 | 121           | 185  | ~300..400 sec                      |
+| 1920 x 1088 | 81            | 121  | ~300..400 sec                      |
+| 2560 x 1408 | 49            | 65   | ~300..400 sec                      |
+| 3840 x 2176 | 17            | 25   | ~300..400 sec                      |
+* +60 sec for prompt (if not empty/not cached)
+* time to stage 1 preview 80..150 sec
+```
+* UPD: optimized transformer code, increased max frames by 40% for text to video, generation speed 300..315 -> 385..415 sec, (1280x704 11sec 24fps, 1920x1088 5sec 24fps)
+* UPD2: added web ui v4, stage 1 video preview, task queue, prompt constructor, disable audio option (faster inference 10-30%)
+
+
+**Credits**
+* Original Model: Lightricks (LTX-2)
+* Optimization: nalexand
+* Web UI: Created for the community to make this powerful model accessible.
+
+Original Model: 
+* (you can find links to all model files and loras below)
+
+
+## LTX-2
 
 [![Website](https://img.shields.io/badge/Website-LTX-181717?logo=google-chrome)](https://ltx.io)
 [![Model](https://img.shields.io/badge/HuggingFace-Model-orange?logo=huggingface)](https://huggingface.co/Lightricks/LTX-2)