first commit

diStyApps · Aug 1, 2023 · be90bcc · be90bcc
commit be90bcc
Show file tree

Hide file tree

Showing 110 changed files with 13,014 additions and 0 deletions.
diff --git a/0_Install_VisionCrafter.bat b/0_Install_VisionCrafter.bat
@@ -0,0 +1,36 @@
+@echo off
+
+REM 1. Create a venv folder
+echo Creating virtual environment inside venv folder...
+python -m venv venv
+
+REM 2. Activate the venv
+echo Activating venv...
+call venv\Scripts\activate.bat
+
+REM 3. Install dependencies from requirements.txt
+echo Installing dependencies from requirements.txt
+pip install -r requirements.txt
+
+REM 4. Download stable-diffusion-v1-5
+echo Downloading stable-diffusion-v1-5
+git clone --branch fp16 https://huggingface.co/runwayml/stable-diffusion-v1-5 repos\animatediff\models\StableDiffusion\stable-diffusion-v1-5
+
+REM 5. Download Motion Modules
+echo Downloading Motion Modules
+git clone https://huggingface.co/guoyww/animatediff repos\animatediff\models\Motion_Module
+
+REM 6. Download toonyou model
+set /p downloadModel=Do you want to download toonyou model? (y/n):
+if "%downloadModel%"=="y" (
+    echo Downloading toonyou model
+    curl -k -L https://civitai.com/api/download/models/78775 -o models\checkpoints\toonyou_beta3.safetensors
+) else (
+    echo Skipping toonyou model download
+)
+
+REM 7. Run VisionCrafter
+echo Launching VisionCrafter
+python main.py
+
+pause
diff --git a/1_Run_VisionCrafter.bat b/1_Run_VisionCrafter.bat
@@ -0,0 +1,12 @@
+@echo off
+
+REM Activate the existing venv
+call venv\Scripts\activate.bat
+
+REM Run VisionCrafter
+python main.py
+
+REM Deactivate the venv
+call venv\Scripts\deactivate.bat
+
+pause
diff --git a/README.md b/README.md
@@ -0,0 +1,220 @@
+<!-- Improved compatibility of back to top link: See: https://github.com/othneildrew/Best-README-Template/pull/73 -->
+<a name="readme-top"></a>
+<!--
+*** Thanks for checking out the Best-README-Template. If you have a suggestion
+*** that would make this better, please fork the repo and create a pull request
+*** or simply open an issue with the tag "enhancement".
+*** Don't forget to give the project a star!
+*** Thanks again! Now go create something AMAZING! :D
+-->
+<!--
+*** I'm using markdown "reference style" links for readability.
+*** Reference links are enclosed in brackets [ ] instead of parentheses ( ).
+*** See the bottom of this document for the declaration of the reference variables
+*** for contributors-url, forks-url, etc. This is an optional, concise syntax you may use.
+*** https://www.markdownguide.org/basic-syntax/#reference-style-links
+-->
+<br />
+<div align="center">
+
+[![](media/svg/patreon.svg)](https://www.patreon.com/distyx)
+
+<!-- <img src="media/covers/cover.jpg"> -->
+
+  <h1 align="center">VisionCrafter</h1>
+  <h4 align="center"><em>Craft your visions</em></h4>
+  <h4 align="center">Don't forget to leave a star.</h4>
+
+
+  <p align="center">
+    <a href="https://github.com/diStyApps/VisionCrafter/issues">Report Bug</a>
+  </p>
+</div>
+
+
+
+<!-- TABLE OF CONTENTS -->
+<details>
+  <summary>Table of Contents</summary>
+  <ol>
+    <li>
+      <a href="#about-the-project">About The Project</a>
+    </li>
+    <li><a href="#requirements">Requirements</a></li>
+    <li><a href="#contact">Contact</a></li>
+    <li><a href="#my-other-projects">My Other Projects</a></li>    
+    <li><a href="#acknowledgments">Acknowledgments</a></li>
+
+
+  </ol>
+</details>
+
+<!-- ABOUT THE PROJECT -->
+## About The Project
+
+VisionCrafter tool with GUI for AnimateDiff and other projects, that generates animations and music from text.
+
+Ideal for producing short videos and GIFs, as well as creating brief cinematic scenes.
+
+<img src="media/preview/0.0.2/1.gif">
+<img src="media/preview/0.0.2/1.png">
+
+
+<p align="right">(<a href="#readme-top">back to top</a>)</p>
+
+<!-- Requirements -->
+## Requirements
+ - Windows 10+ and Nvidia GPU-based cards 
+  - - 12VRAM+ Recommend: 3090/4090
+ - VLC 64bit https://get.videolan.org/vlc/3.0.18/win64/vlc-3.0.18-win64.exe
+<p align="right">(<a href="#readme-top">back to top</a>)</p>
+
+
+
+<!-- Requirements -->
+## Download And Install
+ - [Download](https://github.com/diStyApps/VisionCrafter/archive/refs/heads/main.zip)
+
+ Or git clone
+
+ ```
+git clone https://github.com/diStyApps/VisionCrafter
+```
+ - To install: 0_Install_VisionCrafter.bat
+ - To run: 1_Run_VisionCrafter.bat 
+
+<p align="right">(<a href="#readme-top">back to top</a>)</p>
+
+
+
+## Gallery
+<table class="center">
+    <tr>
+    <td><img src="media/gallery/anim/anim (1).gif"></td>
+    <td><img src="media/gallery/anim/anim (2).gif"></td>
+    <td><img src="media/gallery/anim/anim (3).gif"></td>
+    <td><img src="media/gallery/anim/anim (4).gif"></td>
+    </tr>
+</table>
+<table class="center">
+    <tr>
+    <td><img src="media/gallery/anim/anim (5).gif"></td>
+    <td><img src="media/gallery/anim/anim (6).gif"></td>
+    <td><img src="media/gallery/anim/anim (7).gif"></td>
+    <td><img src="media/gallery/anim/anim (8).gif"></td>
+    </tr>
+</table>
+<table class="center">
+    <tr>
+    <td><img src="media/gallery/anim/anim (9).gif"></td>
+    <td><img src="media/gallery/anim/anim (10).gif"></td>
+    <td><img src="media/gallery/anim/anim (11).gif"></td>
+    <td><img src="media/gallery/anim/anim (12).gif"></td>
+    </tr>
+</table>
+<table class="center">
+    <tr>
+    <td><img src="media/gallery/anim/anim (13).gif"></td>
+    <td><img src="media/gallery/anim/anim (14).gif"></td>
+    <td><img src="media/gallery/anim/anim (15).gif"></td>
+    <td><img src="media/gallery/anim/anim (16).gif"></td>
+    </tr>
+</table>
+<table class="center">
+    <tr>
+    <td><img src="media/gallery/anim/anim (17).gif"></td>
+    <td><img src="media/gallery/anim/anim (18).gif"></td>
+    <td><img src="media/gallery/anim/anim (19).gif"></td>
+    <td><img src="media/gallery/anim/anim (20).gif"></td>
+    </tr>
+</table>
+<table class="center">
+    <tr>
+    <td><img src="media/gallery/anim/anim (21).gif"></td>
+    <td><img src="media/gallery/anim/anim (22).gif"></td>
+    <td><img src="media/gallery/anim/anim (23).gif"></td>
+    <td><img src="media/gallery/anim/anim (24).gif"></td>
+    </tr>
+</table>
+<table class="center">
+    <tr>
+    <td><img src="media/gallery/anim/anim (25).gif"></td>
+    <td><img src="media/gallery/anim/anim (26).gif"></td>
+    <td><img src="media/gallery/anim/anim (27).gif"></td>
+    <td><img src="media/gallery/anim/anim (28).gif"></td>
+    </tr>
+</table>
+
+<!-- <p style="margin-left: 2em; margin-top: -1em">Model：<a href="https://civitai.com/models/30240/toonyou">ToonYou</a></p> -->
+
+
+
+<!-- CONTACT -->
+## Contact
+
+distty@gmail.com
+
+
+<p align="right">(<a href="#readme-top">back to top</a>)</p>
+
+<!-- MY OTHER PROJECTS -->
+## My Other Projects
+
+[SEAIT](https://github.com/diStyApps/seait)
+
+[FaceSwapSuite](https://github.com/diStyApps/FaceSwapSuite)
+
+[VisualClipPicker](https://github.com/diStyApps/VisualClipPicker)
+
+[Stable-Diffusion-Pickle-Scanner-GUI](https://github.com/diStyApps/Stable-Diffusion-Pickle-Scanner-GUI)
+
+[Safe-and-Stable-Ckpt2Safetensors-Conversion-Tool-GUI](https://github.com/diStyApps/Safe-and-Stable-Ckpt2Safetensors-Conversion-Tool-GUI)
+
+
+<p align="right">(<a href="#readme-top">back to top</a>)</p>
+
+<!-- ACKNOWLEDGMENTS -->
+## Acknowledgments
+
+
+* [AnimateDiff](https://github.com/guoyww/AnimateDiff)
+* [audiocraft](https://github.com/facebookresearch/audiocraft)
+* [Tune-A-Video](https://github.com/showlab/Tune-A-Video)
+
+<p align="right">(<a href="#readme-top">back to top</a>)</p>
+
+
+<!-- MARKDOWN LINKS & IMAGES -->
+<!-- https://www.markdownguide.org/basic-syntax/#reference-style-links -->
+[contributors-shield]: https://img.shields.io/github/contributors/othneildrew/Best-README-Template.svg?style=for-the-badge
+[contributors-url]: https://github.com/othneildrew/Best-README-Template/graphs/contributors
+[forks-shield]: https://img.shields.io/github/forks/othneildrew/Best-README-Template.svg?style=for-the-badge
+[forks-url]: https://github.com/othneildrew/Best-README-Template/network/members
+[stars-shield]: https://img.shields.io/github/stars/othneildrew/Best-README-Template.svg?style=for-the-badge
+[stars-url]: https://github.com/othneildrew/Best-README-Template/stargazers
+[issues-shield]: https://img.shields.io/github/issues/othneildrew/Best-README-Template.svg?style=for-the-badge
+[issues-url]: https://github.com/othneildrew/Best-README-Template/issues
+[license-shield]: https://img.shields.io/github/license/othneildrew/Best-README-Template.svg?style=for-the-badge
+[license-url]: https://github.com/othneildrew/Best-README-Template/blob/master/LICENSE.txt
+[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555
+[linkedin-url]: https://linkedin.com/in/othneildrew
+[product-screenshot]: images/screenshot.png
+[Next.js]: https://img.shields.io/badge/next.js-000000?style=for-the-badge&logo=nextdotjs&logoColor=white
+[Next-url]: https://nextjs.org/
+[React.js]: https://img.shields.io/badge/React-20232A?style=for-the-badge&logo=react&logoColor=61DAFB
+[React-url]: https://reactjs.org/
+[Vue.js]: https://img.shields.io/badge/Vue.js-35495E?style=for-the-badge&logo=vuedotjs&logoColor=4FC08D
+[Vue-url]: https://vuejs.org/
+[Angular.io]: https://img.shields.io/badge/Angular-DD0031?style=for-the-badge&logo=angular&logoColor=white
+[Angular-url]: https://angular.io/
+[Svelte.dev]: https://img.shields.io/badge/Svelte-4A4A55?style=for-the-badge&logo=svelte&logoColor=FF3E00
+[Svelte-url]: https://svelte.dev/
+[Laravel.com]: https://img.shields.io/badge/Laravel-FF2D20?style=for-the-badge&logo=laravel&logoColor=white
+[Laravel-url]: https://laravel.com
+[Bootstrap.com]: https://img.shields.io/badge/Bootstrap-563D7C?style=for-the-badge&logo=bootstrap&logoColor=white
+[Bootstrap-url]: https://getbootstrap.com
+[JQuery.com]: https://img.shields.io/badge/jQuery-0769AD?style=for-the-badge&logo=jquery&logoColor=white
+[JQuery-url]: https://jquery.com 
+
+
+
diff --git a/audiocraft/data/__init__.py b/audiocraft/data/__init__.py
@@ -0,0 +1,8 @@
+# Copyright (c) Meta Platforms, Inc. and affiliates.
+# All rights reserved.
+#
+# This source code is licensed under the license found in the
+# LICENSE file in the root directory of this source tree.
+
+# flake8: noqa
+from . import audio, audio_dataset