Scope is a tool for running and customizing real-time, interactive generative AI pipelines and models.
🚧 Here be dragons! This project is currently in alpha. 🚧
- Autoregressive video diffusion models
- WebRTC real-time streaming
- Low latency async video processing pipelines
- Interactive UI with timeline editor, text prompting, model parameter controls and video/camera/text input modes
...and more to come!
Scope currently supports the following operating systems:
- Linux
- Windows
Scope currently requires a Nvidia GPU with >= 24GB VRAM. We recommend a driver that supports CUDA >= 12.8 and a RTX 3090/4090/5090 (newer generations will support higher FPS throughput and lower latency). If you do not have access to a GPU with these specs then we recommend installing on Runpod.
Install uv which is needed to run the server and Node.js which is needed to build the frontend.
git clone git@github.com:daydreamlive/scope.git
cd scope
This will build the frontend files which will be served by the Scope server.
uv run build
Important
If you are running the server in a cloud environment, make sure to read the Firewalls section.
This will start the server.
uv run daydream-scope
After the server starts up, the frontend will be available at http://localhost:8000.
The frontend will present a dialog for downloading model weights for pipelines before running them (by pressing play with the pipeline selected) for the first time. The default directory where model weights are stored is ~/.daydream-scope/models.
Use our RunPod template to quickly set up Scope in the cloud. This is the easiest way to get started if you don't have a compatible local GPU.
Important
Follow the instructions in Firewalls to get a HuggingFace access token.
Deployment Steps:
-
Click the Runpod template link: Template
-
Select your GPU: Choose a GPU that meets the system requirements.
-
Configure environment variables:
- Click "Edit Template"
- Add an environment variable:
- Set name to
HF_TOKEN - Set value to your HuggingFace access token
- Set name to
- Click "Set Overrides"
-
Deploy: Click "Deploy On-Demand"
-
Access the app: Wait for deployment to complete, then open the app at port 8000
The template will configure everything needed and the frontend will present a dialog for downloading model weights for pipelines when running them (by pressing play with the pipeline selected) for the first time.
The easiest way to get started is to replay an example generation and then modify prompts in the timeline to steer the generation in a different direction.
Examples with importable timeline files can be found here:
If you run Scope in a cloud environment with restrictive firewall settings (eg. Runpod), Scope supports using TURN servers to establish a connection between your browser and the streaming server.
The easiest way to enable this feature is to create a HuggingFace account and a read access token. You can then set an environment variable before starting Scope:
# You should set this to your HuggingFace access token
export HF_TOKEN=your_token_hereWhen you start Scope, it will automatically use Cloudflare's TURN servers and you'll have 10GB of free streaming per month:
uv run daydream-scope
Read the contribution guide.
The alpha version of this project is licensed under CC BY-NC-SA 4.0.
You may use, modify, and share the code for non-commercial purposes only, provided that proper attribution is given.
We will consider re-licensing future versions under a more permissive license if/when non-commercial dependencies are refactored or replaced.
