(Meta) Project status, life update, next steps

[Tremeschin]

Hi all, here's some projects and life updates:

• My main focus will be working on Pyaket from now on, as there's much more applicability for the community and financial interests at play; but I'll still support depthflow, rework its website, and provide one click to run executables for supporters - in an effort to make it sustainable.

• I'm moving cities within a month, holidays are near, so I'm currently on a soft break (technical, personal, emotional) until things settle down. Might need to look for a job and start life next year, in which case unpaid open source will not be a priority, as I only have 5 hours of focused mental energy per day. Really hoping to make it sustainable or getting half recognition for the work before then, this is what I love doing!

• See related issues below for more context

I expect to have small development sessions sporadically now through mid january under low priority, followed by an intensive month/weeks to update, stabilize and sort things out, while working on life in parallel, subject to halt for the latter priority.

[harusurv]

Hello!
Thank you for the update, happy to see you again hehe

I have been trying the new da3 and its giving me an error when using it:

🌌 DepthFlow da2+zoom: D:\Cristo Rey\cristo_rey\images\Salmos_34_1_19_part1.jpg -> D:\Cristo Rey\cristo_rey\output\parallax\Salmos_34_1_19_clip_1_full_parallax.mp4 (t=8.062s)
│Broken├┤0'06.430├┤INFO │ ▸ (Module  1 • DepthScene  ) Loading image: D:\Cristo Rey\cristo_rey\images\Salmos_34_1_19_part1.jpg
│Broken├┤0'06.431├┤INFO │ ▸ (Module  1 • DepthScene  ) Loading depth: Estimating from image
2025-12-15 17:14:45,790 - DEBUG - [call:203] - STREAM b'IHDR' 16 13
2025-12-15 17:14:45,790 - DEBUG - [call:203] - STREAM b'tEXt' 41 533
2025-12-15 17:14:45,790 - DEBUG - [call:203] - STREAM b'IDAT' 586 65536
❌ DepthFlow failed: 'NoneType' object has no attribute 'inference'
╭──────────────────────────────────────────────────────────── Traceback (most recent call last) ────────────────────────────────────────────────────────────╮
│ D:\Cristo Rey\cristo_rey\.venv\Lib\site-packages\shaderflow\scene.py:740 in main                                                                          │
│                                                                                                                                                           │
│    739 │   │   │   │   │   self._quit = False                                                                                                             │
│ ❱  740 │   │   │   │   │   ShaderScene.main(**locals())                                                                                                   │
│    741 │   │   │   │   except ShaderBatchStop:                                                                                                            │
│                                                                                                                                                           │
│ D:\Cristo Rey\cristo_rey\.venv\Lib\site-packages\shaderflow\scene.py:774 in main                                                                          │
│                                                                                                                                                           │
│    773 │   │   for module in self.modules:                                                                                                                │
│ ❱  774 │   │   │   module.setup()                                                                                                                         │
│    775                                                                                                                                                    │
│                                                                                                                                                           │
│ D:\Cristo Rey\cristo_rey\.venv\Lib\site-packages\depthflow\scene.py:139 in setup                                                                          │
│                                                                                                                                                           │
│   138 │   │   │   self.config.animation.add(Animation.Orbital())                                                                                          │
│ ❱ 139 │   │   self._load_inputs()                                                                                                                         │
│   140                                                                                                                                                     │
│                                                                                                                                                           │
│ D:\Cristo Rey\cristo_rey\.venv\Lib\site-packages\depthflow\scene.py:254 in _load_inputs                                                                   │
│                                                                                                                                                           │
│   253 │   │   image = self.config.upscaler.upscale(LoadImage(image))                                                                                      │
│ ❱ 254 │   │   depth = LoadImage(depth) or self.config.estimator.estimate(image)                                                                           │
│   255                                                                                                                                                     │
│                                                                                                                                                           │
│ D:\Cristo Rey\cristo_rey\.venv\Lib\site-packages\broken\externals\depthmap.py:83 in estimate                                                              │
│                                                                                                                                                           │
│    82 │   │   │   # Estimate and convert to target dtype                                                                                                  │
│ ❱  83 │   │   │   depth = self._estimate(image)                                                                                                           │
│    84 │   │   │   depth = Vectron.normalize(depth, dtype=self.np_dtype)                                                                                   │
│                                                                                                                                                           │
│ D:\Cristo Rey\cristo_rey\.venv\Lib\site-packages\broken\externals\depthmap.py:258 in _estimate                                                            │
│                                                                                                                                                           │
│   257 │   def _estimate(self, image: np.ndarray) -> np.ndarray:                                                                                           │
│ ❱ 258 │   │   prediction = self._model.inference(                                                                                                         │
│   259 │   │   │   image=[image],                                                                                                                          │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
AttributeError: 'NoneType' object has no attribute 'inference'

Got any clue why? This is how I use it:

import os
import subprocess
import random
import time

def run_depthflow_parallax(scene_depth, image_path, output_video, duration, resolutionWidth, resolutionHeight):
    """
    Run DepthFlow using DA2 + zoom presets (as before), using a shared DepthScene instance,
    then re-encode for compatibility.

    IMPORTANT:
    - `scene_depth` must be created ONCE by the caller and reused.
    - This function is NOT thread-safe: call it sequentially.
    """

    # Your original zoom presets
    options = [
        ["zoom", "-i", "0.16", "--smooth", "horizontal", "-i", "0.16", "--steady", "0.16", "--isometric", "0.16", "--smooth"],
        ["zoom", "-i", "0.16", "--smooth", "horizontal", "-i", "0.16", "--steady", "0.16", "--isometric", "0.16", "--smooth", "--reverse"],
        ["zoom", "-i", "0.16", "--smooth", "--reverse", "horizontal", "-i", "0.16", "--steady", "0.16", "--isometric", "0.16", "--smooth"],
        ["zoom", "-i", "0.16", "--smooth", "--reverse", "horizontal", "-i", "0.16", "--steady", "0.16", "--isometric", "0.16", "--smooth", "--reverse"],
    ]
    selected_option = random.choice(options)

    # DA2 pipeline (as before)
    argv = [
        "da3", "--model", "large",
        "input", "--image", image_path,
        *selected_option,
        "main",
        "-q", "100",
        "-s", "4",
        "--time", str(duration),
        "--fps", "30",
        "--output", output_video,
    ]

    print(f"🌌 DepthFlow da2+zoom: {image_path} -> {output_video} (t={duration:.3f}s)")
    try:
        # CRITICAL: splat args; do NOT pass the list as one argument
        scene_depth.cli(*argv)
        print(f"✅ Parallax created: {output_video}")
    except Exception as e:
        print(f"❌ DepthFlow failed: {e}")
        raise

    # Re-encode the DepthFlow output to ensure compatibility
    temp_output = output_video + ".temp.mp4"
    ffmpeg_cmd = [
        "ffmpeg", "-y", "-i", output_video,
        "-vf", (
            f"scale={resolutionWidth}:{resolutionHeight}:force_original_aspect_ratio=decrease,"
            f"pad={resolutionWidth}:{resolutionHeight}:(ow-iw)/2:(oh-ih)/2,"
            f"setsar=1:1,fps=30,format=yuv420p"
        ),
        "-c:v", "libx264", "-crf", "18", "-preset", "fast",
        "-c:a", "aac", "-b:a", "128k",
        temp_output
    ]

    print(f"🔧 Re-encoding to {resolutionWidth}x{resolutionHeight}, 30 fps, yuv420p...")
    try:
        subprocess.run(ffmpeg_cmd, check=True, capture_output=True, text=True)
        print(f"✅ FFmpeg re-encoding completed: {temp_output}")
    except subprocess.CalledProcessError as e:
        print(f"❌ FFmpeg re-encoding failed: {e.stderr}")
        raise

    # Retry mechanism for file operations (Windows file locks)
    max_retries = 8
    retry_delay = 0.5
    for attempt in range(max_retries):
        try:
            if os.path.exists(output_video):
                os.remove(output_video)
            os.rename(temp_output, output_video)
            break
        except PermissionError as e:
            if attempt < max_retries - 1:
                time.sleep(retry_delay)
            else:
                raise

works with da2 but not with da3

[harusurv]

I have managed to fix it. It's necesary to use GPU. Once reinstalled all to use GPU it worked.

For anyone with this issue.