After upgrading from 4.8 to 5.0.0 I am no longer able to access my rolls

[FeralChild64]

Describe the bug

After upgrading Darktable, my rolls are shown as empty (or nearly empty - some of them show like 2-5 photos in them), despite in reality they contain hundreds of images.

Steps to reproduce

I can't give you the exact steps how to recreate my database. I have simply upgraded the Darktable.

The database I am using is few years old (I am actually using Darktable since over 10 years, but at some point I have lost the database due to SSD failure).

Expected behavior

No response

Logfile | Screenshot | Screencast

(some album names censored due to privacy concerns)

darktable 5.0.0
Copyright (C) 2012-2024 Johannes Hanika and other contributors.

Compile options:
  Bit depth              -> 64 bit
  Debug                  -> DISABLED
  SSE2 optimizations     -> ENABLED
  OpenMP                 -> ENABLED
  OpenCL                 -> ENABLED
  Lua                    -> DISABLED
  Colord                 -> ENABLED
  gPhoto2                -> DISABLED
  GMIC                   -> DISABLED - Compressed LUTs are NOT supported
  GraphicsMagick         -> DISABLED
  ImageMagick            -> DISABLED
  libavif                -> DISABLED
  libheif                -> DISABLED
  libjxl                 -> DISABLED
  LibRaw                 -> ENABLED  - Version 0.22.0-Devel202403
  OpenJPEG               -> ENABLED
  OpenEXR                -> ENABLED
  WebP                   -> ENABLED

(...)

 [opencl_summary_statistics] device 'Intel(R) OpenCL Graphics Intel(R) Arc(TM) A770 Graphics' (0): NOT utilized

Commit

No response

Where did you obtain darktable from?

distro packaging

darktable version

5.0.0

What OS are you using?

Linux

What is the version of your OS?

Gentoo, AMD64

Describe your system?

64 GB RAM, Wayland, Intel Arc A770 16 GB, x11-libs/gtk+-3.24.42-r1

Are you using OpenCL GPU in darktable?

No

If yes, what is the GPU card and driver?

No response

Please provide additional context if applicable. You can attach files too, but might need to rename to .txt or .zip

No response

[zisoft]

We had a similar issue #17377 which wasn't reproducible to track down the cause.

Can you try if it helps to re-import one image of such a collection?

[MStraeten]

you might select a different filter instead of "all images" and after that select "all images"

[FeralChild64]

Can you try if it helps to re-import one image of such a collection?

Imported one image to one collection, and Darktable starting reading every image, from every roll. Thanks for the workaround!

[ralfbrown]

I have been encountering "missing" images, which are fixed by clicking reset on the collection filters module, on first import into a fresh library for some months now. I've also seen it randomly a couple of times after import into a library which already contains images.

[andrewk8]

Not sure if this is related.

Windows. After upgrading from 4.8.1 to 5.0.0, lighttable showed only jpeg. no raws (Sony ARW). I shoot RAW+JPEG plus JPEG from my phone. It showed raw+jpeg groups, but not the raws if I showed them un-grouped.

I ended up resetting the filters (top left above the lighttable) and that made the ARW visible.

[mheieis]

Experienced the same issue. No display of any previously imported images, no matter what format they were in. Clicked around and finally, I clicked one film roll, right clicked and selected "update path to files". The images in that film roll showed up as well as images in all the other film rolls. I've and closed darktable a few times and the above has solved the problem for me. I also clicked on "reset" in collections, it didn't seem to help initially.

[ptilopteri]

* mheieis ***@***.***> [01-18-25 18:46]:

Experienced the same issue. No display of any previously imported images, no matter what format they were in. Clicked around and finally, I clicked one film roll, right clicked and selected "update path to files". The images in that film roll showed up as well as images in all the other film rolls. I've and closed darktable a few times and the above has solved the problem for me. I also clicked on "reset" in collections, it didn't seem to help initially.

have you moved files using some application other than darktable?

…

-- (paka)Patrick Shanahan Plainfield, Indiana, USA @ptilopteri facebook/ptilopteri Photos: http://wahoo.no-ip.org/piwigo paka @ IRCnet oftc

[mheieis]

Just straight forward update. No movement of file structure. When I updated the file path, the path shown was the correct location. I just accepted that and everything was back to normal. Another observation was that I tried re-importing images for film rolls but they were marked as already imported

[tronster]

I have the same (or similar) issue.
Any image I've edited does not show up since updating from a 4.x.x version to 5.0.0 today on Windows via the official install.
So images that I have not manipulated show up fine in lighttable mode, but as soon as I edit them in darkroom mode, they no longer appear.
At first I thought it was a filter issue. But after spending an inordinate amount of time playing with the filters and reproducing it on multiple images, I'm now convinced this is a bug.
On the plus side, at least the image .CR2 is still on disk.

[wpferguson]

Try reimporting one of your processed images.

[tronster]

While re-import didn't work, it did lead to a solution that lets me work around this bug:

1. right click the “film roll”
2. select “update path to files…”
3. images that had been processed will then reappear in lighttable view

Note: I hadn’t changed any file paths, but this still worked fixing whatever got borked in the DB update.