Incomplete photo export when disabling open-cl in darktable-cli

[puyral]

Describe the bug

It seems that disabling open-cl can lead to a picture not being fully rendered. I get a black bar at the bottom of the image.

Steps to reproduce

darktable-cli ./MEP05404.arw ./MEP05404.arw.xmp /tmp/fine.jpg --core --conf plugins/imageio/format/jpeg/quality=80 --conf plugins/imageio/storage/disk/overwrite=1 produces the right image

darktable-cli ./MEP05404.arw ./MEP05404.arw.xmp /tmp/broken.jpg --core --conf plugins/imageio/format/jpeg/quality=80 --conf plugins/imageio/storage/disk/overwrite=1 --disable-opencl produces the incomplete one

The raw files and generated jpgs are available here: https://drive.google.com/drive/folders/1q8_-WJ0C6ljQsvqfF3rO_hjoKqJzf_A0?usp=sharing (because Sony's RAW files are so large, it didn't fit on github ^^')

Expected behavior

borken.jpg and fine.jpg should be the same (or very close to)

Logfile | Screenshot | Screencast

Here are the logs files using -d all for the broken jpg (without open-cl) the working jpg (with open-cl)

Commit

No response

Where did you obtain darktable from?

distro packaging

darktable version

darktable 5.0.0

What OS are you using?

Linux

What is the version of your OS?

NixOS 24.11.20241230.3ffbbdb (Vicuna) x86_64

Describe your system?

I can reproduce the same problem on two machines with very different hardware configuration (one server and one desktop) but running the exact same os and version of darktable.

Are you using OpenCL GPU in darktable?

None

If yes, what is the GPU card and driver?

No response

Please provide additional context if applicable. You can attach files too, but might need to rename to .txt or .zip

The bug is a few months older than version 5.0.0 and was already present in at least 4.8. But things used to be fully functional before.

It seems that more complex edits can lead to a larger black band at the bottom, but it is a bit inconsistent.

I am quite confused by this bug, since there are no error messages in the logs or anywhere else on my computers.

[markus1189]

I recently experienced the same thing, that is images not being rendered correctly anymore when using darktable-cli.

The regular Export from darktable GUI works, but running it from the cli via darktable-cli does produce incomplete images with black bottoms, with varying height on each run.

I'm running a pretty recent build of darktable, commit was 0739a92deacfc9c9a8d26ad21d48372bef1d6dad

OpenCL is disabled, output of darktable-cltest:

darktable unknown-version
Copyright (C) 2012-2025 Johannes Hanika and other contributors.

Compile options:
  Bit depth              -> 64 bit
  Debug                  -> DISABLED
  SSE2 optimizations     -> ENABLED
  OpenMP                 -> ENABLED
  OpenCL                 -> ENABLED
  Lua                    -> ENABLED  - API version 9.4.0
  Colord                 -> ENABLED
  gPhoto2                -> ENABLED
  GMIC                   -> ENABLED  - Compressed LUTs are supported
  GraphicsMagick         -> ENABLED
  ImageMagick            -> DISABLED
  libavif                -> ENABLED
  libheif                -> ENABLED
  libjxl                 -> ENABLED
  LibRaw                 -> ENABLED  - Version 0.22.0-Devel202403
  OpenJPEG               -> ENABLED
  OpenEXR                -> ENABLED
  WebP                   -> ENABLED

See https://www.darktable.org/resources/ for detailed documentation.
See https://github.com/darktable-org/darktable/issues/new/choose to report bugs.

     1.2210 [dt_get_sysresource_level] switched to 1 as `default'
     1.2210   total mem:       63931MB
     1.2210   mipmap cache:    7991MB
     1.2210   available mem:   31965MB
     1.2210   singlebuff:      499MB
     1.2221 [opencl_init] opencl disabled via darktable preferences
     1.2224 [opencl_init] opencl library 'libOpenCL' found on your system and loaded, preference 'default path'
     1.2224 [opencl_init] 0 platforms detected, error: Unknown OpenCL error
     1.2224 [opencl_init] FINALLY: opencl PREFERENCE=OFF is NOT AVAILABLE and NOT ENABLED.

[jenshannoschwalm]

@markus1189 @puyral

It's very difficult to read the above logs, to get an idea about what might go wrong please provide logs with -d pipe if running without opencl or -d pipe -d opencl otherwise. That likely is sufficient and might give me a clue.

[markus1189]

Here my logs:

$> darktable-cli ../raws/2024/12/29/20241229_124315.NEF /tmp/foo.jpg --core -d pipe
darktable unknown-version
Copyright (C) 2012-2025 Johannes Hanika and other contributors.

Compile options:
  Bit depth              -> 64 bit
  Debug                  -> DISABLED
  SSE2 optimizations     -> ENABLED
  OpenMP                 -> ENABLED
  OpenCL                 -> ENABLED
  Lua                    -> ENABLED  - API version 9.4.0
  Colord                 -> ENABLED
  gPhoto2                -> ENABLED
  GMIC                   -> ENABLED  - Compressed LUTs are supported
  GraphicsMagick         -> ENABLED
  ImageMagick            -> DISABLED
  libavif                -> ENABLED
  libheif                -> ENABLED
  libjxl                 -> ENABLED
  LibRaw                 -> ENABLED  - Version 0.22.0-Devel202403
  OpenJPEG               -> ENABLED
  OpenEXR                -> ENABLED
  WebP                   -> ENABLED

See https://www.darktable.org/resources/ for detailed documentation.
See https://github.com/darktable-org/darktable/issues/new/choose to report bugs.

     1.4906 pipe starting             CPU [export]                                   (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  ID=1
     1.4909 modify roi IN                 [export]         lens                   1300 (   0/   0) 8288x5520 scale=1.0000 --> (   5/   2) 8276x5514 scale=1.0000  ID=1
     1.4909 modify roi IN                 [export]         demosaic               800 (   5/   2) 8276x5514 scale=1.0000 --> (   4/   2) 8276x5514 scale=1.0000  ID=1
     1.4910 modify roi IN                 [export]         highlights             400 (   4/   2) 8276x5514 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  ID=1
     1.4910 pipe data: full               [export]                                   (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  
     1.4910 process                   CPU [export]         rawprepare             100 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RAW 366MB
     1.5102 process                   CPU [export]         temperature            300 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RAW 366MB
     1.5242 process                   CPU [export]         highlights             400 (   0/   0) 8288x5520 scale=1.0000 --> (   4/   2) 8276x5514 scale=1.0000  IOP_CS_RAW 457MB
     1.5513 opposed chroma            CPU [export]         highlights             400 (   0/   0) 8288x5520 scale=1.0000 --> (   4/   2) 8276x5514 scale=1.0000  RGB 0.0000 0.0000 0.0000 hash=2f181e9963e983a4
     1.5895 process                   CPU [export]         demosaic               800 (   4/   2) 8276x5514 scale=1.0000 --> (   5/   2) 8276x5514 scale=1.0000  IOP_CS_RAW -> IOP_CS_RGB 2190MB
     1.8540 demosaic inplace          CPU [export]         demosaic               800 (   4/   2) 8276x5514 scale=1.0000 --> (   5/   2) 8276x5514 scale=1.0000  
     1.8540 process                   CPU [export]         denoiseprofile         900 (   5/   2) 8276x5514 scale=1.0000 --> (   5/   2) 8276x5514 scale=1.0000  IOP_CS_RGB 1643MB
    46.7800 process                   CPU [export]         lens                   1300 (   5/   2) 8276x5514 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB 3294MB
    48.1166 process                   CPU [export]         exposure               2400 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB 1464MB
    48.1905 process                   CPU [export]         colorin                3200 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB 1464MB
    48.2807 transform colorspace      CPU [export]         channelmixerrgb        3300 (   0/   0) 8288x5520 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB `linear Rec2020 RGB'
    48.3283 process                   CPU [export]         channelmixerrgb        3300 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB 1464MB
    48.8627 transform colorspace      CPU [export]         sharpen                4400 (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB `linear Rec2020 RGB'
    48.9218 process                   CPU [export]         sharpen                4400 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_LAB 1537MB
    49.1095 transform colorspace      CPU [export]         basecurve              5600 (   0/   0) 8288x5520 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB `linear Rec2020 RGB'
    49.1565 process                   CPU [export]         basecurve              5600 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB 1464MB
    49.2476 process                   CPU [export]         filmicrgb              5900 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB 1647MB
    50.3517 transform colorspace      CPU [export]         tonecurve              6100 (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB `linear Rec2020 RGB'
    50.4090 process                   CPU [export]         tonecurve              6100 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_LAB 1464MB
    50.6084 process                   CPU [export]         bilat                  6700 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_LAB 6545MB
    51.9207 process                   CPU [export]         colorzones             7200 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_LAB 1464MB
    52.3164 process                   CPU [export]         colorout               8200 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB 1464MB
    52.4441 process                   CPU [export]         finalscale             8400 (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  IOP_CS_RGB 1464MB
    52.5020 cache report                  [export]                                    2 lines (important=0, used=0, invalid=0). Using 1396MB, limit=0MB. Hits/run=0.00. Hits/test=0.000
    52.5020 pipe finished             CPU [export]                                   (   0/   0) 8288x5520 scale=1.0000 --> (   0/   0) 8288x5520 scale=1.0000  ID=1
    54.1914 [export_job] exported to `/tmp/foo.jpg'
    54.1918 Session fullpipe cache report. hits/run=0.00, hits/test=0.000

And the resulting image (scaled down 30% to fit 10MB limit):

[jenshannoschwalm]

Hmm, tried the file&xmp provided by @puyral on my small 8GB laptop and exported 10times with & withoug OpenCL . Not a single file failed.

ATM i don't know what could be going wrong here.

[puyral]

Well I managed to "fix" the problem by nuking my ~/.config/darktable...
The problem remains fixed when I manually point to my libray.db but keep the rest of ~/.config/darktable removed. I'm guessing my data.db or my darktablerc got corrupted at some point...

On another note, the requested logs (with the old ~/.config/darktable, so when the bug still occurs):

Without opencl, producing the incomplete file

$ darktable-cli ./MEP05404.arw ./MEP05404.arw.xmp /tmp/broken.jpg --core -d pipe --disable-opencl
darktable 5.0.0
Copyright (C) 2012-2024 Johannes Hanika and other contributors.

Compile options:
  Bit depth              -> 64 bit
  Debug                  -> DISABLED
  SSE2 optimizations     -> ENABLED
  OpenMP                 -> ENABLED
  OpenCL                 -> ENABLED
  Lua                    -> ENABLED  - API version 9.4.0
  Colord                 -> ENABLED
  gPhoto2                -> ENABLED
  GMIC                   -> ENABLED  - Compressed LUTs are supported
  GraphicsMagick         -> ENABLED
  ImageMagick            -> DISABLED
  libavif                -> ENABLED
  libheif                -> ENABLED
  libjxl                 -> ENABLED
  LibRaw                 -> ENABLED  - Version 0.22.0-Devel202403
  OpenJPEG               -> ENABLED
  OpenEXR                -> ENABLED
  WebP                   -> ENABLED

See https://www.darktable.org/resources/ for detailed documentation.
See https://github.com/darktable-org/darktable/issues/new/choose to report bugs.

     2.5819 modify roi OUT                [export]         rawprepare              100 (   0/   0) 9600x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  ID=1
     2.5819 pipe starting             CPU [export]                                     (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  ID=1
     2.5835 modify roi IN                 [export]         rawprepare              100 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9600x6376 scale=1.0000  ID=1
     2.5835 pipe data: full               [export]                                     (   0/   0) 9600x6376 scale=1.0000 --> (   0/   0) 9600x6376 scale=1.0000
     2.5836 process                   CPU [export]         rawprepare              100 (   0/   0) 9600x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW 489MB
     2.6113 process                   CPU [export]         temperature             300 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW 488MB
     2.6349 process                   CPU [export]         highlights              400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW 610MB
     2.6764 opposed chroma            CPU [export]         highlights              400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  RGB 0.0000 0.0000 0.0000 hash=a4c2412ae1b6cb4f
     2.7236 process                   CPU [export]         demosaic                800 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW -> IOP_CS_RGB 2933MB
     3.3779 demosaic inplace          CPU [export]         demosaic                800 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000
     3.3780 process                   CPU [export]         denoiseprofile          900 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 4880MB
    15.7756 process                   CPU [export]         lens                   1300 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 4392MB
    18.4395 process                   CPU [export]         cacorrectrgb           1400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    22.9406 process                   CPU [export]         exposure               2400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    23.0564 process                   CPU [export]         toneequal              2700 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    23.7288 process                   CPU [export]         colorin                3200 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB 1952MB
    23.8689 transform colorspace      CPU [export]         channelmixerrgb        3300 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB `linear Rec2020 RGB'
    23.9488 process                   CPU [export]         channelmixerrgb        3300 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    24.8711 transform colorspace      CPU [export]         sharpen                4500 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB `linear Rec2020 RGB'
    24.9827 process                   CPU [export]         sharpen                4500 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB 2050MB
    25.5855 transform colorspace      CPU [export]         colorbalancergb        5200 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB `linear Rec2020 RGB'
    25.6654 process                   CPU [export]         colorbalancergb        5200 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    30.0138 process                   CPU [export]         sigmoid                5700 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    31.5583 transform colorspace      CPU [export]         colorout               8200 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB `linear Rec2020 RGB'
    31.6553 process                   CPU [export]         colorout               8200 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB 1952MB
    31.8610 process                   CPU [export]         finalscale             8400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    31.9524 cache report                  [export]                                      2 lines (important=0, used=0, invalid=0). Using 1868MB, limit=0MB. Hits/run=0.00. Hits/test=0.000
    31.9524 pipe finished             CPU [export]                                     (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  ID=1
    32.8525 [export_job] exported to `/tmp/broken.jpg'
    32.8530 Session fullpipe cache report. hits/run=0.00, hits/test=0.000

With opencl, producing the expected file

$ darktable-cli ./MEP05404.arw ./MEP05404.arw.xmp /tmp/fine.jpg --core -d pipe -d opencl
darktable 5.0.0
Copyright (C) 2012-2024 Johannes Hanika and other contributors.

Compile options:
  Bit depth              -> 64 bit
  Debug                  -> DISABLED
  SSE2 optimizations     -> ENABLED
  OpenMP                 -> ENABLED
  OpenCL                 -> ENABLED
  Lua                    -> ENABLED  - API version 9.4.0
  Colord                 -> ENABLED
  gPhoto2                -> ENABLED
  GMIC                   -> ENABLED  - Compressed LUTs are supported
  GraphicsMagick         -> ENABLED
  ImageMagick            -> DISABLED
  libavif                -> ENABLED
  libheif                -> ENABLED
  libjxl                 -> ENABLED
  LibRaw                 -> ENABLED  - Version 0.22.0-Devel202403
  OpenJPEG               -> ENABLED
  OpenEXR                -> ENABLED
  WebP                   -> ENABLED

See https://www.darktable.org/resources/ for detailed documentation.
See https://github.com/darktable-org/darktable/issues/new/choose to report bugs.

     0.0656 [dt_get_sysresource_level] switched to 1 as `default'
     0.0656   total mem:       23875MB
     0.0656   mipmap cache:    2984MB
     0.0656   available mem:   11937MB
     0.0656   singlebuff:      186MB
     0.0664 [opencl_init] opencl library 'libOpenCL' found on your system and loaded, preference 'default path'
     0.1070 [opencl_init] found 1 platform
[opencl_init] found 1 device

[dt_opencl_device_init]
   DEVICE:                   0: 'NVIDIA GeForce GTX 1060'
   CONF KEY:                 cldevice_v5_nvidiacudanvidiageforcegtx1060
   PLATFORM, VENDOR & ID:    NVIDIA CUDA, NVIDIA Corporation, ID=4318
   CANONICAL NAME:           nvidiacudanvidiageforcegtx1060
   DRIVER VERSION:           565.77
   DEVICE VERSION:           OpenCL 3.0 CUDA, SM_20 SUPPORT
   DEVICE_TYPE:              GPU, dedicated mem
   GLOBAL MEM SIZE:          6066 MB
   MAX MEM ALLOC:            1516 MB
   MAX IMAGE SIZE:           16384 x 32768
   MAX WORK GROUP SIZE:      1024
   MAX WORK ITEM DIMENSIONS: 3
   MAX WORK ITEM SIZES:      [ 1024 1024 64 ]
   ASYNC PIXELPIPE:          NO
   PINNED MEMORY TRANSFER:   NO
   AVOID ATOMICS:            NO
   MICRO NAP:                250
   ROUNDUP WIDTH & HEIGHT    16x16
   CHECK EVENT HANDLES:      128
   TILING ADVANTAGE:         0.000
   DEFAULT DEVICE:           NO
   KERNEL BUILD DIRECTORY:   /nix/store/5s4mb8gpsxh27f0r3zil61xlxvq3vkws-darktable-5.0.0/share/darktable/kernels
   KERNEL DIRECTORY:         /home/simon/.cache/darktable/cached_v5_kernels_for_NVIDIACUDANVIDIAGeForceGTX1060_56577
   CL COMPILER OPTION:       -cl-fast-relaxed-math
   CL COMPILER COMMAND:      -w -cl-fast-relaxed-math  -DNVIDIA_SM_20=1 -DNVIDIA=1 -I"/nix/store/5s4mb8gpsxh27f0r3zil61xlxvq3vkws-darktable-5.0.0/share/darktable/kernels"
   KERNEL LOADING TIME:       0.1167 sec
[opencl_init] OpenCL successfully initialized. internal numbers and names of available devices:
[opencl_init]		0	'NVIDIA CUDA NVIDIA GeForce GTX 1060'
     0.2982 [opencl_init] FINALLY: opencl PREFERENCE=ON is AVAILABLE and ENABLED.
[opencl_init] opencl_scheduling_profile: 'very fast GPU'
[opencl_init] opencl_device_priority: '*/!0,*/*/*/!0,*'
[opencl_init] opencl_mandatory_timeout: 400
[opencl_update_priorities] these are your device priorities:
[opencl_update_priorities] 		image	preview	export	thumbs	preview2
[dt_opencl_update_priorities]		0	0	0	0	0
[opencl_update_priorities] show if opencl use is mandatory for a given pixelpipe:
[opencl_update_priorities] 		image	preview	export	thumbs	preview2
[opencl_update_priorities]		1	1	1	1	1
[opencl_synchronization_timeout] synchronization timeout set to 0
[opencl_update_priorities] these are your device priorities:
[opencl_update_priorities] 		image	preview	export	thumbs	preview2
[dt_opencl_update_priorities]		0	0	0	0	0
[opencl_update_priorities] show if opencl use is mandatory for a given pixelpipe:
[opencl_update_priorities] 		image	preview	export	thumbs	preview2
[opencl_update_priorities]		1	1	1	1	1
[opencl_synchronization_timeout] synchronization timeout set to 0
     2.3926 modify roi OUT                [export]         rawprepare              100 (   0/   0) 9600x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  ID=1
     2.3926 pipe starting             CL0 [export]                                     (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  ID=1, nvidiacudanvidiageforcegtx1060
     2.3926 [dt_opencl_check_tuning] use 3736MB (headroom=OFF, pinning=OFF) on device `NVIDIA CUDA NVIDIA GeForce GTX 1060' id=0
     2.3941 modify roi IN                 [export]         rawprepare              100 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9600x6376 scale=1.0000  ID=1
     2.3941 pipe data: full               [export]                                     (   0/   0) 9600x6376 scale=1.0000 --> (   0/   0) 9600x6376 scale=1.0000
     2.4150 process                   CL0 [export]         rawprepare              100 (   0/   0) 9600x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW 488.9MB
     2.4207 process                   CL0 [export]         temperature             300 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW 488.0MB
     2.4293 process                   CL0 [export]         highlights              400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW 610.1MB
     2.4538 opposed chroma            CL0 [export]         highlights              400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  RGB 0.0000 0.0000 0.0000 hash=a4c2412ae1b6cb4f
     2.5918 process tiled             CL0 [export]         demosaic                800 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RAW -> IOP_CS_RGB
     2.5918 process *tiled* ptp       CL0 [export]         demosaic                800 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  2x1 tiles, size=6380x6356
     2.7409 demosaic inplace          CL0 [export]         demosaic                800 (   0/   0) 6400x6376 scale=1.0000 --> (   0/   0) 6400x6376 scale=1.0000
     3.1895 demosaic inplace          CL0 [export]         demosaic                800 (6380/   0) 3188x6376 scale=1.0000 --> (6380/   0) 3188x6376 scale=1.0000
     3.3533 process tiled             CL0 [export]         denoiseprofile          900 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB
     3.3533 process *tiled* ptp       CL0 [export]         denoiseprofile          900 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  3x1 tiles, size=3400x6120
     5.0856 process tiled             CL0 [export]         lens                   1300 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB
     5.0856 process *tiled* roi       CL0 [export]         lens                   1300 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  2x1 tiles, size=4788x6380
     5.7067 process                   CPU [export]         cacorrectrgb           1400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    10.4855 process                   CL0 [export]         exposure               2400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952.2MB
    10.6668 process                   CPU [export]         toneequal              2700 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952MB
    11.4520 process                   CL0 [export]         colorin                3200 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB 1952.2MB
    11.4739 transform colorspace      CL0 [export]         channelmixerrgb        3300 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB `linear Rec2020 RGB'
    11.5271 process                   CL0 [export]         channelmixerrgb        3300 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952.2MB
    11.5625 transform colorspace      CL0 [export]         sharpen                4500 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB `linear Rec2020 RGB'
    11.6187 process                   CL0 [export]         sharpen                4500 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB 2928.3MB
    11.7108 transform colorspace      CL0 [export]         colorbalancergb        5200 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB `linear Rec2020 RGB'
    11.7731 process                   CL0 [export]         colorbalancergb        5200 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952.2MB
    11.8132 process                   CL0 [export]         sigmoid                5700 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952.2MB
    11.9029 transform colorspace      CL0 [export]         colorout               8200 (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB -> IOP_CS_LAB `linear Rec2020 RGB'
    11.9613 process                   CL0 [export]         colorout               8200 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_LAB -> IOP_CS_RGB 1952.2MB
    12.0129 process                   CL0 [export]         finalscale             8400 (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  IOP_CS_RGB 1952.2MB
    12.2022 cache report                  [export]                                      2 lines (important=0, used=0, invalid=0). Using 1868MB, limit=0MB. Hits/run=0.00. Hits/test=0.000
    12.2022 pipe finished             CL0 [export]                                     (   0/   0) 9568x6376 scale=1.0000 --> (   0/   0) 9568x6376 scale=1.0000  ID=1
    13.1800 [export_job] exported to `/tmp/fine.jpg'
    13.1804 Session fullpipe cache report. hits/run=0.00, hits/test=0.000
 [opencl_summary_statistics] device 'NVIDIA CUDA NVIDIA GeForce GTX 1060' (0): 190 out of 190 events were successful and 0 events lost. max event=189

[markus1189]

I tried renaming my ~/.config/darktable directory and retried it. Essentially the same result as above, but the height of the bottom black box varies randomly to a bit more or less on each run.

Still running without opencl.

[markus1189]

I tried downgrading to 4.8.1 and 4.6.1 but with both I got incomplete exports.

Maybe it has to do with something else then, although I'm a bit out of ideas on how to diagnose.

If I export from the darktable gui it works fine, but darktable-cli for some reason does not export the full image...

[github-actions]

This issue has been marked as stale due to inactivity for the last 60 days. It will be automatically closed in 300 days if no update occurs. Please check if the master branch has fixed it and report again or close the issue.

[mayjs]

I'm facing the same issue on version 5.0.1 as well.
I am also using NixOS like @puyral, but using a different config directory and image database did not resolve the issue for me.

Does anyone have a pointer where we might start looking for the cause of this?
Both the CLI and the UI seem to end up in the same path of code to run the pipeline and save the image, so I'm not sure what causes this.
Maybe it is some sort of race condition resulting in image data getting saved before the pipeline is finished?

[markus1189]

Same here but I never found a solution. Exporting via GUI works fine, but darktable-cli produces incomplete images with a black area at the bottom.

I would be very thankful for any pointers to analyze this as well!

[puyral]

The problem kinda re-appeard for me, so I'm doing my exports via the gui or a computer with a GPU now.

But I have no idea how to debug this as it doesn't show up in any of the logs...

Someone probably should compile darktable in debug mode and see if something appears but I haven't taken the time to do it yet.

[TurboGit]

For the record the testsuite running on my machine every night (168 exports without OpenCL) has never failed since years. So maybe related to something in your environment.

[TurboGit]

I am also using NixOS like @puyral

Probably something to do with NixOS I would say.

[mayjs]

For the record the testsuite running on my machine every night (168 exports without OpenCL) has never failed since years. So maybe related to something in your environment.

Is that test suite available somewhere? Maybe it could be a good starting for further experiments on my side.

Probably something to do with NixOS I would say.

Yeah, that seems likely, especially since @markus1189 also appears to be on NixOS.
The Nix code to build darktable is fairly simple, there is no patching going on or something like that. So I figure it might be something in the dependencies that is behaving differently. Maybe something with OpenMP?