Is it possible to always pull latest Docker image?

Hi,

I am developing a new CWL pipeline and often update the used Docker image.
I use something like this:

cwlVersion: v1.0
class: CommandLineTool
requirements:
  DockerRequirement:
    dockerPull: registry.XXX.eu/my_image:1.4
...

Is possible to specify to always pull the latest image?
Something like imagePullPolicy: Always in kubernetes.
Our backend uses calrissian to run the CWL

Greetings,
Emile Sonneveld

Besides calrissian, cwltool 3.1.20240112164112 does not seem to pull the latest image as well.

Hello @EmileSonneveld and welcome!

There is a --force-docker-pull command line options for cwltool. Since Calrissian is built upon cwltool, maybe it also supports that option?

1 Like

In the case of calrissian, if the image is in the node’s cache, it won’t be pulled again.

IMO the best strategy is to use the sha256 in dockerPull:

DockerRequirement:
        dockerPull: ghcr.io/eoap/application-package-patterns/runner@sha256:09cef32f5f09171b6e9ebf145da5d40bef6061c68758643e223c38f2415a1ee0