Investigating OS Error during HTML file write

[Mulan-94]

This investigation led to this bokeh commit and to the package tempfile

This stack abuse post gives some further information.
Tempfile is a default python package that scans the following list of directories :

• The directory named by the TMPDIR environment variable.
• The directory named by the TEMP environment variable.
• The directory named by the TMP environment variable
• Platform-specific directories:
• On windows, C:\TEMP, C:\TMP, \TEMP, and \TMP, in the same order.
  • On other platforms, /tmp, /var/tmp, and /usr/tmp, in the same order.
  • The current working directory.

To get the default temp files location: tempfile.gettempdir()
To set tempdir: tempfile.tempdir = "/bla/bla"

I'm going to change the temp dir location if output is HTML to see if this helps

[o-smirnov]

Yep, I think you've found the culprit! Cross-linking to caracal-pipeline/caracal#1200

[KshitijT]

Yay !
So would it be a separate directory than the one set by , e.g.
export SINGULARITY_TMPDIR=/idia/projects/fornax/.singularity_tmp ?

[o-smirnov]

Yeah, SINGULARITY_TMPDIR would be respected by singularity itself, but not necessarily by the container inhabitants. I've added an issue on Stimela which would be a general defensive solution. In the meantime, ragavi should contain its own fix of course.