An Error occurred during the command execution: ValueError No daemon runner document.

[chiang-yuan]

Thanks for developing such a great tool!

When I tried to run jf runner start, I got the following error:

An Error occurred during the command execution: ValueError No daemon runner document.
The auxiliary collection does not contain information about running daemon. Your database was likely set up or reset using an old version of Jobflow Remote. You can upgrade the database using the command "jf admin upgrade".

Running jf admin upgrade gives another error that has little message to debug:

An Error occurred during the command execution: TypeError expected string or bytes-like object, got 'NoneType'

jf project check --errors has passed without error. Not sure how to to debug this. Perhaps it is related to batch submission #172
?

┏━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┓
┃ DB id ┃ Name          ┃ State ┃ Job id  (Index)                           ┃ Worker       ┃ Last updated [PST] ┃
┡━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━┩
│ 1     │ MP GGA static │ READY │ aa0dfc19-6cdd-4296-9454-5c54319d0c9f  (1) │ batch_worker │ 2024-11-18 18:58   │
└───────┴───────────────┴───────┴───────────────────────────────────────────┴──────────────┴────────────────────┘

[gpetretto]

Hi @chiang-yuan,

thanks for following up and testing the batch functionality of jobflow-remote.
Quick explanation: in the development version we have just introduced the jf admin upgrade functionality that allows us to introduce small backward incompatible changes to the DB, while allowing the users to (easily?) upgrade their DB. The code checks the current version of the installed package and will perform the upgrade if the version is 0.1.5. At the moment you are using the development version, so it does not manage to get a proper version number and the upgrade procedure fails. I should admit that I did not consider a solution for generic users for this case. We have a hidden option to jf admin upgrade used for development and testing that allows to manually specify the target version. Running jf admin upgrade --test-version-upgrade 0.1.5 should solve your issue for the time being. I will check what can be done to make this smoother also when using a development version.

[chiang-yuan]

Thanks @gpetretto !!! This solves the problem for now. I will test it soon!

[cote3804]

Adding an error and solution I encountered during upgrading:
If you find yourself stuck in an error loop after upgrading where the jf admin upgrade command fails with this error:
The status of the daemon is RUNNING. The daemon should not be running while performing this operation
and the daemon can't be shut down because of this error:
An Error occurred during the command execution: ValueError No daemon runner document. The auxiliary collection does not contain information about running daemon. Your database was likely set up or reset using an old version of Jobflow Remote. You can upgrade the database using the command "jf admin upgrade"

I was able to fix this by downgrading to an old jobflow-remote version and stopping the daemon on that version. I could then upgrade the jobflow-remote version and run jf admin upgrade --test-version-upgrade 0.1.5 without issue.

[gpetretto]

Thanks both for reporting these issues. They should have been addressed in #234 and #240.
For future reference in case other users end up on this issue, the --test-version-upgrade, that was an hidden option, has been replaced by a visible --target option. So the upgrade procedure for a development version should be jf admin upgrade --target 0.1.5 with the latest updates.