option --pythonVersion not recognized

[ernstpijper]

DIRAC py3 server 7.3.17, py3 pilot jobs and py3 diracos2 client

Still running an old version on our dirac production server but I'm in the process of updating my dirac test machine to the latest version :)

Since a couple of days pilot job crash with the following error message:

option --pythonVersion not recognized

The command that is being run is:

Executing: python dirac-pilot.py -S DIRAC-Production --pythonVersion=3 -ddd -N arc01.gina.surfsara.nl -Q long-4core -n GRID.SURF.nl --modules=https://github.com/chaen/DIRAC.git:::DIRAC:::rel-v7r3_FEAT_proxyStrength

This started all of a sudden. I asked the admins of the compute cluster if something changed that could explain this. But the dirac command that is being run is not the one on the worker node but the one in the python environment setup by the pilot, right?

Anyway, hope you can tell me where to look.

Kind regards,
Ernst Pijper

[aldbr]

Hi,

We recently merged the following PR into the master branch of the Pilot: DIRACGrid/Pilot#235
It basically drops the possibility of having a python2 installation of Dirac within a pilot.

And I think we don't maintain v7r3 anymore.
The best you can do is likely to set the SiteDirector Python3Pilots option to False in the CS.

DIRAC/src/DIRAC/WorkloadManagementSystem/Agent/SiteDirector.py

Lines 996 to 997 in 5938d10

	if self.python3Pilots:
	pilotOptions.append("--pythonVersion=3")

It should prevent having --pythonVersion=3 in the options of the pilot.
Since you are already using python3 pilot jobs, everything should be fine.

Cheers

[ernstpijper]

Hi Andre,

For now I'm using the feat_PROXY_PR branch in your account. That's works just fine. Until I can push this branch into my account, I hope you will not delete it.

[andresailer]

I hope you have ssh configured for github. then this should be it

mkdir -p /tmp/foo/bar
cd /tmp/foo/bar
git clone [email protected]:ernstpijper/DIRAC.git
cd DIRAC
git remote add andre https://github.com/andresailer/DIRAC.git
git fetch andre
git checkout -t andre/feat_PROXY_PR 
git push origin feat_PROXY_PR 

[andresailer]

Ahh, sorry, I missed your previous report about the issue.

[andresailer]

Please delete your https://github.com/ernstpijper/DIRAC repository

And then "fork" the existing DIRAC

https://github.com/DIRACGrid/DIRAC/fork

instead.
And then use the commands I posted above, for example.

[ernstpijper]

Hi Andre,

Everyhting is working again. Thank you so much for your help

Ernst

[andresailer]

Great! Thanks for confirming!

[IgorPelevanyuk]

Hi,
Thanks @aldbr for the direction for the further search.

I have tried that solution. But for version 8.0.36 it did not work. The problem is that in that version the option is appended automatically.

DIRAC/src/DIRAC/WorkloadManagementSystem/Agent/SiteDirector.py

Line 1042 in fa1dcee

pilotOptions.append("--pythonVersion=3")

Commenting that line in code helped!

[aldbr]

Indeed, the pythonVersion option was deleted from v8.0.41 from the SiteDirector, creating issues with all the previous versions.
So there are 2 solutions:

• commenting that line in Dirac < v8.0.41 as you did.
• updating Dirac to a version >= v8.0.41.