Skip to content
This repository has been archived by the owner on May 1, 2020. It is now read-only.

Exception occurred when copy model file to HDFS #23

Open
xhappy opened this issue Mar 1, 2019 · 1 comment
Open

Exception occurred when copy model file to HDFS #23

xhappy opened this issue Mar 1, 2019 · 1 comment

Comments

@xhappy
Copy link

xhappy commented Mar 1, 2019

Starting rotation fitting for split 1
Saving pickle to temp file...
Copying pickle file to hdfs...
hdfs:///user/algo/lopq/model/
Traceback (most recent call last):
File "train_model.py", line 426, in
save_hdfs_pickle(model, args.model_pkl)
File "train_model.py", line 245, in save_hdfs_pickle
copy_to_hdfs(f, pkl_path)
File "train_model.py", line 266, in copy_to_hdfs
subprocess.call(['hadoop', 'fs', '-put', f.name, hdfs_path])
File "/usr/lib64/python2.7/subprocess.py", line 524, in call
return Popen(*popenargs, **kwargs).wait()
File "/usr/lib64/python2.7/subprocess.py", line 711, in init
errread, errwrite)
File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
End of LogType:stdout

@pumpikano
Copy link
Collaborator

Sorry I can't be of much help here. To me it seems that there is some issue with the HDFS command executed in subprocess.call(['hadoop', 'fs', '-put', f.name, hdfs_path]).

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants