Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

First stage RO-Crate import #90

Merged
merged 45 commits into from
May 23, 2024
Merged

First stage RO-Crate import #90

merged 45 commits into from
May 23, 2024

Conversation

jmfernandez
Copy link
Member

Now it is possible to properly import WRROCs produced by WfExS which represent CWL executions.

Technically, properly generated WRROCs from Nextflow executions should also be importable, but RO-Crate generation must be fixed first to properly generate them.

Added new `import` command, to import a Workflow-Run profiles
compliant RO-Crate into a new staged working directory, in order to run it.
Also, detection code has been moved from WfExSBackend to WF class, so it is better reused.
…t is the version of WfExS-backend the one defining the accepted values
…ontainer factories and workflow engines.

* Also, added a couple of new command line commands to list them.

* Additionally, created wfexs_backend.utils.rocrate.ROCrateToolbox , to move there the methods to generate a WfExS definition from an input RO-Crate metadata.

* Other code was also refactored.

* Now the list of executions and containers from a WRROC is walked.
…e module to `wfexs_backend.utils.rocrate` one
As this list of containers does not have an explicit representation
in the workflow staging definition, explicitly return it.
Next commits should implement rebuilding the input parameters properly.
…g a prospective provenance scenario (i.e. all is gathered, but nothing was run)
Also, several type definitions have been moved from common to their most natural place.
Also, a few type definitions have been moved from common to their most natural places.
…actRepoFetcher`

Also, refactored previous implementations in wfexs_backend.fetchers.git and
wfexs_backend.fetchers.swh under GitFetcher and SoftwareHeritageFetcher.

This work is needed to allow future modular repository providers.
…iginal one is used instead of a possibly consolidated one.
It is currently working with WRROCs from CWL workflows. (Nextflow WWROC generation has to be fixed)
Added support for RO-Crate import (only metadata), and input parameters replacement.

Still pending to fix RO-Crate generation for Nextflow, so the imported RO-Crates can be consumed without issues.
@jmfernandez jmfernandez self-assigned this May 23, 2024
@jmfernandez jmfernandez merged commit 03cb492 into main May 23, 2024
6 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant