Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reorganize ingest_metadata field #887

Open
shirey opened this issue Oct 4, 2024 · 0 comments
Open

Reorganize ingest_metadata field #887

shirey opened this issue Oct 4, 2024 · 0 comments
Assignees

Comments

@shirey
Copy link
Member

shirey commented Oct 4, 2024

This work needs to be done In conjunction with the work in Entity API #748

The Dataset.ingest_metadata field will be reorganized to accommodate:

  • Easier access to metadata for searching
  • Adding fields to accommodate the Workflow Tracking effort
  • Adding the Dataset.calculated_metadata field to allow storage of calculated/derived metadata

This work is specified in the ingest_metadata field reorganization document

From the above document a summary of the changes that need to be made are:

  • MOVE:
    • Dataset.metadata.metadata → Dataset.metadata
    • Dataset.metadata.files → Dataset.files
  • RENAME (Elasticsearch/Search API only):
    • Dataset.metadata → Dataset.ingest_metadata (Elasticsearch/Search API only)
  • DELETE:
    • Dataset.metadata.thumbnail_file_abs_path
    • Dataset.metadata.extra_metadata
  • ADD:
    • Dataset.ingest_metadata.workflow_description (as String/Text)
    • Dataset.ingest_metadata.workflow_version (as String/Text)
    • Dataset.calculated_metadata (as JSON text)
@shirey shirey added this to the ingest_metadata reorg milestone Oct 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Ready
Development

No branches or pull requests

2 participants