Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: save CKAN metadata; output second ZIP #10

Merged
merged 12 commits into from
Sep 11, 2024
Merged

feat: save CKAN metadata; output second ZIP #10

merged 12 commits into from
Sep 11, 2024

Commits on Sep 10, 2024

  1. chore: update yoyo migrations; add VS Code helper

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    a141f4c View commit details
    Browse the repository at this point in the history

  2. chore: add and tidy config vars

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    465f853 View commit details
    Browse the repository at this point in the history

  3. feat: turn caching on CDN off

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    10f865b View commit details
    Browse the repository at this point in the history

  4. chore: env var for wait time; urblib warnings off

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    398cd8e View commit details
    Browse the repository at this point in the history

  5. test: update test env

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    7e4a898 View commit details
    Browse the repository at this point in the history

  6. test: tests for utility functions

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    2d47299 View commit details
    Browse the repository at this point in the history

  7. test: tests for fetching, storing CKAN metadata

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    3377c9d View commit details
    Browse the repository at this point in the history

  8. test: tests for new ZIP file creation

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    63040d7 View commit details
    Browse the repository at this point in the history

  9. chore: utility functions for new features

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    dc39f9c View commit details
    Browse the repository at this point in the history

  10. feat: store CKAN metadata 

    * Database migrations
* Download CKAN publisher, dataset metadata
* Save to DB
* Redone indexing code to avoid including legacy metadata in JSON index
    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    bbdabd6 View commit details
    Browse the repository at this point in the history

  11. feat: second ZIP file format 

    * Added code to make outputting of new ZIP file formats easier
* Implemented a second ZIP format, which is stripped down version of legacy Data Dump
    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    aa188d5 View commit details
    Browse the repository at this point in the history

  12. chore: update release targets ready for release

    @simon-20
    simon-20 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    d8dd0c6 View commit details
    Browse the repository at this point in the history