Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create workflow to download massive gdir data using wget #83

Open
JordiBolibar opened this issue Nov 28, 2022 · 2 comments
Open

Create workflow to download massive gdir data using wget #83

JordiBolibar opened this issue Nov 28, 2022 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@JordiBolibar
Copy link
Member

In order to speed up the download of large amounts of data related to gdirs it is better to use a routine based on wget, pulling from this url: https://cluster.klima.uni-bremen.de/~oggm/gdirs/oggm_v1.6/L1-L2_files/elev_bands/RGI62/b_010/L2/

The command should be the following one:

wget --recursive --no-parent --cut-dirs=3 -nH -R "index.html*" https://cluster.klima.uni-bremen.de/~oggm/path/to/your/prepro/
@JordiBolibar JordiBolibar added the enhancement New feature or request label Nov 28, 2022
@JordiBolibar JordiBolibar added this to the Second ODINN release milestone Nov 28, 2022
@JordiBolibar JordiBolibar self-assigned this Nov 28, 2022
@mauro3
Copy link

mauro3 commented Apr 30, 2023

Does the standard lib Downloads.download not work ok? That one is based on curl which should be about as good as wget.

@JordiBolibar
Copy link
Member Author

I did try Downloads.download, but for some reason it was not working correctly. This is quite old, so I need to dive into this again :)

@JordiBolibar JordiBolibar removed this from the Second ODINN release milestone Jun 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants