Skip to content

Commit

Permalink
Set max_concurrency=1
Browse files Browse the repository at this point in the history
  • Loading branch information
thodson-usgs authored Nov 21, 2023
1 parent d9cbd8a commit 24f7d62
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion recipes/us-ssebop/recipe.py
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ def expand(self, pcoll: beam.PCollection) -> beam.PCollection:

recipe = (
beam.Create(pattern.items())
| OpenURLWithFSSpec(max_concurrency=10, open_kwargs={'compression': 'zip'})
| OpenURLWithFSSpec(max_concurrency=1, open_kwargs={'compression': 'zip'})
| Preprocess()
| StoreToZarr(
store_name='us-ssebop.zarr',
Expand Down

0 comments on commit 24f7d62

Please sign in to comment.