[ENH]: Allow users to select types for datagrabbers in order to avoid downloading unnecesary data.

[synchon]

Are you requiring a new dataset or marker?

• I understand this is not a marker or dataset request

Which feature do you want to include?

Datalad-based datasets such as DataladAOMICID1000, DataladAOMICPIOP1 and DataladAOMICPIOP2 have several data types including BOLD, T1w, DWI, etc.

So far, the types parameter is not exposed to the constructor, os a user that only requires one data type, will be forced to datalad get all the data.

How do you imagine this integrated in junifer?

easy, as with the tasks parameter, expose the types one.

Do you have a sample code that implements this outside of junifer?

No response

Anything else to say?

No response

[github-actions]

PR Preview Action v1.4.4
Preview removed because the pull request was closed.
2023-07-21 11:33 UTC

[codecov]

Codecov Report

Merging #132 (dd06c61) into main (a451a98) will decrease coverage by 0.02%.
The diff coverage is 94.87%.

❗ Current head dd06c61 differs from pull request most recent head 7fa55c6. Consider uploading reports for the commit 7fa55c6 to get more accurate results

@@            Coverage Diff             @@
##             main     #132      +/-   ##
==========================================
- Coverage   93.12%   93.10%   -0.02%     
==========================================
  Files          84       84              
  Lines        3695     3714      +19     
  Branches      709      722      +13     
==========================================
+ Hits         3441     3458      +17     
  Misses        160      160              
- Partials       94       96       +2     

Flag	Coverage Δ
docs	100.00% <ø> (ø)
junifer	93.10% <94.87%> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
junifer/datagrabber/aomic/piop1.py	97.61% <90.90%> (-2.39%)	⬇️
junifer/datagrabber/aomic/piop2.py	97.43% <94.44%> (-2.57%)	⬇️
junifer/datagrabber/aomic/id1000.py	100.00% <100.00%> (ø)
junifer/datagrabber/utils.py	100.00% <100.00%> (ø)

[fraimondo]

Can we add a test to check what happens when the user passes a type that is not defined in the datagrabber? I guess the validate_patterns should fail.

[synchon]

Can we add a test to check what happens when the user passes a type that is not defined in the datagrabber? I guess the validate_patterns should fail.

I believe they are there, can you please check the tests with the name like test_<datagrabber>_incorrect_data_type()?