Batch size

[hiroyukioya]

Describe the issue:

not an issue, but if I have recording of duration of 5min, can we use batch size of 5min instead of 2sec? What is your expectation?

Reproduce the bug:

No response

Error message:

No response

Version information:

v 4.0.12

[jacobpennington]

Depending on how many channels your data has, the sorting is likely to fail due to insufficient memory. Sorting is broken up into small batches for more efficient processing, and dramatically increasing the batch size will undo that. As for how that might affect the actual sorting results (assuming you're able to run it), @marius10p would be a better person to answer that.

[marius10p]

It means you won't get good drift correction anymore, since there is one drift per batch, and yes, it will probably run out of GPU RAM too. The edges of the batch should be dealt with correctly by Kilosort4 if that is what you are worried about.

[hiroyukioya]

Thank you. That is a great info.
I could run it with 5 min batch size (we have small channel count and drift estimation is off). In terms of sorting results, what do you expect the effect of batch size (better for longer batch)?