Program gets killed while computing dataset statistics.

[shantanuparab-tr]

System Info

- `lerobot` version: 0.1.0
- Platform: Linux-6.9.3-76060903-generic-x86_64-with-glibc2.35
- Python version: 3.10.14
- Huggingface_hub version: 0.25.0
- Dataset version: 3.0.0
- Numpy version: 2.1.1
- PyTorch version (GPU?): 2.4.0+cu121 (True)
- Cuda version: 12010
- Using GPU in script?: Yes

Information

• One of the scripts in the examples/ folder of LeRobot
• My own task or dataset (give details below)

Reproduction

This is a system specific bug. High performance systems might not encounter this issue.

1. Run the control_robot.py script in record mode.
2. Complete the data collection process and wait till you reach the "Compute Dataset Statistics" part.
3. After a while your system may crash, thereby, terminating the script.

Expected behavior

Due to lack of resources for parallel computation the system crashes. This is because the compute_stats method uses a batch size of 32 and number of workers as 16.