data:csv:chunk
Splits a large CSV file into smaller chunk files of a fixed row count
Options
| Name | Type | Description |
|---|---|---|
input_file | string | Path to the CSV file to split |
output_file | string | Base path used to derive chunk file names |
output_file_prefix | string | Prefix prepended to each chunk file name (defaults to "chunk_") |
output_separator | string | Field separator for output chunk files |
size | int | Number of data rows per chunk |
header | bool | When true, the header row is written to every chunk file |
Outputs
| Name | Type | Description |
|---|---|---|
files | []string | List of paths for the created chunk files |
chunks | int | Total number of chunk files created |
records | int | Total number of data rows split across all chunks |