csv:unchunk

Combines multiple CSV chunk files back into a single output file

Options

Name	Type	Description
`input_files`	`[]string`	List of chunk file paths to combine
`input_file_suffix`	`string`	Optional suffix appended to each input file name before processing (e.g. "_translated")
`output_file`	`string`	Path for the combined output CSV file
`separator`	`string`	Field separator used in all input and output files
`header`	`bool`	When true, only the first chunk's header is written to the output
`skip_first_header`	`bool`	When true, header mismatches across chunks are ignored instead of causing an error

Outputs

Name	Type	Description
`output_file`	`string`	OutputFile path of the combined output file
`files`	`[]string`	The list of input files that were combined
`records`	`int`	Total number of data rows written to the output

Example

name: Reassemble CSV chunks into one file
actions:
  - name: joined
    component: csv:unchunk
    vars:
      input_files:
        - part-1.csv
        - part-2.csv
      output_file: full.csv
      header: true
      skip_first_header: true

outputs:
  file: "{{ joined.output_file }}"

Edit or read the source on GitHub