Skip to content

glob

Scan files using * based glob statement and open all files as input.

Parameters

Name Description
storeFilename Store value of filename in parameter each row
input Path of avro object file to transform
xml xmlLoad configutation
table Run transform pipeline on a TSV or CSV
json Run a transform pipeline on a multi line json file
avro Load data from avro file

Example

inputs:
  pubmedRead:
    glob:
      path: "{{params.baseline}}/*.xml.gz"
      xml: {}