The Delimited File Connector finds files matching a given pattern in one or more directories, reads the first record in every non-empty file found, and extracts the file metadata and column names.
The Delimited File Connector assumes that all files being scanned have a single header record containing field names. When duplicate field names within the same file are detected, only the first occurrence is kept. The Delimited File Connector supports:
- Text files. Excel spreadsheets and other proprietary formats are not supported.
- The definition of multiple directories.
- Windows local folders, Windows mapped drives, Windows network UNC paths and Linux paths.
- Traversing sub-directories (optional).
- These delimiters: commas, semicolons, pipes and tabs. Note that it is not necessary for all files to have the same delimiter.
- Column names with or without surrounding quotes (can be quotation marks or apostrophes). The delimiter can be in the column name as long as the field is enclosed in quotes.
- Customized file patterns, for example
*.csv. Note that you can only define one file pattern. File pattern exclusions are not supported.
The Delimited File Connector has been tested with English, European and Chinese characters. Emojis are not supported.