Data Set Uploads

Supported File Formats

The platform allows you to upload and work with various data file formats directly without needing external storage connections.

CSV Files

Upload comma-separated value files with these options:

• Delimiter - Comma (,), Semicolon (;), Tab, Pipe (|), or custom
• Header Row - Specify if the first row contains column names
• Encoding - UTF-8, UTF-16, ASCII, ISO-8859-1, etc.
• Quote Character - Character used for text quoting
• Escape Character - Character for escaping special characters
• Skip Rows - Number of rows to skip at the beginning

JSON Files

Upload JSON data files with support for:

• JSON Arrays - Array of objects format
• JSON Lines - Newline-delimited JSON (NDJSON)
• Nested Objects - Automatic flattening of nested structures
• Schema Inference - Automatic data type detection

Parquet Files

Upload Apache Parquet files for efficient columnar data storage:

• Column Selection - Read specific columns for efficiency
• Compression - Support for Snappy, GZIP, LZ4, ZSTD
• Schema Preservation - Maintains original data types
• Row Group Filtering - Efficient partial file reading

Excel Files

Upload Microsoft Excel files (.xlsx, .xls):

• Sheet Selection - Choose specific sheets to import
• Header Row - Specify the row containing column headers
• Data Range - Define a specific cell range to import
• Date Handling - Automatic date format detection

Upload Process

1. Navigate to Connectors → Connect
2. Click "Upload Data Set"
3. Drag and drop files or click to browse
4. Configure import settings based on file type
5. Preview the data to verify correct parsing
6. Click "Import" to add the data set