File Import

File Import Workflows

Explorer allows you to import files from your connected data sources for analysis and processing. This is useful for working with files stored in cloud storage or file servers.

Starting an Import

1. Navigate to Data Catalog → Explorer
2. Select a cloud storage or file server connection
3. Browse to the file or folder you want to import
4. Select files using checkboxes
5. Click "Import Selected"
6. Configure import settings
7. Start the import process

Import Options

Single File Import

Import individual files with these options:

• File Format Detection - Automatic format detection based on extension
• Schema Preview - Preview detected columns and types
• Data Preview - View sample rows before importing
• Destination - Choose where to store the imported data

Bulk Import

Import multiple files at once:

• Folder Import - Import all files in a folder
• Pattern Matching - Filter files by name pattern (*.csv, data_*.json)
• Merge Options - Combine multiple files into one dataset
• Parallel Processing - Speed up imports with concurrent processing

Import Progress

Monitor your import jobs in real-time:

• Progress Bar - Visual indicator of completion
• File Status - Track individual file progress
• Error Handling - View and resolve import errors
• Cancel/Pause - Control running imports

Scheduled Imports

Set up recurring imports for regularly updated data:

• Frequency - Daily, weekly, or custom schedules
• Incremental - Only import new or modified files
• Notifications - Get alerts on import completion or failures
• History - View past import runs and results