Overview
DQL enables you to run high-performance SQL queries directly on delimited, fixed width, CSV, Parquet, JSON, and Excel files, in addition to heterogenous RDBMS connections simultaneously. It uses a zero-copy architecture (powered by Apache Arrow) to deliver instant results, even for enterprise scale datasets.
You can directly connect to multiple remote data sources (databases, file systems, etc.), execute queries which hit these databases simultaneously, and even identify cross-system data lineage.
Launch: Q3 2026 (Interactive Use - Translation Engine, VSIX), Q4 2027 (Programmatic Use - API, CLI)
You can directly connect to multiple remote data sources (databases, file systems, etc.), execute queries which hit these databases simultaneously, and even identify cross-system data lineage.
Launch: Q3 2026 (Interactive Use - Translation Engine, VSIX), Q4 2027 (Programmatic Use - API, CLI)
Key Highlights
Run SQL directly on any database system or file format while DQL abstracts the ETL pipeline for you
Track data lineage from source to sink, throughout your data pipeline
Single SQL dialect to govern heterogenous RDBMS querying
Project Info
Status
Prototype
Category
ETL
Tech Stack
Rust
UNIX
TypeScript
Apache Arrow
VS Code Extension API