Dremio · posted · checked
Senior Staff Software Engineer – Query Engine
AWSAzureGCPJavaSQLRemote · PortugalStaff+
Who can apply
Remote · Portugal
Location: Portugal - Remote
Be Part of Building the Future
Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at www.dremio.com.
About the role
Dremio's Query Planner & Reflections team owns the SQL planner and optimizer, built on Apache Calcite, and the reflections engine that transparently rewrites queries to use pre-computed materializations instead of raw source data. The team sits between SQL and execution, owning the systems that turn queries into efficient plans and make them fast.
As a Senior Staff Software Engineer, you'll set technical direction for these systems: driving ambiguous, cross-team initiatives, raising the bar through design and code review, and growing other senior engineers. Your work will directly affect query performance, correctness, and cost across Dremio's cloud data platform.
What you'll be doing
Set technical direction: Define architecture and roadmap for the query planner and reflections systems, including next-generation features.
Build the planner: Design, implement, test, and support planning rules, cost-based optimization, query rewriting, and reflection matching and substitution.
Own complex initiatives: Lead design and delivery of projects that cross team boundaries, working with Query Execution, Catalog, Datalake, and Product.
Work with open source: Work deeply with Apache Calcite and Apache Iceberg, and drive contributions upstream where it benefits Dremio.
Diagnose difficult problems: Investigate query planning correctness and performance issues, including reflection matching, using query profiles, telemetry, benchmarks, logs, and production data.
Design for every deployment: Build systems that run correctly across Dremio's deployment models and public clouds.