Oddball · posted · checked
Lead Data Engineer
AzurePythonSparkSQLRemote · United StatesStaff+
Who can apply
Remote · United States
- “- Applicants must be authorized to work in the United States.”
- Applicants must be authorized to work in the United States. In alignment with federal contract requirements, certain roles may also require U.S. citi …
Oddball believes that the best products are built when companies understand and value the things they are working on. We value learning and growth and the ability to make a big impact at a small company. We believe that we can make big changes happen and improve the daily lives of millions of people by bringing quality software to the federal space.
This position is contingent upon contract award.
We’re looking for a Lead Data Engineer to join our VA team, setting the technical approach for moving legacy data warehouse data and pipelines onto an Azure and Databricks lakehouse.
What you'll be doing:
Set the technical approach for migrating data and pipelines onto the lakehouse
Guide migration teams on patterns, reconciliation, and quality gates
Design reusable migration pipelines using Azure Data Factory and Azure Databricks
Define how source and target data are reconciled to confirm accuracy
Resolve the hardest pipeline and performance problems
Mentor data engineers and review their work
Partner with product, QA, and platform teams
What you’ll bring:
Data engineering leadership on large migration or modernization programs
Deep experience with Databricks or Spark and Azure Data Factory
Show the full posting
Strong SQL and Python skills
Experience moving legacy ETL and data warehouse workloads to the cloud
Understanding of lakehouse and medallion architecture, including Delta
Experience in federal or regulated data environments is a plus