Coderio · posted · checked
Senior Data Engineer
AWSDockerGCPPythonSQLOn-site · Los Angeles, Miami and New YorkSenior
Who can apply
On-site · Los Angeles, Miami and New York
- “Work Location / Employment: US-based (Remote / Hybrid) — Must be authorized to work in the United States.”
Location: California / Los Angeles / Miami, Florida / New York / New York City Metropolitan Area / Nueva Jersey / Washington
Senior Data Engineer - USA
Job Overview
We are looking for a Senior Data Engineer based in the US to design, build, and maintain robust data pipelines and scalable infrastructure across our cloud platform. In this role, you will play a key part in enabling Data Products throughout their lifecycle—sourcing data via batch and stream processing, optimizing data architecture, and ensuring data quality. You will collaborate closely with Data Scientists and ML Engineers to automate workflows and deploy resilient data pipelines in production.
Work Location / Employment: US-based (Remote / Hybrid) — Must be authorized to work in the United States.
Tech Stack & Key Technologies
Cloud Platforms: AWS (Redshift, Glue, EMR, MWAA, S3) & GCP (BigQuery, Cloud Storage)
Languages & Frameworks: Python, PySpark, SQL (advanced optimization & tuning)
Data Engineering & Ops: Batch & Stream Processing, ETL/ELT Pipelines, Data Modeling, Data Warehousing, Orchestration
DevOps, Infrastructure & Tools: Docker, Terraform, CI/CD pipelines, UNIX/Linux environments, MLOps best practices
Key Responsibilities
Pipeline Architecture & Development: Design, build, and deploy scalable, decoupled, and high-performance data pipelines for batch and streaming data ingestion into Data Lakes and Data Warehouses.
ETL/ELT Processing: Develop and optimize efficient data pipelines using Python, PySpark, and advanced SQL.
Collaboration with ML & Data Science: Partner with Data Scientists and ML Engineers to build resilient pipelines, automate MLOps workflows, and gather model interaction data to support retraining loops.
Performance Optimization & Monitoring: Continuously monitor, troubleshoot, and optimize pipeline execution, query performance, and storage resource utilization across cloud platforms.