Sumo Logic · posted · checked
Software Engineer II
AWSKafkaTerraformOn-site · Uttar PradeshMid-level
Who can apply
On-site · Uttar Pradesh
Location: Noida , Uttar Pradesh , India
Software Engineer - II, Kafka Infrastructure
Summary of role
Kafka is the backbone of how data moves through Sumo Logic, and every team that builds on it needs clusters that are predictable, reliable and easy to manage. As a Software Engineer within the Kafka Infrastructure team, you will build and maintain the tools and frameworks that manage the full lifecycle of Kafka clusters at Sumo Logic. The team acts as the platform and center of excellence for Kafka, with the long-term goal of unifying Kafka operations under a single, consistent usage pattern. You will contribute to the automation that lets teams spin up, tear down, migrate and manage Kafka clusters and topics themselves, as part of Sumo Logic's internal Platform-as-a-Service.
Responsibilities
Build and maintain automation and tooling for the Kafka cluster lifecycle: provisioning, upgrades, scaling, failover and migration
Develop and own the self-service interfaces teams use to consume Kafka (Terraform modules, CLI tools, APIs, dashboards), with predictable, versioned behavior
Maintain and evolve the team's core components, including cluster balancing, consumer-lag monitoring, schema management, cluster-to-cluster data migration, Kafka-to-S3 backup and hardened machine images
Improve observability and operational practices for Kafka across the organization, and drive standardization of tooling
Provide second-level support for Kafka clusters, and participate in the on-call rotation (with an eventual move into the PaaS global on-call rotation)
Educate and collaborate with application teams through onboarding sessions, documentation and migration guides, and consult on partitioning, consumer-group and schema best practices
Evaluate and test new Kafka technologies and designs, and make recommendations
Write detailed design documents and documentation on system design and implementation