
Software Engineer II
Sumo Logic2 days ago
Noida, IndiaMid Level
Responsibilities
- Build and maintain automation for the Kafka cluster lifecycle, including provisioning, upgrades, scaling, failover, and migration.
- Develop and own self-service Kafka interfaces such as Terraform modules, CLI tools, APIs, and dashboards.
- Maintain cluster balancing, consumer-lag monitoring, schema management, cluster-to-cluster migration, Kafka-to-S3 backup, and hardened machine-image components.
- Improve Kafka observability and operational practices and standardize tooling across the organization.
- Provide second-level support for Kafka clusters and participate in Kafka and PaaS on-call rotations.
- Educate and collaborate with application teams through onboarding, documentation, migration guides, and Kafka architecture consultation.
- Evaluate and test Kafka technologies and designs and write detailed system design and implementation documentation.
Requirements
- Bachelor's or Master's degree in Computer Science or another scientific or technical discipline.
- At least 2 years of software development experience in Java, Scala, Golang, or a similar language.
- At least 1 year of hands-on Apache Kafka experience covering brokers, topics, partitions, replication, and consumer groups.
- Understanding of Kafka internals and operations, including partition reassignment, rebalancing, leader election, in-sync replicas, retention, compaction, and performance tuning.
- Experience with cloud platforms such as AWS, Azure, or GCP, with AWS preferred.
- Proficiency with Terraform and scripting languages such as Python or Bash.
- Comfort with Linux administration and troubleshooting distributed systems in production.
- Familiarity with Prometheus, Grafana, or similar monitoring tools, including consumer-lag monitoring.
- Knowledge of Kafka security aspects including TLS, authentication, and authorization.
- Preferred experience with Cruise Control, Schema Registry, Kafka Connect, MirrorMaker, Packer, Kubernetes, GitOps, CLI tools, or internal developer platforms.
Tech Stack
Apache KafkaAWSAzureBashGoGoogle Cloud PlatformGrafanaJavaKubernetesLinuxPrometheusPythonScalaTerraform
Categories
About Sumo Logic
Sumo Logic builds a cloud-native SaaS platform for log management, security analytics (SIEM), and observability used by DevOps and security teams to monitor and troubleshoot applications and infrastructure. Founded in 2010 and headquartered in Redwood City, California, it was acquired by Francisco Partners and taken private in 2023. The business is subscription-based and supports cloud and hybrid environments.