Lead Confluent Kafka Engineer
Datamatics Technologies3 days ago
Islamabad, PakistanSenior / Staff+
Responsibilities
- Deploy, configure, maintain, upgrade, patch, and expand Apache Kafka and Confluent Platform environments.
- Provision and administer Kafka brokers, topics, partitions, replication, retention, capacity, and cluster configurations.
- Support Schema Registry, Kafka Connect, Control Center, and Kafka-based Java/Spring Boot applications.
- Troubleshoot production issues involving brokers, ISR, replication, consumer lag, throughput, latency, storage, connectivity, and application integrations.
- Manage Kafka security configurations including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support CI/CD pipelines, deployment automation, configuration management, release activities, and environment promotion.
- Perform health checks, capacity planning, performance tuning, incident management, root-cause analysis, and operational documentation.
- Support high availability, disaster recovery, backup and restore, multi-cluster replication, migration, and recovery procedures.
Requirements
- Bachelor’s degree in a relevant field.
- 5 to 10 years of experience supporting Kafka and Confluent Platform in production.
- Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
- Hands-on experience with Kafka deployment, configuration, upgrades, patching, operational maintenance, and production support.
- Strong Java and Spring Boot experience for Kafka producer and consumer integrations.
- Strong Linux, networking, JVM troubleshooting, and production-support skills.
- Experience with Kafka security, including TLS/mTLS, SASL, ACLs, and certificates.
- Experience with data streaming and Confluent Kafka.
- Experience with Kubernetes, OpenShift, Anthos, Helm, containerized Kafka deployments, Kafka Connect, Schema Registry, or Confluent Control Center is preferred.
- Experience with Jenkins, GitLab CI, Azure DevOps, monitoring tools, Kafka disaster recovery, multi-cluster architectures, replication, or migration is preferred.
- Experience supporting Kafka in banking, telecom, or other mission-critical environments is preferred.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.