Lead Confluent Kafka Engineer
Datamatics Technologies1 day ago
Lahore, PakistanSenior / Staff+
Responsibilities
- Deploy, configure, administer, upgrade, patch, and maintain Apache Kafka and Confluent Platform across development, UAT, and production environments.
- Provision and manage Kafka brokers, topics, partitions, replication, retention, capacity, cluster expansion, and rolling restarts.
- Troubleshoot production issues involving brokers, ISR, consumer lag, throughput, latency, storage, connectivity, and replication.
- Configure Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support Java and Spring Boot Kafka producer and consumer deployments and integration troubleshooting.
- Support Kafka Connect, Schema Registry, Control Center, CI/CD pipelines, deployment automation, monitoring, incident management, disaster recovery, backup/restore, and multi-cluster replication.
- Maintain operational documentation, deployment procedures, configuration standards, recovery documentation, and runbooks while collaborating with application, DevOps, infrastructure, and security teams.
Requirements
- Minimum bachelor’s degree in a relevant field.
- 5 to 10 years of experience.
- Strong hands-on production experience with Apache Kafka and Confluent Platform, including deployment, configuration, upgrades, patching, and operational maintenance.
- Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
- Strong Java and Spring Boot experience for Kafka producer and consumer integrations.
- Strong Linux, networking, JVM, troubleshooting, and production-support skills.
- Experience configuring Kafka security, particularly TLS/mTLS, SASL, ACLs, and certificates.
- Data streaming experience.
- Preferred experience with Kubernetes, OpenShift, Anthos, Helm, containerized Kafka deployments, Kafka Connect, Schema Registry, Confluent Control Center, CI/CD tools, monitoring platforms, disaster recovery, multi-cluster architectures, replication, migrations, and mission-critical banking or telecom environments.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.