Lead Confluent Kafka Engineer
Datamatics Technologies3 days ago
Karachi, PakistanSenior / Staff+
Responsibilities
- Deploy, configure, maintain, upgrade, patch, and expand Apache Kafka and Confluent Platform environments across development, UAT, and production.
- Manage Kafka clusters, brokers, topics, partitions, replication, retention, capacity, health checks, performance tuning, and high availability.
- Troubleshoot production issues involving ISR, consumer lag, throughput, latency, storage, connectivity, and replication.
- Configure Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support Java and Spring Boot Kafka producer and consumer deployments and integration troubleshooting.
- Support Kafka Connect, Schema Registry, Control Center, CI/CD pipelines, deployment automation, configuration management, and release activities.
- Collaborate with application, DevOps, infrastructure, and security teams to onboard Kafka use cases and promote changes across environments.
- Perform incident management, root-cause analysis, disaster recovery, backup and restore, multi-cluster replication, and migration support.
- Maintain operational documentation, deployment procedures, configuration standards, recovery documentation, and runbooks.
Requirements
- 5 to 10 years of experience in Confluent Kafka engineering or related production operations.
- Minimum bachelor's degree in a relevant field.
- Strong hands-on production experience with Apache Kafka and Confluent Platform, including deployment, configuration, upgrades, patching, and operational maintenance.
- Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
- Strong Java and Spring Boot experience for Kafka producer and consumer integrations.
- Strong Linux, networking, JVM, troubleshooting, and production-support skills.
- Experience with Kafka security, including TLS/mTLS, SASL, ACLs, and certificates.
- Experience with data streaming.
- Preferred experience with Kubernetes, OpenShift, Anthos, Helm, Kafka Connect, Schema Registry, Confluent Control Center, CI/CD tools, monitoring tools, disaster recovery, multi-cluster architectures, replication, migrations, and mission-critical banking or telecom environments.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.