Lead Confluent Kafka Engineer
Datamatics Technologies1 day ago
Karachi, PakistanSenior / Staff+
Responsibilities
- Deploy, configure, maintain, upgrade, patch, and expand Apache Kafka and Confluent Platform environments across development, UAT, and production.
- Manage Kafka brokers, topics, partitions, replication, retention, capacity, rolling restarts, and cluster configuration.
- Support Schema Registry, Kafka Connect, Control Center, Java/Spring Boot Kafka applications, and producer/consumer integrations.
- Troubleshoot production issues involving replication, ISR, consumer lag, throughput, latency, storage, connectivity, and cluster health.
- Configure Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support CI/CD pipelines, deployment automation, configuration management, release activities, health checks, performance tuning, incident management, and root-cause analysis.
- Maintain operational documentation, recovery runbooks, backup and restore procedures, high-availability configurations, disaster recovery, and multi-cluster replication.
Requirements
- 5 to 10 years of experience supporting Apache Kafka or Confluent Platform in production.
- Minimum bachelor's degree in a relevant field.
- Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
- Hands-on experience with Kafka deployment, configuration, upgrades, patching, operational maintenance, and data streaming.
- Strong Java and Spring Boot experience for Kafka producer and consumer integrations.
- Strong Linux, networking, JVM, troubleshooting, and production-support skills.
- Experience configuring Kafka security, particularly TLS/mTLS, SASL, ACLs, and certificates.
- Preferred experience with Kubernetes, OpenShift, Anthos, Helm, containerized Kafka deployments, Kafka Connect, Schema Registry, and Confluent Control Center.
- Preferred CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent tools.
- Preferred monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools.
- Preferred experience with Kafka disaster recovery, multi-cluster architectures, replication, migration activities, and banking, telecom, or other mission-critical environments.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.