Lead Confluent Kafka Engineer
Datamatics Technologies1 day ago
Islamabad, PakistanSenior / Staff+
Responsibilities
- Deploy, configure, administer, upgrade, patch, and expand Apache Kafka and Confluent Platform environments across development, UAT, and production.
- Manage Kafka brokers, topics, partitions, replication, retention, capacity, consumer lag, throughput, latency, and cluster health.
- Support Schema Registry, Kafka Connect, Control Center, Java/Spring Boot Kafka applications, and producer/consumer integrations.
- Configure Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Perform troubleshooting, performance tuning, incident management, root-cause analysis, capacity planning, backup/restore, disaster recovery, and multi-cluster replication support.
- Support CI/CD pipelines, deployment automation, configuration management, release activities, monitoring, operational documentation, and recovery runbooks.
- Collaborate with application, DevOps, infrastructure, and security teams to onboard Kafka use cases and promote changes across environments.
Requirements
- 5 to 10 years of experience in Kafka or related production engineering work.
- Bachelor’s degree in a relevant field.
- Strong hands-on production experience with Apache Kafka and Confluent Platform.
- Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
- Hands-on experience with Kafka deployment, configuration, upgrades, patching, and operational maintenance.
- Strong Java and Spring Boot experience for Kafka producer and consumer integrations.
- Strong Linux, networking, JVM, troubleshooting, and production-support skills.
- Experience with Kafka security, including TLS/mTLS, SASL, ACLs, and certificates.
- Experience with data streaming and Confluent Kafka.
- Experience with Kubernetes, OpenShift, Anthos, Helm, containerized Kafka deployments, Kafka Connect, Schema Registry, or Confluent Control Center is preferred.
- CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent is preferred.
- Monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools is preferred.
- Experience with Kafka disaster recovery, multi-cluster architectures, replication, migration activities, or mission-critical banking and telecom environments is preferred.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.