Lead Confluent Kafka Engineer
Datamatics Technologies3 days ago
Lahore, PakistanSenior / Staff+
Responsibilities
- Deploy, configure, maintain, upgrade, patch, and expand Apache Kafka and Confluent Platform environments across development, UAT, and production.
- Provision and manage Kafka brokers, topics, partitions, replication, retention, capacity, rolling restarts, and configuration changes.
- Support Schema Registry, Kafka Connect, Control Center, and related Kafka services.
- Troubleshoot production issues involving brokers, partitions, ISR, replication, consumer lag, throughput, latency, storage, and connectivity.
- Configure Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support Java and Spring Boot Kafka application deployments, producer/consumer configuration, and integration troubleshooting.
- Collaborate with application, DevOps, infrastructure, and security teams to onboard Kafka use cases and promote changes across environments.
- Support CI/CD pipelines, deployment automation, configuration management, and release activities.
- Perform health checks, capacity planning, performance tuning, incident management, and root-cause analysis.
- Maintain operational documentation, deployment procedures, configuration standards, recovery documentation, and runbooks.
- Support high availability, disaster recovery, backup and restore, and multi-cluster replication requirements.
Requirements
- 5 to 10 years of experience supporting Apache Kafka or Confluent Platform in production.
- Bachelor’s degree in a relevant field.
- Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
- Hands-on experience deploying, configuring, upgrading, patching, and operationally maintaining Kafka.
- Strong Java and Spring Boot experience for Kafka producer and consumer integrations.
- Strong Linux, networking, JVM, troubleshooting, and production-support skills.
- Experience configuring Kafka security, particularly TLS/mTLS, SASL, ACLs, and certificates.
- Experience with Confluent Kafka and data streaming.
- Experience with Kubernetes, OpenShift, Anthos, Helm, and containerized Kafka deployments is preferred.
- Experience with Kafka Connect, Schema Registry, and Confluent Control Center is preferred.
- CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent is preferred.
- Monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools is preferred.
- Experience with Kafka disaster recovery, multi-cluster architectures, replication, and migration activities is preferred.
- Experience supporting Kafka in banking, telecom, or other mission-critical environments is preferred.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.