Confluent Kafka Engineer
Datamatics Technologies1 day ago
Lahore, PakistanSenior / Staff+
Responsibilities
- Install, configure, administer, and support Apache Kafka and Confluent Platform across development, UAT, and production environments.
- Manage Kafka brokers, topics, partitions, replication, retention policies, capacity planning, upgrades, patches, rolling restarts, and cluster scaling.
- Deploy and maintain Schema Registry, Kafka Connect, Control Center, and related Kafka ecosystem services.
- Troubleshoot broker performance, partitions, ISR, replication, consumer lag, latency, throughput, storage, connectivity, and production incidents.
- Implement Kafka security controls including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support Java and Spring Boot Kafka producer and consumer integrations.
- Collaborate with application, infrastructure, DevOps, and security teams to onboard workloads and promote environments.
- Contribute to CI/CD, deployment automation, release management, and configuration control.
- Perform health monitoring, performance optimization, capacity forecasting, incident response, and root cause analysis.
- Create operational documentation, deployment guidelines, configuration standards, disaster recovery procedures, and runbooks.
- Support high availability, backup and recovery, disaster recovery, and multi-cluster replication strategies.
Requirements
- 5–10 years of experience supporting Confluent Kafka or Apache Kafka environments.
- Bachelor's degree or higher in Computer Science, Information Technology, Engineering, or a related discipline.
- Proven hands-on production experience with Apache Kafka and Confluent Platform.
- Strong understanding of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention policies, and delivery guarantees.
- Experience with Kafka installation, configuration, upgrades, patch management, and operational support.
- Strong Java and Spring Boot development and integration experience for Kafka-based applications.
- Expertise in Linux administration, networking, JVM performance, production troubleshooting, and operational support.
- Experience implementing Kafka security with TLS/mTLS, SASL, ACLs, and certificate management.
- Practical experience with data streaming platforms and real-time event-driven architectures.
- Preferred experience with Kubernetes, OpenShift, Anthos, Helm, and containerized Kafka deployments.
- Preferred familiarity with Kafka Connect, Schema Registry, and Confluent Control Center.
- Preferred experience with Jenkins, GitLab CI, Azure DevOps, or similar CI/CD tools.
- Preferred monitoring and observability experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring solutions.
- Preferred knowledge of Kafka disaster recovery, multi-cluster deployments, replication strategies, and migration projects.
- Experience in banking, telecommunications, or other business-critical enterprise domains is preferred.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.