Confluent Kafka Engineer
Datamatics Technologies1 day ago
Islamabad, PakistanSenior / Staff+
Responsibilities
- Install, configure, administer, upgrade, patch, scale, and provide operational support for Apache Kafka and Confluent Platform across development, UAT, and production environments.
- Manage Kafka brokers, topics, partitions, replication, retention policies, capacity planning, consumer lag, performance, and cluster stability.
- Deploy and maintain Schema Registry, Kafka Connect, Control Center, and related Kafka ecosystem services.
- Configure and maintain Kafka security controls including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support and troubleshoot Java and Spring Boot Kafka producer and consumer applications.
- Collaborate with application, infrastructure, DevOps, and security teams to onboard workloads and promote environments.
- Contribute to CI/CD, deployment automation, release management, and configuration control.
- Perform health monitoring, performance optimization, capacity forecasting, incident response, root cause analysis, and production troubleshooting.
- Create operational documentation, deployment guidelines, configuration standards, disaster recovery procedures, and runbooks.
- Support high availability, backup and recovery, disaster recovery, multi-cluster replication, and migration activities.
Requirements
- 5–10 years of experience supporting Confluent Kafka and Apache Kafka in production environments.
- Bachelor's degree or higher in Computer Science, Information Technology, Engineering, or a related discipline.
- Strong understanding of Kafka architecture, including brokers, partitions, replication, ISR, consumer groups, offsets, retention policies, and delivery guarantees.
- Hands-on experience with Kafka installation, configuration, upgrades, patch management, and ongoing operational support.
- Strong Java and Spring Boot development and integration experience for Kafka-based applications.
- Expertise in Linux administration, networking, JVM performance, production troubleshooting, and operational support.
- Experience implementing and managing Kafka security with TLS/mTLS, SASL, ACLs, and certificate management.
- Practical experience with data streaming platforms and real-time event-driven architectures.
- Preferred experience with Kubernetes, OpenShift, Anthos, Helm, and containerized Kafka deployments.
- Preferred familiarity with Kafka Connect, Schema Registry, Confluent Control Center, CI/CD platforms, monitoring, observability, disaster recovery, multi-cluster deployments, and enterprise environments.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.