Confluent Kafka Engineer
Datamatics Technologies1 day ago
Karachi, PakistanSenior / Staff+
Responsibilities
- Install, configure, administer, and support Apache Kafka and Confluent Platform across development, UAT, and production environments.
- Manage Kafka brokers, topics, partitions, replication, retention policies, capacity planning, upgrades, patches, rolling restarts, configuration updates, and cluster scaling.
- Deploy and maintain Schema Registry, Kafka Connect, Control Center, and related Kafka services.
- Troubleshoot broker performance, partitions, ISR, replication, consumer lag, latency, throughput, storage, connectivity, and Java/Spring Boot Kafka applications.
- Configure Kafka security controls including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Collaborate with application, infrastructure, DevOps, and security teams to onboard workloads and promote environments.
- Support CI/CD, deployment automation, release management, configuration control, health monitoring, performance optimization, incident response, and root cause analysis.
- Create operational documentation, deployment guidelines, configuration standards, disaster recovery procedures, and runbooks.
- Support high availability, backup and recovery, disaster recovery, and multi-cluster replication architectures.
Requirements
- 5-10 years of relevant experience supporting Apache Kafka or Confluent Platform in production environments.
- Bachelor's degree or higher in Computer Science, Information Technology, Engineering, or a related discipline.
- Strong understanding of Kafka architecture, including brokers, partitions, replication, ISR, consumer groups, offsets, retention policies, and delivery guarantees.
- Hands-on experience with Kafka installation, configuration, upgrades, patch management, and operational support.
- Strong Java and Spring Boot development and integration experience for Kafka-based applications.
- Expertise in Linux administration, networking, JVM performance, production troubleshooting, and operational support.
- Experience implementing Kafka security with TLS/mTLS, SASL, ACLs, and certificate management.
- Practical experience with data streaming platforms and real-time event-driven architectures.
- Preferred experience with Kubernetes, OpenShift, Anthos, Helm, and containerized Kafka deployments.
- Preferred familiarity with Kafka Connect, Schema Registry, Confluent Control Center, CI/CD platforms, monitoring, observability, disaster recovery, multi-cluster deployments, replication, and migration projects.
- Experience in banking, telecommunications, or other business-critical enterprise domains is preferred.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.