Junior Kafka Engineer
Datamatics Technologies14 hours ago
Islamabad, PakistanEntry Level
Responsibilities
- Support deployment, configuration, maintenance, provisioning, upgrades, patching, rolling restarts, and expansion of Apache Kafka and Confluent Platform environments.
- Manage Kafka topics, partitions, replication, retention, capacity, brokers, consumer lag, offsets, and cluster health across development, UAT, and production.
- Support Kafka components including Schema Registry, Kafka Connect, and Confluent Control Center.
- Monitor and troubleshoot Kafka performance, availability, storage, connectivity, replication, application integration, and production incidents.
- Configure and maintain Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Assist with Java and Spring Boot Kafka application deployments, including producer and consumer configuration and integration troubleshooting.
- Support CI/CD pipelines, deployment automation, configuration management, release activities, disaster recovery, backup/restore, and multi-cluster replication.
- Collaborate with application, DevOps, infrastructure, and security teams to onboard Kafka use cases and promote changes across environments.
- Maintain operational documentation, deployment procedures, configuration standards, troubleshooting guides, and runbooks.
Requirements
- Minimum 3 years of relevant IT or software engineering experience with hands-on Apache Kafka or Confluent Platform exposure.
- Hands-on experience working with Apache Kafka in development or production environments.
- Understanding of Kafka architecture, including brokers, topics, partitions, replication, ISR, consumer groups, producers, consumers, offsets, retention, and delivery semantics.
- Experience with Kafka deployment, configuration, administration, monitoring, and operational maintenance.
- Hands-on knowledge of Java and Spring Boot for Kafka producer and consumer integrations.
- Working knowledge of Linux, networking fundamentals, JVM concepts, troubleshooting, and production support.
- Understanding or hands-on experience with Kafka security, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Ability to troubleshoot Kafka issues involving consumer lag, broker connectivity, partitions, replication, offsets, and application integrations.
- Exposure to Kubernetes, OpenShift, Anthos, Helm, Docker, or containerized Kafka deployments is preferred.
- Familiarity with Kafka Connect, Schema Registry, Confluent Control Center, CI/CD tools, monitoring tools, disaster recovery, replication, migration, capacity planning, and performance tuning is preferred.
- Experience with Kafka in banking, telecom, financial services, or other mission-critical environments is preferred.
- Minimum bachelor's degree in Computer Science, Software Engineering, Information Technology, or a relevant field.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Apache KafkaDockerGitLab CI/CDGrafanaHelmJavaJenkinsKubernetesLinuxOpenShiftPrometheusSplunkSpring Boot
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.