Junior Kafka Engineer
Datamatics Technologies3 days ago
Karachi, PakistanEntry Level
Responsibilities
- Support deployment, configuration, maintenance, upgrades, patching, rolling restarts, and expansion of Apache Kafka and Confluent Platform environments.
- Assist with Kafka cluster provisioning, broker configuration, topic creation, partitioning, replication, retention, capacity management, and performance analysis.
- Support Schema Registry, Kafka Connect, Confluent Control Center, high availability, disaster recovery, backup and restore, and multi-cluster replication activities.
- Monitor and troubleshoot brokers, partitions, ISR, consumer lag, throughput, latency, storage, connectivity, offsets, and application integrations.
- Configure and support Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Assist with Java and Spring Boot Kafka producer and consumer deployments and integration troubleshooting.
- Support CI/CD pipelines, deployment automation, configuration management, release activities, health checks, incident response, and root-cause analysis.
- Work with application, DevOps, infrastructure, and security teams to onboard Kafka use cases and promote changes across environments.
- Maintain operational documentation, deployment procedures, configuration standards, troubleshooting guides, and runbooks.
Requirements
- Minimum three years of relevant IT or software engineering experience with hands-on Apache Kafka or Confluent Platform exposure.
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a relevant field.
- Hands-on experience working with Apache Kafka in development or production environments.
- Understanding of Kafka architecture, including brokers, topics, partitions, replication, ISR, consumer groups, producers, consumers, offsets, retention, and delivery semantics.
- Experience with Kafka deployment, configuration, administration, monitoring, and operational maintenance.
- Hands-on knowledge of Java and Spring Boot for Kafka producer and consumer integrations.
- Working knowledge of Linux, networking fundamentals, JVM concepts, troubleshooting, and production support.
- Understanding or hands-on experience with Kafka security, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Ability to troubleshoot Kafka issues involving consumer lag, broker connectivity, partitions, replication, offsets, and application integrations.
- Preferred exposure to Kubernetes, OpenShift, Anthos, Helm, Docker, containerized Kafka deployments, and containerized applications.
- Preferred experience with Kafka Connect, Schema Registry, Confluent Control Center, disaster recovery, multi-cluster architectures, replication, migration, capacity planning, performance tuning, and cluster monitoring.
- Preferred CI/CD exposure using Jenkins, GitLab CI, Azure DevOps, or equivalent tools.
- Preferred monitoring experience using Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools.
- Experience with Kafka in banking, telecommunications, financial services, or other mission-critical environments is beneficial.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Apache KafkaDockerGitLab CI/CDGrafanaHelmJavaJenkinsKubernetesLinuxOpenShiftPrometheusSplunkSpring Boot
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.