Junior Kafka Engineer
Datamatics Technologies14 hours ago
Lahore, PakistanEntry Level
Responsibilities
- Support deployment, configuration, maintenance, upgrades, patching, rolling restarts, expansion, and capacity management for Apache Kafka and Confluent Platform.
- Administer Kafka brokers, topics, partitions, replication, retention, consumer groups, offsets, and related cluster settings across development, UAT, and production environments.
- Support Schema Registry, Kafka Connect, Confluent Control Center, Kafka security, high availability, disaster recovery, backup and restore, and multi-cluster replication activities.
- Monitor and troubleshoot Kafka issues involving brokers, partitions, ISR, consumer lag, throughput, latency, storage, connectivity, performance, and availability.
- Assist with Java and Spring Boot Kafka producer and consumer deployments and integration troubleshooting.
- Support CI/CD pipelines, deployment automation, configuration management, release activities, health checks, incident troubleshooting, root-cause analysis, and production support.
- Maintain operational documentation, deployment procedures, configuration standards, troubleshooting guides, and runbooks.
- Collaborate with application, DevOps, infrastructure, and security teams to onboard Kafka use cases and promote changes across environments.
Requirements
- Minimum 3 years of relevant IT or software engineering experience with hands-on Apache Kafka or Confluent Platform exposure.
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a relevant field.
- Hands-on Apache Kafka experience in development or production environments, including deployment, configuration, administration, monitoring, and operational maintenance.
- Understanding of Kafka architecture, including brokers, topics, partitions, replication, ISR, consumer groups, producers, consumers, offsets, retention, and delivery semantics.
- Hands-on knowledge of Java and Spring Boot for Kafka producer and consumer integrations.
- Working knowledge of Linux, networking fundamentals, JVM concepts, troubleshooting, and production support.
- Understanding or hands-on experience with Kafka security, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Ability to troubleshoot Kafka issues involving consumer lag, broker connectivity, partitions, replication, offsets, and application integrations.
- Preferred exposure to Kubernetes, OpenShift, Anthos, Helm, Docker, and containerized Kafka deployments.
- Preferred familiarity with Kafka Connect, Schema Registry, Confluent Control Center, Kafka disaster recovery, multi-cluster architectures, replication, migration, capacity planning, performance tuning, and mission-critical environments.
- Preferred CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent tools and monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Apache KafkaDockerGitLab CI/CDGrafanaHelmJavaJenkinsKubernetesLinuxOpenShiftPrometheusSplunkSpring Boot
Categories
Data EngineeringDevOps
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.