Junior Kafka Engineer
Datamatics Technologies3 days ago
Lahore, PakistanEntry Level
Responsibilities
- Support deployment, configuration, maintenance, provisioning, upgrades, patching, rolling restarts, and expansion of Apache Kafka and Confluent Platform environments.
- Manage or assist with Kafka brokers, topics, partitions, replication, retention, capacity, consumer lag, throughput, latency, storage, and connectivity troubleshooting.
- Support Schema Registry, Kafka Connect, Confluent Control Center, high availability, disaster recovery, backup and restore, and multi-cluster replication activities.
- Configure and troubleshoot Kafka security using TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Assist with Java and Spring Boot Kafka producer and consumer deployments and integration troubleshooting.
- Support CI/CD pipelines, deployment automation, configuration management, release activities, health checks, monitoring, performance analysis, incident response, and root-cause analysis.
- Collaborate with application, DevOps, infrastructure, and security teams to onboard Kafka use cases and promote changes across environments.
- Maintain deployment procedures, configuration standards, troubleshooting guides, operational documentation, and runbooks.
Requirements
- Minimum three years of relevant IT or software engineering experience with hands-on Apache Kafka or Confluent Platform exposure.
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a relevant field.
- Hands-on experience with Apache Kafka in development or production environments and Kafka deployment, administration, monitoring, and operational maintenance.
- Understanding of Kafka architecture, including brokers, topics, partitions, replication, ISR, consumer groups, producers, consumers, offsets, retention, and delivery semantics.
- Hands-on knowledge of Java and Spring Boot for Kafka producer and consumer integrations.
- Working knowledge of Linux, networking fundamentals, JVM concepts, troubleshooting, and production support.
- Understanding or hands-on experience with Kafka security, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Understanding of real-time data streaming and event-driven architectures, with the ability to troubleshoot consumer lag, broker connectivity, partitions, replication, offsets, and application integrations.
- Exposure to Kubernetes, OpenShift, Anthos, Helm, Docker, or containerized Kafka deployments is preferred.
- Experience with CI/CD tools such as Jenkins, GitLab CI, or Azure DevOps is preferred.
- Monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools is preferred.
- Understanding of Kafka disaster recovery, multi-cluster architectures, replication, migration, capacity planning, and performance tuning is preferred.
- Experience with Kafka in banking, telecom, financial services, or other mission-critical environments is preferred.
Benefits
- Full-time employment.
- Onsite work arrangement in Islamabad.
Tech Stack
Apache KafkaDockerGitLab CI/CDGrafanaHelmJavaJenkinsKubernetesLinuxOpenShiftPrometheusSplunkSpring Boot
Categories
About Datamatics Technologies
Datamatics Technologies is a London-headquartered, privately held IT services firm founded in 2016 that delivers onsite and offshore data analytics and data science solutions. It provides resource augmentation and managed services—on time-and-materials or fixed-price terms—covering data warehousing, BI, ETL, information security, and cloud platform engineering with emphasis on Oracle Cloud. The company serves telecom, finance, government, and manufacturing clients, primarily across the Middle East and Africa.