Staff Software Engineer (Real Time/ Streaming Data Engineer)

8 months ago

Bengaluru, IndiaStaff+

Responsibilities

Architect distributed streaming systems using Kafka Streams, Spark, and Flink.
Design the roadmap for transitioning to a robust Lakehouse architecture.
Tune performance and resolve bottlenecks in pipelines processing massive numbers of events per second.
Own pipeline stability, data integrity, low latency, and distributed consistency.
Establish monitoring, observability, reliability, and automated testing standards.
Identify modernization opportunities to improve platform efficiency and cost-effectiveness.

8+ years of software engineering experience.
At least 5 years of deep production experience with Scala or Java, including concurrency, memory management, and garbage-collection tuning.
Deep knowledge of the JVM.
At least 5 years of hands-on experience with the Kafka ecosystem, including offsets, partitions, rebalancing, and state stores.
Experience with Apache Kafka, Kafka Streams, Kafka Connect, Flink, and Spark.
A proven track record designing systems that remain resilient under heavy load.
Understanding of consistency-model and storage-format trade-offs.
Mastery of AWS services and infrastructure for handling terabytes of data, including MSK, EMR, Athena, and Lambda.
Experience with Terraform and Kubernetes.

Competitive salary, insurance, annual leave, bonuses, referral rewards, and other benefits.
Collaborative work with a global engineering team using cutting-edge technology.
Hybrid work model with three days in the office at Prestige Tech Pacific.

1,001-5,000 employees