5 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Own the internal Kafka distribution, including branch management, patch curation, release cutting, and upgrade planning
- Contribute upstream bug fixes, KIPs, code reviews, and design discussions to Apache Kafka
- Diagnose and fix broker and controller issues involving replication, partition reassignment, KRaft consensus, log storage, ISR management, and protocol handling
- Develop custom production patches for performance tuning, observability hooks, and operational safety valves
- Establish Kafka development practices for testing, benchmarking, and patch validation before rollout
- Mentor a supporting engineer and grow the team’s Kafka capabilities
- Serve as the internal authority on Kafka internals and advise platform teams on configuration, capacity planning, and architecture
- Interface with audit and compliance teams to ensure the Kafka distribution meets compliance and regulatory standards
Requirements
- Deep experience reading, modifying, and debugging Apache Kafka broker, controller, or client internals
- A track record of upstream Apache Kafka contributions, such as committed patches, KIP discussions, pull request reviews, or equivalent community engagement
- Strong distributed-systems fundamentals, including consensus, replication, exactly-once semantics, log-structured storage, and distributed state machines
- Systems-level programming knowledge covering JVM internals, garbage collection tuning, memory layout, JIT behavior, OS-level I/O, page cache, fsync semantics, zero-copy, TCP tuning, and socket buffers
- Experience maintaining a software fork or distribution while managing local patches and upstream mergeability
- At least 8 years of systems or infrastructure software engineering experience, with meaningful experience in Kafka or comparable distributed systems
- Apache Kafka committer or PMC member experience is preferred
- Experience with KRaft, Kafka Streams internals, Kafka Connect internals, Kafka test infrastructure, system tests, Trogdor, or ducktape is preferred
- Experience authoring or co-authoring a KIP is preferred
Benefits
- Medical, critical illness, accidental, and life insurance
- Employee assistance program, onsite medical center, and emergency support system
- Maternity, paternity, adoption assistance, and day-care support programs
- Relocation, transfer support, and travel policies
- Employee and flexible PF contributions, gratuity, NPS, and leave encashment
- Higher education assistance, car lease, and salary advance policy
Tech Stack
Categories
About PhonePe
PhonePe builds a digital payments and financial services platform for consumers and merchants in India, spanning UPI payments, P2P transfers, bill pay, merchant acceptance, insurance, lending, investments, and stock broking (Share.Market). It monetizes through merchant payments and distribution of financial products, and also operates Pincode (hyperlocal commerce) and the Indus Appstore. Founded in 2015 and headquartered in Bengaluru, PhonePe is majority-owned by Walmart.