24 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Lead architectural enhancements across Hadoop and open-source data platforms for petabyte-scale growth, high availability, fault tolerance, and zero-downtime scaling.
- Own end-to-end execution of complex data-processing pipelines and platform frameworks, optimizing resource utilization, throughput, and reliability.
- Design and deliver internal and customer-facing tools for data access, governance, and cluster management.
- Integrate Hadoop data layers with broader enterprise platforms and automate cross-system workflows.
- Diagnose distributed-system failures, perform root-cause analysis, conduct memory profiling, and tune performance.
- Build production-quality software with AI coding agents by providing appropriate context, specifications, constraints, and validation criteria.
Requirements
- 10+ years of software design and distributed-systems development experience.
- Expert proficiency in Java and/or Scala, with strong knowledge of algorithms, concurrency models, and data structures.
- Deep expertise in Linux/Unix internals, network topologies, distributed computing, and large-scale cluster architectures.
- Hands-on architectural expertise with Hadoop, Spark, Apache Iceberg, and Apache YuniKorn.
- Experience shipping complex infrastructure products in enterprise production environments.
- Strong troubleshooting and performance-tuning skills for large-scale distributed systems.
- Demonstrated experience delivering production-grade software with AI coding tools such as Claude Code and Codex.
- Open-source project contributions or upstream community engagement are strongly preferred.
Tech Stack
Categories
BackendData Engineering
About eBay
eBay operates a global online marketplace where individuals and businesses buy and sell goods via auctions and fixed‑price listings. It generates revenue from transaction fees, advertising, and payment processing on its managed marketplace. Founded in 1995 and headquartered in San Jose, it is a publicly traded company on NASDAQ and serves buyers and sellers in over 190 markets.