10 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Architect scalable, highly available Hadoop and open-source data platforms supporting petabyte-scale growth.
- Own end-to-end execution of complex data-processing pipelines and platform frameworks, optimizing resource utilization, throughput, and reliability.
- Build internal and customer-facing tools for data access, governance, and cluster management.
- Integrate Hadoop data layers with broader enterprise platforms and automate operational workflows.
- Diagnose distributed-system failures, perform root-cause analysis, and tune performance across large-scale environments.
Requirements
- 15+ years of software design and distributed-systems development experience.
- Expert proficiency in Java and/or Scala, with strong knowledge of algorithms, concurrency, and data structures.
- Deep expertise in Linux/Unix internals, network topologies, distributed computing, and large-scale cluster architectures.
- Hands-on architectural expertise with Hadoop, Spark, Apache Iceberg, and Apache YuniKorn.
- Experience with memory profiling, root-cause analysis, and systemic performance tuning for distributed systems.
- Demonstrated success delivering complex infrastructure products in fast-paced enterprise environments.
- Active open-source project contributions or upstream community engagement are strongly preferred.
Tech Stack
Categories
Data EngineeringDevOps
About TCGplayer
TCGplayer operates an online marketplace and software tools for buying and selling trading card games and related collectibles, serving hobby shops and individual sellers. It generates revenue through marketplace fees, seller subscriptions, and fulfillment programs such as TCGplayer Direct. An eBay subsidiary, the company provides authentication and logistics services that help stores list inventory at scale and reach buyers across the U.S. and internationally.