10 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Architect scalable, highly available, fault-tolerant Hadoop and open-source data platforms supporting petabyte-scale growth.
- Own the technical execution of complex data-processing pipelines and platform frameworks, optimizing resource utilization, throughput, and reliability.
- Design internal and customer-facing tools for data access, governance, and cluster management.
- Integrate Hadoop data layers with broader enterprise platforms and automate cross-platform workflows.
- Diagnose distributed-system failures and bottlenecks through root-cause analysis, memory profiling, and performance tuning.
Requirements
- 10+ years of software design and distributed systems development experience.
- Expert proficiency in Java and/or Scala, with strong knowledge of algorithms, concurrency models, and data structures.
- Deep expertise in Linux/Unix internals, network topologies, distributed computing, large-scale cluster architectures, and enterprise production environments.
- Hands-on architectural experience with Hadoop, Spark, Apache Iceberg, and Apache YuniKorn.
- Experience shipping complex infrastructure products in fast-paced enterprise environments.
- Open-source project contributions or upstream community engagement are strongly preferred.
Tech Stack
Categories
BackendData Engineering
About TCGplayer
TCGplayer operates an online marketplace and software tools for buying and selling trading card games and related collectibles, serving hobby shops and individual sellers. It generates revenue through marketplace fees, seller subscriptions, and fulfillment programs such as TCGplayer Direct. An eBay subsidiary, the company provides authentication and logistics services that help stores list inventory at scale and reach buyers across the U.S. and internationally.