23 hours ago
Dublin, IrelandSenior
Responsibilities
- Design and enhance scalable, fault-tolerant architectures for real-time and batch data processing.
- Develop and maintain automated data pipelines feeding eBay’s lakehouse architecture.
- Improve data semantics, classification, discovery, and governance.
- Optimize data consumption with materialized views and data subsumption techniques.
- Collaborate with engineering teams, data scientists, and business analysts on data solutions.
- Evaluate emerging data engineering technologies to improve infrastructure scalability, efficiency, and reliability.
Requirements
- Experience with Apache Kafka, Apache Flink, and other streaming technologies for large-scale data processing.
- Strong understanding and implementation experience with lakehouse architectures.
- Knowledge of data semantics, data discovery, and governance practices.
- Experience designing, developing, and automating data pipelines, including materialized views.
- Familiarity with data subsumption and data redundancy reduction techniques.
- Proficiency in Java, Scala, Python, or similar programming languages.
- At least 5 years of relevant software engineering or data engineering experience.
Tech Stack
Categories
Data Engineering
About TCGplayer
TCGplayer operates an online marketplace and software tools for buying and selling trading card games and related collectibles, serving hobby shops and individual sellers. It generates revenue through marketplace fees, seller subscriptions, and fulfillment programs such as TCGplayer Direct. An eBay subsidiary, the company provides authentication and logistics services that help stores list inventory at scale and reach buyers across the U.S. and internationally.
