2 months ago
Responsibilities
- Develop and maintain scalable, high-performance big data platforms.
- Build and improve tooling for distributed databases, filesystems, compute systems, and large-scale private cloud environments.
- Identify opportunities to improve continuous release and deployment environments.
- Build or deploy metadata tooling to improve data discoverability.
- Introduce platform-wide tools that improve data quality.
- Develop technologies and practices that reduce time to insight for analysts and data scientists.
- Develop streaming processing applications and frameworks.
- Operate multiple large-scale big data platforms in collaboration with DataOps Engineers.
Requirements
- At least 6 years of experience with object-oriented Python programming.
- Experience developing and maintaining distributed data and compute systems such as Spark, Trino, and Druid.
- Experience with data modelling tooling and DevOps pipelines or development ecosystems.
- Experience building real-time and batch data pipelines using Kafka and Spark Streaming, with emphasis on frameworks, usability, and quality.
- Experience with the Kubernetes ecosystem, including Kubernetes and Docker, and/or Hadoop ecosystems including Hive, YARN, HDFS, and Kerberos.
- Strong communication skills and the ability to collaborate with diverse stakeholders including analysts, data scientists, data engineers, infrastructure teams, and security teams.
Benefits
- Based in the Amsterdam office with an office-first work arrangement; remote-only work is not offered.
- Adyen provides a supportive environment focused on career ownership, collaboration, diversity, equity, and inclusion.
- The company aims to respond to applications within 5 business days, and the interview process typically takes about 4 weeks.
Tech Stack
Categories
Data EngineeringDevOps
About Adyen
Adyen (AMS: ADYEN) is the financial technology platform of choice for leading companies. By providing end-to-end payments capabilities, data-driven insights, and financial products in a single global solution, Adyen helps businesses achieve their ambitions faster. With offices around the world, Adyen works with the likes of Meta, Uber, H&M, eBay, and Microsoft. For support visit: https://support.adyen.com