8 days ago
Barcelona, Spain +2 moreStaff+
Responsibilities
- Design, build, and evolve scalable data pipelines and ETL frameworks for real-time and analytical data processing.
- Own the health and performance of the data platform, optimizing latency, throughput, and reliability at scale.
- Collaborate with engineering and cross-functional stakeholders to align data infrastructure with product goals and trader-facing outcomes.
- Drive architectural decisions focused on pipeline reliability, data quality, and scalability.
- Help define the target architecture for ingesting, transforming, storing, and serving data.
- Mentor and support engineers through design reviews, technical discussions, and hands-on knowledge sharing.
Requirements
- Have 7+ years of experience as a data or software engineer with a track record of delivering production-quality data systems.
- Have 2+ years of experience in a product-focused organization and cross-functional collaboration.
- Demonstrate experience building and scaling production data-intensive pipelines and platforms.
- Have deep knowledge of stream and batch processing frameworks, with hands-on Flink or Spark experience essential.
- Be comfortable working with Kotlin, Python, and TypeScript.
- Be able to design high-level architecture and implement low-level details.
- Have experience designing and deploying data infrastructure in AWS or GCP cloud environments.
- Have hands-on experience with Kafka, Redis, and/or clustered Postgres.
- Experience with Apache Iceberg and dbt, AI-agent data infrastructure, distributed systems, or high-throughput and low-latency environments is desirable.
- Team leadership or engineering management experience is desirable.
Benefits
- Equity in a high-growth, venture-backed company.
- Work with a market-leading commodity-trading intelligence product and top-tier tools and technology.
- Role available in London, Barcelona, or Madrid.
- Remote-first company with a hybrid expectation of approximately 2–3 days per week in the office and built-in flexibility.
Tech Stack
Apache FlinkApache KafkaApache SparkAWSdbtGoogle Cloud PlatformKotlinPostgreSQLPythonRedisTypeScript
Categories
Data Engineering
About Sparta
Sparta builds a SaaS platform that gives commodity and oil traders real-time pricing, forecasting, and market intelligence sourced from major brokerages and data providers. It cleans and analyzes data to surface actionable opportunities and support trading decisions, collaboration, and time-to-market. Founded in 2020 and headquartered in Geneva, this privately held company sells subscriptions to trading teams seeking a unified workspace for opportunity identification, pricing, and execution.