Senior Data Engineer
Fadata Group1 month ago
Madrid, SpainSenior
Responsibilities
- Curate, document, profile, classify, and govern data assets, including PII and sensitive data.
- Build and maintain robust data pipelines, data models, validation, lineage, quality, and integration solutions.
- Integrate data platforms with microservices, APIs, messaging systems, event-driven architectures, and distributed processing frameworks.
- Understand and enhance data deployments and improve the existing Liquibase setup.
- Design reporting, data-sharing, aggregation, data lake, and warehouse foundations using ETL/ELT processes.
- Design, build, and maintain RAG pipelines, including ingestion, chunking, embedding, indexing, and retrieval.
- Work with vector databases and search technologies to support accurate and trustworthy semantic retrieval for AI agents.
- Collaborate with Data Architects, SMEs, Engineering, Architecture, Product, and Business teams on platform strategy and standards.
Requirements
- 5+ years of experience in data engineering or backend engineering with a data focus.
- Strong Python programming skills and hands-on experience with SQL and PL/SQL, including Oracle database models and logic.
- Hands-on experience with data pipeline tools such as Airflow, Spark, Kafka, or Flink.
- Experience with cloud data services on AWS, Azure, or GCP.
- Familiarity with ETL/ELT processes, data integration patterns, distributed systems, and event-driven architectures.
- Understanding of RAG and vector fundamentals, including embeddings, vector stores, and retrieval concepts.
- Awareness of version control, testing, CI/CD, and clean technical documentation.
- Strong problem-solving and analytical skills, with comfort organizing legacy systems of uncertain status.
- Preferred experience with governed data environments, data lakes, data warehousing, dimensional modelling, data science collaboration, data governance and cataloguing tools, distributed pipeline architectures, and enterprise, insurance, or financial-services systems.
Benefits
- Competitive remuneration package and opportunities for personal and professional growth.
- Positive company culture focused on employee wellbeing and multinational collaboration.
- Dedicated no-meeting time for focused work.
- Half-day off on the second Friday of each month for passion projects or personal time.
Tech Stack
Categories
AI ApplicationsData Engineering
About Fadata Group
Fadata Group builds enterprise core insurance software for insurers, covering policy administration, claims, billing, underwriting, and product management across life, P&C, and health. It offers its platform as cloud services and through implementation partners to carriers in multiple regions. Founded in 1990 and headquartered in Munich, it is privately held with shareholders including The Riverside Company and Charles Taylor plc.