Senior Data Engineer (Big Data & Data Warehouse)
Caixa Mágica Software3 days ago
Remote, Portugal or Lisbon, PortugalSenior
Responsibilities
- Analyze, plan, implement, and technically test Data Warehouse solutions and data platform initiatives.
- Develop and maintain raw data ingestion pipelines for Data Lake and related environments.
- Ensure data accessibility, referencing, governance, and quality across enterprise platforms.
- Design and implement ETL processes and data integration solutions.
- Gather requirements and define technical solutions with business and functional teams.
- Participate in certification, quality assurance, and User Acceptance Testing activities.
- Document technical analyses, implemented solutions, testing activities, and project decisions.
- Industrialize, supervise, and integrate data solutions into production environments.
- Propose improvements and optimizations to data platforms, tools, and processes.
- Contribute to project delivery and continuous improvement initiatives.
Requirements
- Bachelor's or Master's degree in Computer Engineering, Information Technology, or a related field.
- More than 6 years of experience in Data Engineering and Data Warehouse environments.
- At least 4 years of experience in functional and technical analysis and corporate data model design.
- Strong expertise in Big Data ecosystems, enterprise data integration, Data Warehouse architecture, ETL development, and automation.
- Experience with SQL, T-SQL, SQL Server Analysis Services, Microsoft BI tools, Power BI, Hadoop, Kafka, NiFi, and Access & Exchange Layer technologies.
- Experience developing with Java, Scala, Python, Apache Spark, and Hive.
- Experience with SQL and NoSQL database technologies, Bash scripting, DevOps practices, and Continuous Integration environments.
- Experience with Jira, Confluence, Draw.io, and Microsoft Office tools.
- Experience in Agile project environments; banking or Consumer Credit experience is advantageous.
- Strong communication, organizational, documentation, presentation, analytical, problem-solving, customer focus, and requirements-gathering skills, including the ability to lead meetings.
- Fluency in Portuguese and English.
Benefits
- Permanent employment contract for a long-term project.
- Tech equipment, SIM card, and personal smartphone.
- Health and life insurance.
- Social events and team-building activities.
- Training in the latest technologies and opportunities for professional growth.
- Supportive team environment with coffee, fruit, snacks, and a welcoming office.
Tech Stack
Categories
Data Engineering
About Caixa Mágica Software
Caixa Mágica Software is a privately held Portuguese software firm based in Lisbon, founded in 2004. It delivers open-source–focused services—custom software development, consulting, training, and nearshore/outsourcing—to public institutions and private enterprises across Europe. The company originated with the Linux Caixa Mágica distribution and has expanded into embedded systems, cloud platforms, mobile/web applications, and digital identity, and contributes to EU-funded research projects.