2 months ago
Porto, PortugalSenior / Staff+
Responsibilities
- Define and drive the DevOps strategy for the Azure-based Data Platform.
- Design, develop, automate, and optimize CI/CD/CT pipelines for complex data workflows.
- Integrate Azure Data Services, Databricks, Apache Spark, and Delta Lake with DevOps pipelines.
- Implement DevOps best practices, automated testing, deployment strategies, and security and regulatory compliance.
- Apply Azure-native security features including Azure Key Vault, Managed Identities, and Azure Policy.
- Lead observability, monitoring, incident resolution, and platform reliability efforts.
- Evaluate and adopt emerging data technologies, tools, and DevOps methodologies.
- Mentor data engineers, data scientists, and DevOps professionals.
- Coordinate integration across Data Engineering, Data Science, MLOps, and Cloud Infrastructure teams.
Requirements
- 5+ years of hands-on experience as an Azure DevOps Engineer or in a similar senior Data & Analytics role.
- Deep expertise in Microsoft Azure services, particularly data platforms, security, and scalability.
- Experience with Azure DevOps Pipelines, GitHub Actions, and robust deployment pipeline design.
- Hands-on Databricks integration with CI/CD pipelines.
- Experience with Azure Data Services, Apache Spark, and Delta Lake data workflows.
- Expertise with Terraform and Azure Resource Manager templates for multi-cloud infrastructure as code.
- Advanced proficiency with Python, YAML, Git, Bash, and PowerShell.
- Experience with Python packaging and dependency management using Poetry.
- Experience integrating Azure Data Factory into DevOps pipelines.
- Strong experience with pytest, Great Expectations, and other testing or data quality tools.
- Advanced experience with Docker and Kubernetes.
- Experience working in and leading Agile environments such as Scrum.
Benefits
- Professional development with a major global fashion-industry brand.
- Opportunity to support digitalization, eCommerce growth, business intelligence, and advanced analytics.
- Exposure to senior business and eCommerce leaders and high-impact organizational initiatives.
- International and diverse team environment.
- Role based at the Digital Campus in Porto.
Tech Stack
Categories
Data EngineeringDevOps
