2 months ago
Newcastle, United Kingdom or London, United KingdomSenior
Responsibilities
- Support and monitor Azure Data Factory pipelines, datasets, linked services, triggers, Azure Databricks jobs and clusters, Azure Machine Learning workloads, and Power BI dashboards and refreshes.
- Investigate pipeline, job, machine learning, dashboard, and data load failures using Azure Monitor, Log Analytics, alerts, and Application Insights.
- Maintain CI/CD pipelines for ADF, Databricks, and machine learning deployments using Azure DevOps, GitHub Actions, and YAML pipelines.
- Develop automation scripts and self-healing solutions using Python, PowerShell, and Bash to reduce manual intervention and improve reliability.
- Write, optimize, and troubleshoot SQL queries for data validation, root cause analysis, report troubleshooting, and automation.
- Support Azure Synapse Analytics, SQL Server, Azure SQL Database, Snowflake, and BigQuery data warehouse environments and investigate ETL performance issues.
- Provide L2/L3 incident, problem, and change support, participate in on-call rotations, and respond to critical incidents.
- Create and maintain SOPs, runbooks, knowledge base articles, and client documentation.
Requirements
- Strong expertise in Azure cloud services, DevOps, SQL, data warehousing, monitoring, and managed services support.
- Experience with Azure Data Factory pipelines, triggers, parameterization, and monitoring.
- Experience with Azure Databricks, Spark, notebooks, and job orchestration.
- Experience with Azure Machine Learning pipelines, model deployment, and monitoring.
- Experience with Power BI Service dataset refreshes, access control, and report diagnostics.
- Knowledge of Azure DevOps, GitHub Actions, YAML pipelines, Python, PowerShell, Azure Monitor, Log Analytics, alerts, and Application Insights.
- SQL experience for debugging, data validation, optimization, and Azure SQL Database or SQL Server operations.
- Familiarity with data modeling, data warehouse performance tuning, root cause analysis, and ITSM tools such as ServiceNow or Jira.
- Strong verbal and written communication, documentation, presentation, prioritization, and live-support skills.
- Microsoft certifications such as DP-900, AZ-900, or DP-203 are preferred.
- Familiarity with AKS, Docker, containerized machine learning environments, data governance, cloud security, AI Foundry, generative AI, or Fabric is preferred.
- Candidates must already hold UK Government Security Clearance (SC), or be eligible and willing to undergo the SC vetting process.
Benefits
- Full-time, permanent position with preferred locations in Newcastle or London.
- Core working hours are 08:30-17:30 with rotational on-call support approximately one week in four.
- Flexibility is required for off-hours and weekend support during critical deployments or outages.
- Opportunity to work with enterprise-scale Azure solutions across data, AI, DevOps, and automation.
- Learning and career growth opportunities across data engineering, MLOps, and cloud automation.
Tech Stack
Apache SparkAzureBashDatabricksDockerGitHub ActionsGoogle BigQueryMicrosoft SQL ServerPowerShellPythonSnowflake
Categories
Data EngineeringDevOps
About Avanade
Avanade is the world’s leading expert on Microsoft. Trusted by over 7,000 clients worldwide, we deliver AI-driven solutions that unlock the full potential of people and technology, optimize operations, foster innovation and drive growth. As Microsoft’s Global SI Partner we combine global scale with local expertise in AI, cloud, data analytics, cybersecurity, and ERP to design solutions that prioritize people and drive meaningful impact. We champion diversity, inclusion, and sustainability, ensuring our work benefits society and business.