2 months ago
Remote, United KingdomSenior
Responsibilities
- Design and develop end-to-end cloud-based application and data solutions for enterprise customer projects.
- Create software artifacts that automate data platform implementations and data migrations.
- Translate functional and technical requirements into detailed designs and maintainable implementations.
- Develop data pipelines for ingestion, transformation, cleansing, processing, and integration with external systems and data access tools.
- Tune batch and real-time data processing performance.
- Develop test automation, test scenarios, test cases, and related tooling; lead testing execution and follow issues through resolution.
- Perform root cause analysis, diagnostics, troubleshooting, health checks, and configuration reviews for operational issues.
- Secure client cloud data platform components and provide operational visibility across infrastructure, pipelines, and machine learning applications.
- Assist client application developers and advise on efficient data access and manipulation.
- Define and implement efficient operational processes for data platforms and applications.
Requirements
- At least eight years of data engineering experience, including at least three years owning architecture and design decisions.
- Demonstrated hands-on delivery of platforms that the candidate designed and built.
- Deep hands-on experience with Databricks or Microsoft Fabric and working knowledge of the other.
- Strong Spark and SQL skills.
- Solid Python or equivalent production data programming experience.
- Production experience with Delta Lake, medallion architecture, and lakehouse patterns.
- Experience with Power BI, including semantic model design and placement.
- Solid dimensional and semantic modeling skills, including the ability to explain where business logic should reside.
- Working knowledge of data governance, including classification, lineage, cataloging, and access control.
- Experience applying CI/CD, version control, and testing practices to data work.
Benefits
- Competitive total rewards package.
- Flexible remote work from home with no daily office travel requirement and a stable internet connection.
- Substantial training allowance, professional development days, training opportunities, and certification support.
- Company-provided home-office equipment, including a laptop with a choice of operating system.
- Annual budget for personalizing the work environment.
- Annual wellness budget for gym memberships, massages, fitness, and related activities.
- Paid vacation and sick days, plus a day off to volunteer for a favorite charity.
- Opportunities to blog during work hours and volunteer for charitable causes.
Tech Stack
Categories
Data Engineering
About Pythian
Pythian is an Ottawa-based IT services firm providing data, analytics, AI, and cloud consulting plus 24/7 managed database and infrastructure operations for mid-market and enterprise clients. Founded in 1997 and privately held, it is part of Mill Point Capital’s portfolio; its engineers support Oracle, SQL Server, MySQL, NoSQL, and DevOps across multi-cloud and on-premises environments. Its business model combines project-based consulting, implementations, and recurring managed services.