Senior Software Engineer of Data Platform and Services
LivePersonabout 3 hours ago
Responsibilities
- Own and drive the migration of legacy data pipelines to modern platforms, focusing on Databricks.
- Leverage AI coding assistants to automate and accelerate the migration process.
- Design, build, and maintain scalable Airflow DAGs and Databricks Jobs.
- Implement robust validation strategies to ensure data quality during migration.
- Enhance data platform reliability by contributing to SLOs/SLAs and incident response.
- Possess a strong understanding of contact center analytics and data-driven design.
Requirements
- 6–8 years of software engineering experience with a focus on distributed systems.
- Experience in driving legacy-to-modern platform migrations in production environments.
- Proficiency in the Databricks ecosystem, including Jobs and Delta Lake.
- Strong skills in Python for ETL scripting and designing production DAGs.
- Experience with cloud-native data storage and Kubernetes microservice architectures.
- Excellent communication skills and comfort working with globally distributed teams.
Benefits
- Additional pension scheme with 20% company contribution and annual bonus.
- Flexible Paid Time Off (33 days total) including vacation and care days.
- Remote-first work model with no defined working hours.
- Monthly connection events to foster team bonding.
- Access to internal professional development resources.
Tech Stack
Apache AirflowApache HadoopApache SparkDatabricksGoogle CloudGoogle Cloud PlatformJavaKubernetesPythonScalaSQL
Categories
AI & MLData Engineering