
Cloud Data Platform Engineer
Northern Trust2 hours ago
Base Salary
$137k - $234k/yr
Responsibilities
- Design, implement, operate, and improve cloud-based data platform services and infrastructure for enterprise data, analytics, and AI workloads.
- Build scalable Lakehouse capabilities supporting structured, semi-structured, and unstructured data.
- Develop reusable platform services, onboarding processes, Infrastructure as Code modules, deployment templates, and automation frameworks.
- Create and maintain GitHub-based CI/CD pipelines for platform provisioning, application deployment, testing, and operational workflows.
- Develop data ingestion, transformation, orchestration, processing, monitoring, and scaling frameworks.
- Implement disaster recovery, backup, failover, observability, monitoring, alerting, and operational tooling.
- Enforce governance, security, compliance, access control, encryption, audit, metadata management, and data discoverability standards.
- Optimize platform performance, scalability, cost, reliability, and resource utilization.
- Evaluate emerging cloud data services and collaborate with architects, application teams, data scientists, BI teams, and developers on platform standards and roadmaps.
- Mentor junior engineers and contribute to cloud engineering and data development best practices.
Requirements
- Bachelor’s degree in computer science, data engineering, or a related field is required; a master’s degree is preferred.
- At least 7 years of experience in data engineering, cloud engineering, or platform engineering is required.
- Hands-on experience with Azure or AWS and strong experience with Databricks or Snowflake are required.
- Proven DevOps engineering experience, including cloud infrastructure resource creation, data object change management, and Infrastructure as Code, is required.
- Experience building data pipelines with Azure Data Factory, Synapse, Apache Airflow, dbt, Kafka, or similar tools is required.
- Proficiency with GitHub, GitHub Copilot, Terraform, YAML, Azure DevOps, DevSecOps, CloudFormation, or Pulumi is required.
- Programming experience with SQL, Python, YAML, Java, or Scala is required.
- Understanding of cloud-native data services such as Azure Synapse, Data Factory, Azure App Services, AWS Redshift, Glue, S3, and Athena is required.
- Familiarity with Docker and Kubernetes is required.
- Knowledge of FinOps principles and experience operating cloud platforms in regulated environments with governance, audit, security, and compliance requirements are preferred.
- Strong problem-solving, communication, and cross-functional collaboration skills are required.
Benefits
- Comprehensive benefits package including 401(k) and pension benefits.
- Medical, dental, vision, spending accounts, disability, life, and accident insurance benefits.
- Paid time off, parental leave, and caregiver leave.
- Additional voluntary and well-being benefits.
- Discretionary bonus program that may include an equity component.
- Flexible and collaborative work culture with opportunities for internal movement and accessible senior leadership.
Categories
Data EngineeringDevOps