Principal, Cloud Data Platform Engineer

2 hours ago

Pune, IndiaStaff+

Responsibilities

Design, implement, and maintain scalable cloud-native data platforms on AWS or Azure.
Develop and optimize data pipelines for ingestion, transformation, and processing of structured, semi-structured, and unstructured data.
Build reusable frameworks and automation for data workflows, monitoring, and scaling.
Optimize data storage and compute for performance, security, cost efficiency, and scalability.
Integrate cloud data services with enterprise applications, APIs, and third-party tools.
Implement data quality, lineage, cataloging, metadata management, discoverability, governance, security, and compliance controls.
Establish monitoring, alerting, troubleshooting, disaster recovery, backup, failover, and operational reliability practices.
Establish CI/CD pipelines for data services and platform components.
Enable advanced analytics and AI/ML workloads in partnership with data scientists, BI teams, and application developers.
Evaluate emerging cloud data services and advise on cloud-based data architectures and solutions.
Mentor junior engineers and contribute to cloud engineering and data development best practices.

Bachelor’s degree in Computer Science, Data Engineering, or a related field; a master’s degree is preferred.
15+ years of total technology infrastructure experience and 10+ years of data engineering, cloud engineering, or platform engineering experience.
Hands-on experience with at least one major cloud provider, specifically AWS or Azure.
Strong experience with big data and data processing frameworks such as Spark, Databricks, or Flink.
Experience building data pipelines with Apache Airflow, dbt, Kafka, or similar tools.
In-depth knowledge of Snowflake, Databricks, or similar cloud data platforms.
Hands-on experience with AI/ML data pipelines and feature engineering.
Exposure to regulated environments such as financial services or healthcare.
Proficiency in SQL and one or more of Python, Java, or Scala.
Knowledge of cloud-native data services including AWS Redshift, Glue, S3, and Athena; Azure Synapse and Data Factory; or GCP BigQuery and Dataflow.
Familiarity with Docker and Kubernetes.
Experience with infrastructure-as-code tools such as Terraform, CloudFormation, or Pulumi.
Knowledge of FinOps principles for cost-efficient data platform design.
Strong problem-solving, communication, cross-functional collaboration, mentorship, and influencing skills.

Flexible and collaborative work culture with accessible senior leaders and opportunities for internal movement.
Inclusive workplace committed to supporting employees and the communities it serves.
Philanthropic opportunities and employee community volunteering.
Reasonable accommodations are available during the employment process.
Role associated with Northern Trust’s Pune office, which supports global technology and business operations.

501-1,000 employees