Lead, Data Engineer
Northern Trust6 days ago
Pune, IndiaStaff+
Responsibilities
- Design, build, optimize, and modernize enterprise-scale data platforms using Snowflake and Microsoft Azure.
- Develop batch, micro-batch, near real-time, real-time, and event-driven data pipelines using Python and Astronomer/Airflow.
- Architect cloud data warehouses, data lakes, ELT/ETL frameworks, reusable ingestion patterns, and transformation pipelines.
- Use Snowflake Streams and Tasks, Dynamic Tables, Snowpark, Iceberg Tables, Secure Data Sharing, and Materialized Views.
- Drive data platform reliability, monitoring, observability, operational excellence, governance, performance, scalability, and cost efficiency.
- Build and deploy cloud-native solutions using Azure AKS, Azure Blob Storage, Azure Data Lake Storage, and Azure DevOps.
- Partner with analytics, reporting, product, architecture, engineering, and business teams to deliver trusted analytics-ready data assets.
- Establish coding standards, engineering best practices, and architectural patterns, and participate in technical reviews and architecture governance.
Requirements
- Bachelor's or master's degree in computer science, engineering, information systems, or a related field.
- At least 7 years of experience in data engineering, data platform engineering, or data warehousing.
- At least 5 years of hands-on Snowflake experience.
- Strong expertise in Python and advanced SQL development.
- Experience designing enterprise-scale data warehouses and analytical platforms.
- Strong experience with Airflow and/or Astronomer for orchestration and workflow management.
- Experience building cloud-native solutions on Microsoft Azure.
- Understanding of data modeling, data warehousing, ELT/ETL frameworks, distributed systems, data governance, CI/CD, and DevOps practices.
- Preferred experience in financial services, wealth management, asset management, investment analytics, BI and analytics platforms, semantic modeling, dashboard development, data governance, lineage, metadata management, and cloud BI modernization.
- Preferred Snowflake SnowPro Core, SnowPro Advanced Data Engineer, SnowPro Advanced Architect, Microsoft Certified: Azure Data Engineer Associate, Microsoft Certified: Azure Solutions Architect Expert, or Microsoft Certified: Azure Fundamentals certifications.
Benefits
- Flexible and collaborative work culture with accessible senior leaders and opportunities for internal movement.
- Inclusive workplace committed to reasonable accommodations and community service and philanthropy.
- Role is based in the Northern Trust Pune office.
About Northern Trust
Northern Trust is a financial services company that provides asset servicing (custody and fund administration), asset management, wealth management, and banking/treasury services to institutions, corporations, and affluent families. Its business model centers on fees for assets under custody/administration and management, plus banking services. Founded in 1889 and headquartered in Chicago, it is publicly traded on Nasdaq (NTRS) and serves clients across the Americas, EMEA, and APAC.