Lead Data Engineer - T&T
McCormick & Company, Incorporated30 days ago
Gurgaon, IndiaStaff+
Responsibilities
- Collaborate with data product managers and stakeholders to gather requirements and deliver data products.
- Design, implement, maintain, and optimize ELT and data pipelines from diverse source systems.
- Perform data modeling, mapping, cleaning, transformation, manipulation, quality checks, security controls, and performance tuning.
- Build scalable pipelines using Azure Synapse, PySpark, SQL, Fabric, Databricks, and related cloud technologies.
- Document data lineage, ETL topics, solutions, and knowledge-transfer materials.
- Monitor and improve data quality, reliability, scalability, performance, and cost effectiveness.
- Automate manual processes and support enhancements to existing data products and analytics solutions.
- Investigate, troubleshoot, and resolve data errors and discrepancies with analytics support teams.
- Support Data Science, AI, Data Analyst, and business teams with data product and pipeline needs.
Requirements
- Bachelor’s degree in Mathematics, Statistics, Computer Science, Data Analytics/Science, or a related field.
- 8–12 years of data engineering experience.
- Demonstrated coding ability in one or more languages, with PySpark preferred.
- Experience building data pipelines and handling structured and semi-structured data.
- Basic SQL performance-tuning knowledge and experience with pipeline unit testing.
- Experience with Git-based workflows and exposure to medallion architecture.
- Understanding of data privacy fundamentals and experience with data quality and security practices.
- Microsoft Certified: Azure Data Engineer Associate, Microsoft Certified: Fabric Data Engineer Associate, or related cloud technology certification.
- Experience with SQL, Fabric, Databricks, Synapse, Azure Data Factory, Azure ML, Azure DevOps, or the listed secondary GCP tooling.
- Knowledge of data analysis, visualization techniques, and frameworks.
- Experience performing root-cause analysis to answer business questions and identify improvement opportunities.
- Ability to manage multiple priorities, work independently, communicate technical and business issues, resolve conflicts, and collaborate effectively.
Benefits
- 401(k), health insurance, paid time off, competitive compensation, career growth opportunities, tuition assistance, and wellbeing programs.
- Flexibility and support for diverse life stages and choices.
- Community, sustainability, diversity, inclusion, and collaboration-focused workplace programs.
Tech Stack
Categories
Data Engineering
About McCormick & Company, Incorporated
McCormick & Company, Incorporated manufactures and markets spices, seasoning blends, condiments, and flavor solutions for consumers, food manufacturers, and foodservice operators. It sells both branded products for retail and custom flavor systems for B2B customers, distributing to more than 150 countries. Founded in 1889 and headquartered in Hunt Valley, Maryland, McCormick is a public company traded on the NYSE (MKC).