1 month ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and implement complex end-to-end data pipelines spanning multiple sources and large SAP datasets.
- Own pipeline scaling, partitioning, clustering, incremental backfills, and performance optimization.
- Manage routine production incidents and deliver permanent fixes through code, tests, and documentation.
- Mentor junior engineers and act as a gatekeeper for technical standards and foundational tooling.
- Collaborate with analysts and data scientists to convert requirements into clear technical stories and specifications.
- Promote standards and best practices through code reviews, reusable assets, and documentation.
- Monitor pipelines using logs and dashboards and diagnose performance and memory issues with query plans and Spark UI.
- Design and implement data quality checks and ensure tests run in CI/CD schedules.
- Contribute to Elanco's cross-company data engineering community and help reduce knowledge silos.
Requirements
- Bachelor's degree in computer science or software engineering, or equivalent professional experience.
- At least 6 years of experience engineering and delivering enterprise-scale data solutions.
- Required experience with Google BigQuery, BigQuery Studio, Databricks, PySpark, and Delta Lake.
- Strong proficiency in SQL, Python, and Spark for building and maintaining data products.
- Experience with complex SQL including multi-join queries and window functions.
- Experience mentoring junior engineers, stewarding practitioner communities, or enforcing team technical standards.
- Preferred familiarity with SAP S/4HANA data structures, SAP BW, and SAP SLT.
- Experience with modern data architectures including Lakehouse Bronze/Silver/Gold layers, star schemas, and data contracts.
- Experience with Git, CI/CD, and Test-Driven Development in a DevSecOps culture.
- Familiarity with data quality frameworks, data governance, and cloud cost and efficiency considerations.
- Ability to independently deliver moderately complex data projects within a defined design.
- Strong interpersonal and communication skills, including the ability to turn rough requirements into clear, testable specifications.
Benefits
- Hybrid work environment in Bangalore, India.
- 0% travel required.
Tech Stack
Categories
Data Engineering
About Elanco
Elanco is a public animal health company that develops pharmaceuticals, vaccines, parasiticides, and nutrition products for pets and farm animals, sold through veterinarians, distributors, and retail channels. Headquartered in Indianapolis and traded on the NYSE (ELAN), it originated at Eli Lilly in 1954 and became an independent company in 2018. Elanco expanded its portfolio by acquiring Bayer Animal Health in 2020, serving companion-animal and livestock markets worldwide.