Data Engineer (Databricks)
Procter & Gamble2 days ago
Hyderābād, IndiaSenior
Responsibilities
- Design, build, test, and deploy automated data pipelines and ETL/ELT processes on Azure and Databricks.
- Develop production-ready data transformations, integrations, and aggregations using Python and PySpark.
- Write, tune, and optimize complex SQL queries for performance and efficient pipeline execution.
- Ensure data quality, consistency, and reliability across production data flows.
- Design and implement harmonized relational and analytical data models, including data warehouse structures.
- Analyze source schemas, data flows, entity relationships, constraints, and business logic across multiple systems.
- Translate analytical requirements into scalable data structures with analysts and business stakeholders.
- Document data architecture and enforce data modeling standards.
- Serve as the technical SME and quality gatekeeper for external vendor developers.
- Conduct code reviews and pull request approvals and promote coding, testing, security, and CI/CD standards.
- Partner with the Product Owner on delivery milestones, technical trade-offs, and technical debt mitigation.
Requirements
- Demonstrated experience conducting code reviews, establishing engineering best practices, and providing technical guidance to junior peers or external developers.
- Expert-level knowledge of relational data modeling, data warehousing concepts such as star and snowflake schemas, and database design.
- Expert proficiency in SQL, including complex queries, performance tuning, and advanced functions across database systems.
- Advanced Python programming skills for data manipulation, including experience with Pandas.
- Hands-on experience developing PySpark solutions in distributed computing environments.
- Strong practical experience with Azure data services, including Azure Data Lake Storage, Azure Data Factory, and Synapse Analytics.
- Hands-on experience with the Databricks platform.
- Strong communication, analytical, problem-solving, and critical-thinking skills.
Benefits
- Competitive starting salary and benefits program including private health care, P&G stock, saving plans, and sport cards.
- Training and certification paths with broad self-development opportunities.
- Regular salary reviews and potential promotions based on results and performance.
- Opportunities to change roles every few years within P&G.
- Hybrid work model with the option to work from home two days per week.
- Full-time employment under an Umowa o Pracę contract.
- Access to large-scale projects, IT partners, and technologies from the first day.
About Procter & Gamble
Procter & Gamble is a global consumer packaged goods company that makes and sells household, personal care, and hygiene products through retailers and e-commerce. Its portfolio includes brands such as Pampers, Tide, Gillette, Oral-B, and Pantene, serving consumers worldwide. Founded in 1837 and headquartered in Cincinnati, Ohio, P&G is a public company listed on the NYSE under the ticker PG.