16 days ago
Hyderābād, IndiaSenior
Responsibilities
- Design and build AWS Glue pipelines to move, transform, and load data across Redshift and cloud data stores.
- Develop maintainable and performant PySpark jobs for batch and streaming processing.
- Integrate Kinesis data streams into near-real-time ingestion and analytics workflows.
- Create data models and transformation logic for data warehouses, reporting, and analytical access.
- Tune query performance and pipeline throughput in Redshift, Spark, and related data engineering platforms.
- Troubleshoot data integration issues across source systems, transformation logic, and downstream dependencies.
- Gather requirements from client stakeholders and translate data needs into technical deliverables.
- Review junior team members’ work and provide guidance on pipeline design, development standards, and delivery.
- Support scalable data platform implementation, migration, and cloud modernization activities.
Requirements
- Bachelor’s degree required.
- At least 5 years of experience required.
- Oral and written proficiency in English required.
- Preferred fields of study include Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, and Mathematical Statistics.
- Hands-on experience with AWS Glue and PySpark data pipeline development is preferred.
- Experience developing Redshift data models, tuning performance, and using Kinesis for real-time ingestion is preferred.
- Ability to interpret complex data needs, translate them into deliverables, and mentor junior team members is preferred.
Tech Stack
Amazon RedshiftApache Spark
Categories
Data Engineering
About PwC
PwC is a global network of professional services firms providing assurance, tax, and advisory work for businesses and public-sector clients. It sells project-based and managed consulting, audit, and deals services, and implements and integrates business applications. Formed in 1998 by the merger of Price Waterhouse and Coopers & Lybrand, it is headquartered in London and is one of the Big Four accounting firms.