2 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Lead and perform hands-on development of scalable data engineering solutions using Python, PySpark, and related programming languages.
- Design, develop, and deploy AWS cloud-native data platforms using compute, storage, database, orchestration, ETL, analytics, migration, and integration services.
- Design and manage RDS, Aurora, Postgres, and DynamoDB database solutions for structured and unstructured workloads.
- Build and orchestrate automated data workflows using Apache Airflow, AWS Step Functions, and SNS.
- Develop and optimize ETL and analytics pipelines using AWS Glue, EMR, Athena, and Redshift.
- Implement infrastructure as code and deployment automation using AWS CloudFormation and CodePipeline.
- Plan and execute data migration using AWS DataSync and AWS DMS while maintaining data integrity and minimizing downtime.
- Integrate services with API Gateway and manage secure access using IAM.
- Design data models and develop end-to-end pipelines for ingestion, migration, and transformation.
- Write, optimize, and maintain SQL Server queries and stored procedures.
- Collaborate with architects, analysts, business stakeholders, and other cross-functional teams.
- Ensure data pipelines and cloud infrastructure meet enterprise security, governance, and compliance standards.
Requirements
- 4–10 years of professional experience is required, including 6–8 years of hands-on development and 4–6 years developing and deploying AWS cloud-native solutions.
- Strong programming experience with Python, PySpark, or related programming languages.
- Hands-on AWS experience with EC2, Lambda, S3, RDS, Aurora, Postgres, and DynamoDB.
- Experience with Apache Airflow, Step Functions, SNS, Glue, EMR, Athena, Redshift, CloudFormation, CodePipeline, AWS DataSync, and AWS DMS.
- Working knowledge of API Gateway and IAM for secure service integration and access management.
- Expertise handling large datasets, data models, and pipelines for ingestion, migration, and transformation.
- Strong hands-on SQL Server and stored procedure experience.
- Strong problem-solving, analytical, independent-working, leadership, and communication skills.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, with the posting specifying Master of Engineering or Bachelor of Engineering.
- Preferred knowledge of APIs and API integration patterns, SSO implementations, and streaming technologies such as Kafka or Kinesis.
Benefits
- PwC offers inclusive benefits, flexibility programs, wellbeing support, mentorship, and opportunities for learning and professional growth.
- The role is based in Bangalore; travel requirements are not specified.
- PwC states that it provides equal employment opportunities and maintains a discrimination- and harassment-free workplace.
Tech Stack
Categories
Data Engineering
About PwC
PwC is a global network of professional services firms providing assurance, tax, and advisory work for businesses and public-sector clients. It sells project-based and managed consulting, audit, and deals services, and implements and integrates business applications. Formed in 1998 by the merger of Price Waterhouse and Coopers & Lybrand, it is headquartered in London and is one of the Big Four accounting firms.
