16 days ago
Bengaluru, IndiaSenior
Responsibilities
- Build Azure Databricks data pipelines and scalable cloud data engineering solutions.
- Design and maintain data integration, transformation, validation, batch, and streaming workflows.
- Optimize data models, query performance, and warehouse structures for reporting and analysis.
- Use Apache Airflow, Azure Data Factory, and Databricks tools to orchestrate data processes.
- Translate client business needs into technical data architecture and delivery plans.
- Support data modernization and migration from legacy platforms to cloud-native architectures.
- Review code, pipeline logic, data quality controls, and test results to support issue resolution.
- Create architecture, end-user, operations handoff, design, testing, and code review documentation.
- Collaborate with client stakeholders, manage assigned workstreams, and mentor junior team members.
Requirements
- Bachelor’s degree required.
- At least 4 years of experience required.
- Four or more years of experience with Azure ADLS, Databricks, Data Flows, HDInsight, and Azure Analysis Services.
- Experience with data management, data modeling, big data frameworks, Hadoop, and Spark.
- Experience extracting data from flat files, XML, JSON, Parquet, big data appliances, and RDBMS sources.
- Strong SQL knowledge, including joins, groups, functions, and stored procedures.
- Experience creating and verifying unit and integration tests.
- Understanding of data warehouse lifecycles, data migration processes, and cloud data migration methods.
- Unix shell scripting skills and strong analytical and troubleshooting skills.
- Knowledge of application DevOps tools, Git, CI/CD frameworks, Jenkins or GitLab, and source code management.
- Proficiency in written and spoken English and strong communication skills.
- Preferred certifications in Azure or Databricks.
- Preferred experience with Storm, Spark Streaming, Mahout, SparkML, H2O, Azure Functions, and Python.
- Preferred academic fields include management information systems, computer and information science, systems engineering, engineering, mathematics, statistics, or mathematical statistics.
Benefits
- Acceleration Center India role supporting global client teams across geographies and jurisdictions.
- Hands-on learning, access to modern tools, and an inclusive culture.
- Travel requirements are not specified.
- Job posting end date is not specified.
Tech Stack
Categories
Data Engineering
About PwC
PwC is a global network of professional services firms providing assurance, tax, and advisory work for businesses and public-sector clients. It sells project-based and managed consulting, audit, and deals services, and implements and integrates business applications. Formed in 1998 by the merger of Price Waterhouse and Coopers & Lybrand, it is headquartered in London and is one of the Big Four accounting firms.