3 days ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Design and develop cloud data solutions using Azure Databricks and related Azure services.
- Build and maintain data pipelines, integrations, transformations, and migration workflows.
- Collaborate with cross-functional teams to deliver analytics projects and client solutions.
- Analyze data to derive actionable insights and improve data processing efficiency.
- Create detailed design documents, unit and integration test plans, code review reports, and operational documentation.
- Lead cloud development activities on agile teams and provide automated cloud solutions.
- Mentor and support junior data engineers and conduct training on data management practices.
- Maintain adherence to data governance, security, quality, and implementation processes.
Requirements
- Bachelor's degree in Engineering or a listed credential including MCA, M.Sc, M.E, M.Tech, or MBA.
- 4–8 years of hands-on experience, including 4+ years working with Azure ADLS, Databricks, Data Flows, HDInsight, and Azure Analysis Services.
- Mandatory experience with Hadoop and Spark and knowledge of big data frameworks.
- Strong SQL skills, including joins, groups, functions, and stored procedures.
- Experience extracting data from flat files, XML, JSON, Parquet, big data appliances, and RDBMS sources.
- Experience creating and verifying unit and integration tests.
- Good Unix shell scripting skills and knowledge of data management, data modeling, data warehouse lifecycles, and data migration.
- Knowledge of application DevOps tools and source code management, including Git, Jenkins or GitLab, CodePipeline, CodeBuild, and CodeCommit.
- Strong analytical, troubleshooting, communication, planning, and organizational skills.
- Preferred qualifications include Azure or Databricks certifications, Azure Functions experience, streaming systems experience, big data ML toolkit experience, and Python knowledge.
- Professional proficiency in spoken and written English is required.
Benefits
- Training is provided to develop technical and professional skills.
- The role is based in Bangalore, India, with travel to client locations potentially required according to project needs.
- The position supports projects across PwC Acceleration Center services and client engagements.
Tech Stack
Categories
Data Engineering
About PwC
PwC is a global network of professional services firms providing assurance, tax, and advisory work for businesses and public-sector clients. It sells project-based and managed consulting, audit, and deals services, and implements and integrates business applications. Formed in 1998 by the merger of Price Waterhouse and Coopers & Lybrand, it is headquartered in London and is one of the Big Four accounting firms.