2 days ago
Hyderābād, IndiaMid Level / Senior
Responsibilities
- Design and develop data solutions using Azure Databricks and other Azure data services.
- Implement data pipelines, integrations, transformations, migrations, and cloud data processing workflows.
- Extract and process data from flat files, XML, JSON, Parquet, big data appliances, and relational databases.
- Create data models, architecture documents, unit and integration test plans, code review reports, and operational documentation.
- Collaborate with cross-functional teams to deliver analytics projects and client solutions.
- Analyze data to produce actionable insights and improve processing efficiency.
- Lead cloud development activities and provide automated cloud solutions on agile teams.
- Mentor junior data engineers and conduct training on recommended data management practices.
- Maintain adherence to data governance, security, quality, and implementation processes.
- Support troubleshooting, source code management, and application DevOps activities.
Requirements
- Bachelor’s degree or equivalent listed degree qualification in Engineering, MCA, M.Sc, M.E, M.Tech, or MBA.
- At least 4 years of hands-on experience in Azure data engineering.
- Experience with Azure ADLS, Databricks, Data Flows, HDInsight, and Azure Analysis Services.
- Mandatory experience with Hadoop and Spark, plus knowledge of big data frameworks and technologies.
- Strong SQL knowledge, including joins, groups, functions, and stored procedures.
- Experience creating and verifying unit and integration tests.
- Experience with data management, data modeling, data warehouse lifecycles, and cloud data migration.
- Good Unix shell scripting skills and knowledge of application DevOps tools and source code management.
- Experience with Jenkins or GitLab and tools such as CodePipeline, CodeBuild, and CodeCommit.
- Strong analytical, troubleshooting, communication, planning, and organizational skills.
- Oral and written proficiency in English.
- Preferred certifications in Azure or Databricks.
- Preferred experience with streaming systems such as Storm or Spark Streaming, big data ML toolkits such as Mahout, SparkML, or H2O, Azure Functions, and Python.
Benefits
- PwC Acceleration Center role with exposure to Advisory, Assurance, Tax, and Business Services projects.
- Training designed to develop technical and professional skills.
- Mentoring and collaboration opportunities in a dynamic, digitally enabled environment.
- Travel to client locations may be required based on project needs.
- Based in Bangalore, India.
Tech Stack
Categories
Data Engineering
About PwC
PwC is a global network of professional services firms providing assurance, tax, and advisory work for businesses and public-sector clients. It sells project-based and managed consulting, audit, and deals services, and implements and integrates business applications. Formed in 1998 by the merger of Price Waterhouse and Coopers & Lybrand, it is headquartered in London and is one of the Big Four accounting firms.