18 hours ago
Mumbai, India or Chennai, IndiaMid Level / Senior
Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Azure storage services.
- Ingest data from relational databases, APIs, and file-based systems into Azure data platforms.
- Develop and optimize Azure Databricks notebooks, jobs, and Spark workloads for large-scale data processing.
- Implement data transformations using HPCC/ECL, SparkSQL, and PySpark.
- Design data models and curated bronze, silver, and gold datasets using Delta Lake, Parquet, and other columnar formats.
- Optimize SQL, ECL, and Spark workloads through partitioning, caching, indexing, data pruning, and performance monitoring.
- Monitor and troubleshoot data pipelines and Databricks jobs to resolve performance and scalability issues.
- Implement Azure IAM, managed identities, RBAC, data access controls, encryption, and governance practices.
- Collaborate with business analysts, data scientists, and application teams to understand data requirements.
- Document pipelines, transformations, and architectural designs and participate in code reviews.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- 4–5 years of relevant hands-on experience building, optimizing, and maintaining Azure data solutions.
- Strong proficiency in SQL and data transformation logic.
- Hands-on experience with Azure Databricks, SparkSQL, PySpark, Azure Data Factory, Azure Data Lake Storage Gen2, and Azure SQL or Synapse.
- Understanding of data warehousing concepts, ETL/ELT patterns, and large-scale structured and semi-structured datasets.
- Knowledge of software development principles, design patterns, SDLC processes, testing, deployment, and maintenance.
- Experience with requirements gathering, documentation, problem solving, and code reviews.
- Knowledge of US insurance terminology.
- Preferred experience with Azure DevOps, GitHub, Azure Synapse Analytics, HPCC, data quality frameworks, monitoring tools, and Azure certifications such as DP-203.
- Experience with Agile or Scrum development environments.
Benefits
- Group health insurance covering the employee and family.
- Group life insurance and accident policy.
- Generous long-service awards.
- New baby gift.
- Rewards and certifications.
- Location-specific benefits and accommodations are available through the employer’s support process.
Tech Stack
Categories
Data Engineering
About RELX
RELX provides information-based analytics, research content, and decision tools for scientists, legal and risk professionals, insurers, and governments. Through segments including Elsevier (STM), LexisNexis (legal and risk), and RX (exhibitions), it sells subscriptions, data services, and software platforms used in 180+ countries. Headquartered in London, it is a public company listed in London and Amsterdam.