Software Engineer III
LexisNexis Risk Solutions18 hours ago
Mumbai, India or Chennai, IndiaSenior
Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Azure storage services.
- Ingest data from relational databases, APIs, and file-based systems into Azure data platforms.
- Implement data transformations on HPCC using ECL and on Azure using Spark SQL and PySpark in Azure Databricks.
- Develop and optimize Databricks notebooks and jobs and write efficient Spark jobs for large-scale data processing.
- Design and implement data models on HPCC using ECL and with Delta Lake, Parquet, and other columnar storage formats.
- Optimize ECL code, SQL, and Spark workloads for performance and scalability.
- Collaborate with business analysts, data scientists, and application teams to understand data requirements and promote data engineering best practices.
Requirements
- Strong proficiency in SQL and data transformation logic, with a solid understanding of data warehousing concepts and ETL/ELT patterns.
- Hands-on experience with Azure Databricks, Spark SQL, and PySpark.
- Experience with Azure Data Factory, Azure Data Lake Storage Gen2, and Azure SQL or Synapse.
- Experience working with large-scale structured and semi-structured datasets.
- Knowledge of software development principles, design patterns, testing, deployment, maintenance, and SDLC processes.
- Proficiency in requirements gathering and documentation.
- Excellent verbal and written communication skills and strong problem-solving abilities.
- Knowledge of insurance terminology and a willingness to learn new processes and technologies.
Benefits
- Country-specific benefits are available.
- The employer supports accommodations and adjustments throughout the hiring process.
- The company is committed to an inclusive, accessible, and equal-opportunity hiring process.
Tech Stack
Categories
Data Engineering
About LexisNexis Risk Solutions
LexisNexis Risk Solutions builds data and analytics products for businesses and governments to assess risk, prevent fraud, verify identities, and meet compliance. It sells APIs, decisioning platforms, and curated data sets used across insurance, financial services, healthcare, and public safety. Headquartered in Alpharetta, Georgia, it operates as part of RELX, providing industry-specific solutions such as insurance risk scores and digital identity intelligence.