1 month ago
Base Salary
$85k - $140k/yr
Responsibilities
- Define the architectural roadmap, technical direction, and best practices for scalable, reliable, and secure end-to-end data pipelines.
- Mentor engineers, conduct code reviews, and drive project timelines and delivery velocity.
- Partner with data scientists, analysts, ML engineers, and business stakeholders to translate requirements into production-ready data solutions.
- Design, build, and optimize high-volume data ingestion and transformation jobs using dbt Core and AWS Glue.
- Develop modular and reusable data pipelines with Dagster and implement real-time flows using Confluent platforms or AWS streaming services such as Kinesis.
- Implement data anonymization, privacy, regulatory compliance, and data quality practices.
- Manage Iceberg open table formats, schema evolution, and data management.
- Optimize query performance and cost across Snowflake, Amazon Redshift, and AWS Athena.
- Integrate Splunk monitoring and observability to identify bottlenecks and troubleshoot production issues.
- Apply DataOps and DevOps fundamentals across the data ecosystem.
Requirements
- 10+ years of progressive hands-on experience in data engineering, data architecture, or a closely related full-stack data role.
- Deep understanding of data engineering principles, ETL/ELT patterns, and metadata management.
- Proven experience building and managing petabyte-scale data infrastructure in a cloud-native environment.
- Strong SQL, PySpark, and Python skills.
- Experience with AWS, including S3, IAM, and VPC.
- Experience with Talend, dbt Core, Iceberg, AWS Glue Catalog, Snowflake, Redshift, Athena, Splunk, AWS streaming services, and Git.
- Insurance industry experience is preferred but not mandatory.
Benefits
- Remote work mode within the United States.
- Annual bonus in addition to base salary.
- Benefits information is provided through the employer’s U.S. careers and benefits page.
About EXL
EXL provides data analytics, AI, and digital operations services for enterprises in insurance, healthcare, banking, and other regulated industries. It delivers consulting, managed services, and technology platforms to improve decision-making, risk management, and operational efficiency. Founded in 1999 and headquartered in New York, EXL is a public company listed on the NASDAQ (ticker: EXLS).