8 hours ago
Base Salary
$120k - $140k/yr
Responsibilities
- Lead the architecture, development, and production rollout of a batch feature store for analytics and AI use cases.
- Design scalable PySpark and Impala SQL pipelines that transform Hive and Oracle data into reusable features.
- Define standards for feature logic, data quality, reconciliation, performance, monitoring, and failure recovery.
- Own batch scheduling and dependencies using CA7 or an equivalent platform.
- Provide hands-on technical direction through design reviews, code reviews, troubleshooting, and mentoring.
- Establish Git/Bitbucket, testing, and AI-assisted development practices.
- Coordinate production releases and change management in accordance with SDLC requirements.
- Collaborate with business, analytics, and technology stakeholders to resolve requirements, communicate trade-offs, and deliver milestones.
- Plan and track work using Jira.
Requirements
- At least 8 years of experience in data engineering, data platforms, or enterprise application development.
- At least 5 years of hands-on experience with PySpark, large-scale ETL/ELT development, and advanced SQL.
- At least 3 years leading technical design and delivery for data engineering teams.
- Advanced PySpark and Impala SQL skills, including query and pipeline performance tuning.
- Proven experience designing enterprise-scale ETL/ELT pipelines.
- Strong expertise with Hive and Oracle data platforms.
- Experience with CA7 or an equivalent batch scheduling platform.
- Proficiency in Linux scripting, Git/Bitbucket, and CI/CD.
- Working knowledge of Agile delivery, Jira, SDLC, production release, and change management.
- Practical experience with AI-assisted development tools.
- Strong communication skills and experience leading delivery across multiple stakeholder groups.
- Experience in banking or financial services is preferred.
Benefits
- Onsite work location in Pittsburgh, NJ, or NY.
- Annual bonus in addition to the base salary.
- Benefits information is provided through the employer's US careers and benefits page.
About EXL
EXL provides data analytics, AI, and digital operations services for enterprises in insurance, healthcare, banking, and other regulated industries. It delivers consulting, managed services, and technology platforms to improve decision-making, risk management, and operational efficiency. Founded in 1999 and headquartered in New York, EXL is a public company listed on the NASDAQ (ticker: EXLS).