about 3 hours ago
Base Salary
$189k - $284k/yr
Responsibilities
- Independently challenge model owners across lending, fraud, and AML.
- Hunt for silent errors that can lead to inaccurate metrics.
- Choose evaluation methods that hold up under real conditions.
- Work hands-on in unfamiliar codebases and ship production code.
- Build validation tooling for agentic systems.
- Evaluate ML systems end to end and challenge design assumptions.
- Tie explainability and fair-lending findings back to model decisions.
- Help define validation standards for production AI systems.
Requirements
- A quantitative degree or equivalent experience in high-stakes domains.
- Command of effective-challenge methodologies like reproduction and stress testing.
- Deep applied ML and statistics knowledge across various model families.
- Experience with experimentation and statistical rigor.
- Solid software and data engineering skills in Python and SQL.
- Fluency with modern AI tools and frameworks.
- Familiarity with model risk management frameworks and fair-lending standards.
- Strong communication skills to explain conclusions to stakeholders.
Benefits
- Remote work options.
- Medical insurance.
- Flexible time off.
- Retirement savings plans.
- Modern family planning support.
Tech Stack
AWSDatabricksGoogle Cloud PlatformLightGBMMLflowNumPyPandaspytestPythonPyTorchscikit-learnSnowflakeXGBoost
Categories
AI & MLData Science