Machine Learning

5 days ago

Base Salary

$140k - $160k/yr

Responsibilities

Design and implement LLM-driven features in production systems.
Build and maintain structured and unstructured data pipelines and reusable Python libraries.
Develop prompts, structured outputs, tool-calling workflows, and retrieval pipelines.
Create evaluation suites, test sets, success metrics, and failure analyses for LLM applications.
Diagnose and mitigate hallucination, latency, and cost issues.
Implement monitoring, logging, and alerting for AI services.
Contribute to responsible-AI guardrails and human-in-the-loop processes.
Collaborate with product, engineering, and business stakeholders and document technical findings.

Bachelor’s degree in computer science, machine learning, mathematics, physics, statistics, econometrics, or equivalent practical experience.
Production or production-like software experience through work, internships, research, open source, or substantial personal projects.
Strong Python programming ability with clear, tested, and maintainable code.
Experience with web services, data integrations, testing, logging, and basic monitoring across diverse data types.
Hands-on experience building LLM applications using prompting, structured outputs, tool-calling, retrieval, or multi-step workflows.
Experience evaluating LLM-powered applications through test sets, failure reviews, metrics, and prompt or retrieval iteration.
Grounding in machine learning, statistics, and experimental design, with the ability to interpret technical papers and documentation.
Strong communication and collaboration skills with product, engineering, and business partners.
Interest in responsible AI in financial services, including privacy, security, human review, and appropriate automation.
Familiarity with cloud deployment, containers, and modern release pipelines.

1,001-5,000 employees