3 days ago
Boston, MA, USAMid Level
H1B sponsor
Base Salary
$116k - $174k/yr
Responsibilities
- Build reliable backend systems and APIs powering AI-driven customer experiences.
- Develop agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.
- Address applied AI challenges including RAG, grounding, hallucination mitigation, model selection, and hybrid approaches.
- Build evaluation methods using representative datasets, automated and human evaluation, regression testing, error analysis, and production signals.
- Improve reliability with guardrails, retries, fallbacks, observability, monitoring, and failure handling.
- Build asynchronous and distributed processing workflows for AI workloads at scale.
- Participate in on-call rotation and diagnose, mitigate, and learn from production incidents.
- Work with external customers and cross-functional partners to identify problems and translate feedback into product improvements.
- Monitor product quality and performance metrics and iterate on shipped experiences.
Requirements
- At least 3 years of professional software engineering experience, including backend systems or distributed applications.
- Hands-on experience building or contributing to generative AI or agentic AI applications, preferably in production or for real users.
- Proficiency in Python and experience with backend frameworks such as FastAPI or Django.
- Experience with asynchronous processing or distributed task/event systems such as Celery, Kafka, SQS, RabbitMQ, or Redis.
- Working knowledge of databases, data modeling, APIs, and production persistence patterns.
- Experience with cloud environments and technologies such as AWS, containers, Kubernetes, or infrastructure automation.
- Ability to evaluate tradeoffs among quality, latency, cost, reliability, and implementation complexity.
- Experience or strong interest in working directly with external customers.
- Preferred experience training, fine-tuning, distilling, or adapting machine learning or language models.
- Preferred experience with reinforcement learning, feedback-driven optimization, LLM-as-judge systems, evaluator calibration, benchmark datasets, AI quality tooling, or production-scale AI optimization.
Benefits
- Comprehensive health, welfare, and wellbeing benefits based on eligibility.
- Potential annual cash bonus, equity, and sign-on payments in addition to base compensation.
- The role may require up to 10% travel for onboarding, client or partner work, team meetings, and industry events, coordinated in advance.
Tech Stack
Categories
About Klaviyo
Klaviyo builds a subscription SaaS platform that lets e-commerce and consumer brands use first-party data to run targeted email, SMS, and push campaigns, with built-in automation and analytics. The product also includes B2C CRM features for segmentation, A/B testing, and customer lifecycle workflows. Founded in 2012 and headquartered in Boston, it is a public company (NYSE: KVYO) used by brands such as Mattel and Glossier.