6 hours ago
Boston, MA, USAMid Level
H1B sponsor
Base Salary
$116k - $174k/yr
Responsibilities
- Build reliable backend systems and APIs powering AI-driven customer experiences.
- Develop production agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.
- Solve applied AI problems involving retrieval and RAG, grounding, hallucination mitigation, model selection, and LLM-based, deterministic, or hybrid approaches.
- Build evaluation approaches using representative datasets, automated and human evaluation, regression testing, qualitative error analysis, and production signals.
- Improve reliability through guardrails, retries, fallbacks, observability, monitoring, and failure handling.
- Build asynchronous and distributed processing workflows for AI workloads at scale.
- Participate in on-call rotation and diagnose, mitigate, and learn from production incidents.
- Work directly with external customers and cross-functional partners to identify pain points and translate feedback into product improvements.
- Monitor shipped experiences using quality metrics, system performance, and customer feedback.
Requirements
- At least 3 years of professional software engineering experience with backend systems or distributed applications.
- Hands-on experience building or contributing to generative AI or agentic AI applications, ideally in production or used by real users.
- Proficiency in Python and experience with backend frameworks such as FastAPI or Django.
- Experience with asynchronous processing or distributed task and event systems such as Celery, Kafka, SQS, RabbitMQ, or Redis.
- Working knowledge of databases, data modeling, APIs, and production persistence patterns.
- Experience with cloud environments and technologies such as AWS, containers, Kubernetes, infrastructure automation, or CI/CD systems.
- Ability to evaluate tradeoffs among quality, latency, cost, reliability, and implementation complexity.
- Experience with or strong interest in working directly with external customers.
- Preferred experience includes training, fine-tuning, distilling, or adapting machine learning or language models; reinforcement learning; LLM evaluation infrastructure; and operating AI systems at production scale or optimizing inference cost, latency, or throughput.
Benefits
- Base compensation is listed separately in the salary range; total compensation may include annual cash bonus, equity, sign-on payments, and health, welfare, and wellbeing benefits based on eligibility.
- The role may require up to 10% travel for onboarding, client or partner work, team meetings, and industry events, coordinated in advance.
Tech Stack
Categories
About Klaviyo
Klaviyo builds a subscription SaaS platform that lets e-commerce and consumer brands use first-party data to run targeted email, SMS, and push campaigns, with built-in automation and analytics. The product also includes B2C CRM features for segmentation, A/B testing, and customer lifecycle workflows. Founded in 2012 and headquartered in Boston, it is a public company (NYSE: KVYO) used by brands such as Mattel and Glossier.