
Staff Engineer - Machine Learning
Freshworks8 hours ago
Base Salary
$211k - $261k/yr
Responsibilities
- Lead implementation of agent runtime orchestration services for reasoning, planning, and tool invocation.
- Design and develop robust APIs and SDKs for building and deploying agent workflows.
- Build stateful dialog management and memory services for multi-turn, context-aware agents.
- Implement multi-agent communication protocols and shared context systems.
- Transition backend services to cloud-native, event-driven microservices or service mesh architectures.
- Build task scheduling and long-running workflow operations using Temporal or Airflow.
- Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.
- Implement and maintain RAG pipelines and integrations with vector databases.
- Integrate LangSmith-based evaluation and comprehensive observability across backend services.
- Implement RBAC, API authentication, and multi-tenant isolation logic.
- Establish automated unit, integration, and load testing and implement OpenTelemetry.
- Mentor junior backend engineers and provide technical guidance and code reviews.
Requirements
- 6+ years of backend engineering experience.
- 1–2+ years of hands-on experience in AI/ML platform development.
- Expert proficiency in Java and Python.
- Hands-on experience with LangChain, LangGraph, or LangSmith.
- Deep understanding of event-driven architectures, microservices, and Kubernetes.
- Experience with AWS, Terraform, PostgreSQL, and vector databases.
- Practical experience with workflow engines such as Temporal or Airflow and messaging systems such as Kafka.
- Preferred experience with AI-driven planning systems or dialog state tracking.
- Preferred background in enterprise security, including RBAC, SSO, or OAuth2.
- Preferred experience in a high-growth SaaS or startup environment.
- Preferred active contributions to open-source backend or AI frameworks.
Benefits
- Hybrid schedule with onsite work three days per week, Tuesday through Thursday, at the San Mateo, California headquarters.
- Eligible for a target bonus in addition to base salary.
- Dental, medical, vision, disability, and life insurance options.
- Equity and ESPP.
- Flexible PTO, flexible spending, commuter benefits, and wellness benefits.
- Adoption and parental leave benefits.
Tech Stack
Categories
About Freshworks
Freshworks builds cloud-based customer and employee service software for IT, support, and business teams, including Freshdesk, Freshservice, and AI assistants (Freddy). It sells via subscription to organizations from SMBs to enterprises; notable customers include Sony Music Entertainment, New Balance, and Seagate. Founded in 2010 and headquartered in San Mateo, California, Freshworks is publicly traded on Nasdaq under the ticker FRSH.