
Staff Backend AI Platform Engineer
Freshworks8 hours ago
Base Salary
$225k - $278k/yr
Responsibilities
- Lead implementation of agent runtime orchestration services for reasoning, planning, and tool invocation.
- Design and develop robust APIs and SDKs for internal and external agent workflow development and deployment.
- Build and optimize stateful dialog management, memory services, multi-agent communication, and shared context systems.
- Transition backend capabilities to cloud-native, event-driven services using microservices or service mesh architectures.
- Build task scheduling and long-running workflow operations using workflow engines such as Temporal or Airflow.
- Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.
- Implement RAG pipelines and integrations with vector databases.
- Integrate LangSmith-based evaluation and comprehensive observability across backend services.
- Implement RBAC, API authentication, and multi-tenant isolation logic.
- Establish automated unit, integration, and load testing and implement OpenTelemetry for system visibility.
- Provide technical guidance, mentorship, and code reviews for junior backend engineers.
Requirements
- 6+ years of backend engineering experience.
- 1–2+ years of hands-on AI/ML platform development experience.
- Expert proficiency in Java and Python.
- Hands-on experience with LangChain, LangGraph, or LangSmith.
- Deep understanding of event-driven architectures, microservices, and Kubernetes.
- Experience with AWS, Terraform, relational databases such as PostgreSQL, and vector databases.
- Practical experience with workflow engines such as Temporal or Airflow and messaging systems such as Kafka.
- Preferred: experience with AI-driven planning systems or dialog state tracking.
- Preferred: enterprise security experience including RBAC, SSO, or OAuth2.
- Preferred: experience in a high-growth SaaS or startup environment.
- Preferred: active contributions to open-source backend or AI frameworks.
Benefits
- Hybrid role with onsite expectations three days per week, Tuesday through Thursday, at the San Mateo, California headquarters.
- Eligible for a target bonus and equity plus ESPP.
- Medical, dental, vision, disability, and life insurance options.
- Flexible PTO, flexible spending accounts, commuter benefits, and wellness benefits.
- Adoption and parental leave benefits.
Tech Stack
Categories
About Freshworks
Freshworks builds cloud-based customer and employee service software for IT, support, and business teams, including Freshdesk, Freshservice, and AI assistants (Freddy). It sells via subscription to organizations from SMBs to enterprises; notable customers include Sony Music Entertainment, New Balance, and Seagate. Founded in 2010 and headquartered in San Mateo, California, Freshworks is publicly traded on Nasdaq under the ticker FRSH.