Freshworks

Staff Backend AI Platform Engineer

Freshworks
Apply
8 hours ago
San Mateo, CA, USAStaff+
H1B sponsor

Base Salary

$225k - $278k/yr

Responsibilities

  • Lead implementation of agent runtime orchestration services for reasoning, planning, and tool invocation.
  • Design and develop robust APIs and SDKs for internal and external agent workflow development and deployment.
  • Build and optimize stateful dialog management, memory services, multi-agent communication, and shared context systems.
  • Transition backend capabilities to cloud-native, event-driven services using microservices or service mesh architectures.
  • Build task scheduling and long-running workflow operations using workflow engines such as Temporal or Airflow.
  • Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.
  • Implement RAG pipelines and integrations with vector databases.
  • Integrate LangSmith-based evaluation and comprehensive observability across backend services.
  • Implement RBAC, API authentication, and multi-tenant isolation logic.
  • Establish automated unit, integration, and load testing and implement OpenTelemetry for system visibility.
  • Provide technical guidance, mentorship, and code reviews for junior backend engineers.

Requirements

  • 6+ years of backend engineering experience.
  • 1–2+ years of hands-on AI/ML platform development experience.
  • Expert proficiency in Java and Python.
  • Hands-on experience with LangChain, LangGraph, or LangSmith.
  • Deep understanding of event-driven architectures, microservices, and Kubernetes.
  • Experience with AWS, Terraform, relational databases such as PostgreSQL, and vector databases.
  • Practical experience with workflow engines such as Temporal or Airflow and messaging systems such as Kafka.
  • Preferred: experience with AI-driven planning systems or dialog state tracking.
  • Preferred: enterprise security experience including RBAC, SSO, or OAuth2.
  • Preferred: experience in a high-growth SaaS or startup environment.
  • Preferred: active contributions to open-source backend or AI frameworks.

Benefits

  • Hybrid role with onsite expectations three days per week, Tuesday through Thursday, at the San Mateo, California headquarters.
  • Eligible for a target bonus and equity plus ESPP.
  • Medical, dental, vision, disability, and life insurance options.
  • Flexible PTO, flexible spending accounts, commuter benefits, and wellness benefits.
  • Adoption and parental leave benefits.
Freshworks

About Freshworks

5,001-10,000 employees

Freshworks builds cloud-based customer and employee service software for IT, support, and business teams, including Freshdesk, Freshservice, and AI assistants (Freddy). It sells via subscription to organizations from SMBs to enterprises; notable customers include Sony Music Entertainment, New Balance, and Seagate. Founded in 2010 and headquartered in San Mateo, California, Freshworks is publicly traded on Nasdaq under the ticker FRSH.

Contact me