Freshworks

Staff Engineer - Machine Learning

Freshworks
Apply
8 hours ago
San Mateo, CA, USAStaff+
H1B sponsor

Base Salary

$211k - $261k/yr

Responsibilities

  • Lead implementation of agent runtime orchestration services for reasoning, planning, and tool invocation.
  • Design and develop robust APIs and SDKs for building and deploying agent workflows.
  • Build stateful dialog management and memory services for multi-turn, context-aware agents.
  • Implement multi-agent communication protocols and shared context systems.
  • Transition backend services to cloud-native, event-driven microservices or service mesh architectures.
  • Build task scheduling and long-running workflow operations using Temporal or Airflow.
  • Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.
  • Implement and maintain RAG pipelines and integrations with vector databases.
  • Integrate LangSmith-based evaluation and comprehensive observability across backend services.
  • Implement RBAC, API authentication, and multi-tenant isolation logic.
  • Establish automated unit, integration, and load testing and implement OpenTelemetry.
  • Mentor junior backend engineers and provide technical guidance and code reviews.

Requirements

  • 6+ years of backend engineering experience.
  • 1–2+ years of hands-on experience in AI/ML platform development.
  • Expert proficiency in Java and Python.
  • Hands-on experience with LangChain, LangGraph, or LangSmith.
  • Deep understanding of event-driven architectures, microservices, and Kubernetes.
  • Experience with AWS, Terraform, PostgreSQL, and vector databases.
  • Practical experience with workflow engines such as Temporal or Airflow and messaging systems such as Kafka.
  • Preferred experience with AI-driven planning systems or dialog state tracking.
  • Preferred background in enterprise security, including RBAC, SSO, or OAuth2.
  • Preferred experience in a high-growth SaaS or startup environment.
  • Preferred active contributions to open-source backend or AI frameworks.

Benefits

  • Hybrid schedule with onsite work three days per week, Tuesday through Thursday, at the San Mateo, California headquarters.
  • Eligible for a target bonus in addition to base salary.
  • Dental, medical, vision, disability, and life insurance options.
  • Equity and ESPP.
  • Flexible PTO, flexible spending, commuter benefits, and wellness benefits.
  • Adoption and parental leave benefits.
Freshworks

About Freshworks

5,001-10,000 employees

Freshworks builds cloud-based customer and employee service software for IT, support, and business teams, including Freshdesk, Freshservice, and AI assistants (Freddy). It sells via subscription to organizations from SMBs to enterprises; notable customers include Sony Music Entertainment, New Balance, and Seagate. Founded in 2010 and headquartered in San Mateo, California, Freshworks is publicly traded on Nasdaq under the ticker FRSH.

Contact me