Principal Engineer - Machine Learning
Freshworks7 hours ago
Chennai, IndiaStaff+
Responsibilities
- Lead the architecture and execution of agent runtime orchestration services focused on reasoning, planning, tool invocation, and low-latency execution.
- Design APIs and SDKs for internal teams and external partners to build, deploy, and manage agent workflows.
- Build stateful dialogue management, shared context, and memory services for multi-turn autonomous agents.
- Establish agent-to-agent communication protocols, coordination patterns, and shared memory for distributed multi-agent workflows.
- Lead migration to cloud-native, event-driven backend services using microservices, service mesh, and event-streaming architectures.
- Optimize LLM orchestration through semantic caching, dynamic batching, token monitoring, and intelligent model routing.
- Direct enterprise RAG pipelines, vector database integrations, and end-to-end tracing and evaluation.
- Establish standards for unit, integration, and load testing, tenant isolation, RBAC, and multi-tenancy.
- Set technical direction, develop platform roadmaps, influence cross-functional engineering decisions, and mentor senior engineers.
Requirements
- 12–18 years of progressive software engineering and machine learning system development experience architecting scalable enterprise backend systems.
- Deep proficiency in Java and Python.
- Hands-on production experience with agentic orchestration frameworks such as LangChain, LangGraph, and LangSmith, and workflow engines such as Temporal and Airflow.
- Advanced understanding of event-driven architectures, microservices, Kubernetes, Kafka, AWS cloud infrastructure, PostgreSQL, and vector databases.
- Ability to resolve complex architectural bottlenecks, anticipate technical risks, manage cross-functional dependencies, and deliver large-scale engineering initiatives.
- Ability to translate business and AI goals into long-term platform roadmaps and influence technical decisions across engineering teams.
- Experience with AI-driven planning systems, dialogue state tracking, or reinforcement learning feedback loops is preferred.
- Experience with enterprise security frameworks including SSO, OAuth2, RBAC, and multi-tenant data isolation is preferred.
- Open-source AI/ML project participation or contributions to major LLM/orchestration libraries is preferred.
Benefits
- Hybrid work arrangement requiring in-office presence three days per week, Tuesday through Thursday.
- Equal-opportunity workplace committed to an inclusive and diverse environment.
Tech Stack
Categories
About Freshworks
Freshworks builds cloud-based customer and employee service software for IT, support, and business teams, including Freshdesk, Freshservice, and AI assistants (Freddy). It sells via subscription to organizations from SMBs to enterprises; notable customers include Sony Music Entertainment, New Balance, and Seagate. Founded in 2010 and headquartered in San Mateo, California, Freshworks is publicly traded on Nasdaq under the ticker FRSH.