2 months ago
Base Salary
$170k - $215k/yr
Responsibilities
- Design scalable, highly available AI infrastructure covering compute, storage, networking, security, enterprise integrations, Infrastructure as Code, multi-region HA/DR, and CI/CD.
- Design and develop multi-agent systems using LangChain, LangGraph, evaluation frameworks, prompt optimization, and A/B testing.
- Guide agent deployment and operations, including state management, tool integration, API design, and error handling.
- Lead technical maturity assessments and infrastructure audits for enterprise customers.
- Work directly with customers to understand requirements, present recommendations, and guide implementations.
- Partner cross-functionally with engagement managers, product teams, and engineering teams.
Requirements
- 7+ years of experience in hands-on technical, customer-facing roles such as Solutions Architect or Forward Deployed Engineer, or an equivalent unusual background with the required skill set.
- 3+ years of experience designing and deploying production infrastructure on GCP, AWS, or Azure.
- Strong Kubernetes experience, including cluster design, autoscaling, and multi-zone deployments using GKE, EKS, or AKS.
- Experience with Terraform, Helm, GitOps practices, databases, high availability, replication, backup strategies, disaster recovery, networking, security, observability, and CI/CD pipelines.
- At least 1 year of experience building production AI/ML applications or agents.
- Strong experience with LLM frameworks such as LangChain or LangGraph, along with agent state management, evaluation frameworks, prompt engineering, optimization, A/B testing, vector stores, RAG patterns, and knowledge organization.
- Experience with tool integration, API design, error handling, and strong Python and/or TypeScript development skills.
- Enterprise customer-facing experience and experience conducting technical assessments or infrastructure audits.
- Strong communication, problem-solving, consultative, cross-functional collaboration, and hands-on engineering skills.
Benefits
- Medical, dental, and vision coverage.
- Flexible vacation.
- 401(k) plan.
- Meals on in-office days in the US.
- Meaningful equity and other benefits and perks.
- On-site role located in New York City.
Tech Stack
Categories
Solutions Engineering
About LangChain
LangChain builds open-source frameworks and a commercial platform for developing, evaluating, deploying, and operating LLM-powered agents and applications. Its LangSmith suite provides observability, testing, deployment, and governance for enterprise AI workloads; customers include Nvidia, LinkedIn, Workday, and Bridgewater. Privately held and headquartered in San Francisco, the company was founded in 2022.