9 days ago
Palo Alto, CA, USASenior
Base Salary
$170k - $185k/yr
Responsibilities
- Design and implement scalable AI services and platform capabilities supporting intelligent agents and enterprise workflows.
- Build reusable SDKs, APIs, orchestration layers, and shared services for AI application development.
- Develop production-grade solutions using LLMs, embeddings, RAG architectures, vector databases, memory systems, and agent frameworks.
- Create prompt engineering approaches, evaluation strategies, guardrails, quality metrics, and monitoring mechanisms.
- Deliver complex AI initiatives from architecture and design through production deployment.
- Optimize system latency, accuracy, cost, reliability, scalability, and operational efficiency.
- Apply testing, infrastructure automation, monitoring, governance, compliance, and security practices.
- Troubleshoot distributed AI services and integrations and conduct root-cause analysis.
- Collaborate with engineers, product managers, architects, and domain experts to translate requirements into scalable solutions.
- Provide technical guidance, mentor or support teammates, and contribute to documentation and engineering best practices.
Requirements
- 5+ years of software engineering experience, including 2+ years building AI/ML-powered applications in production environments.
- Strong proficiency in Python and experience designing backend systems and APIs.
- Experience with LLMs, agent frameworks, RAG architectures, vector databases, embeddings, and AI orchestration platforms.
- Hands-on experience with platforms such as OpenAI, Azure AI, Anthropic, Hugging Face, LangChain, LangGraph, Semantic Kernel, Pinecone, Weaviate, or equivalent technologies.
- Understanding of software architecture, cloud-native development, microservices, and scalable system design.
- Experience building and operating production applications in cloud environments.
- Strong problem-solving, debugging, and performance optimization skills.
- Effective communication and collaboration skills.
- Preferred experience with agentic AI systems, copilots, multi-agent workflows, autonomous enterprise applications, AI evaluation, LLM observability, AI governance, responsible AI, Azure/AWS/GCP AI ecosystems, enterprise platform integrations, and mentoring junior engineers.
Benefits
- Salary range of $170,000 to $185,000 plus bonus potential.
- Flexible paid time off, including sick and holiday leave.
- Medical, dental, and vision insurance.
- 401K with company contribution.
- Flexible spending accounts.
- Life insurance and disability benefits.
- Tuition assistance and community involvement and volunteering events.
Tech Stack
Categories
