5 months ago
Base Salary
$205k - $270k/yr
Responsibilities
- Lead the design and development of AI agents and Agentic Assist systems, including system architecture and core modeling approaches.
- Architect multi-step agent workflows combining real-time guidance, knowledge retrieval, reasoning, summarization, and automated actions.
- Design, deploy, and optimize LLM-powered systems, RAG pipelines, multi-agent orchestration, and domain-adapted models.
- Improve reasoning, planning, and tool-use capabilities in real-world AI applications.
- Develop offline benchmarking, online experimentation, and LLM-as-a-judge evaluation strategies.
- Diagnose and mitigate hallucinations, retrieval errors, tool misuse, prompt brittleness, and multi-step reasoning failures.
- Define quality metrics such as accuracy, faithfulness, task completion, latency, cost, and robustness.
- Optimize production AI systems for scalability, latency, security, reliability, and cost efficiency.
- Collaborate with product, frontend, and backend teams to integrate AI capabilities into the platform.
- Mentor engineers, contribute to technical strategy, and help shape the AI systems roadmap.
Requirements
- Bachelor’s degree in Computer Science, Mathematics, or a related field; a Master’s or Ph.D. is preferred.
- 5–8+ years of industry experience building and deploying machine learning systems in production, including significant LLM experience.
- Strong expertise in NLP, generative AI, transformer architectures, embeddings, and retrieval systems.
- Proven experience designing and deploying enterprise Retrieval-Augmented Generation systems.
- Experience building and evaluating complex agentic or multi-step LLM workflows.
- Strong knowledge of PyTorch, TensorFlow, Hugging Face, and distributed or cloud-based infrastructure.
- Experience optimizing real-time ML systems for performance, scalability, and reliability.
- Strong technical leadership skills and ability to influence cross-functional decisions.
Benefits
- Comprehensive medical, dental, and vision coverage
- Flexible paid time off
- Paid parental leave
- Retirement savings plan
- Remote work setup budget
- Monthly wellness and communication stipend
- In-office meal program and commuter benefits for onsite employees
Tech Stack
PyTorchTensorFlow
Categories
About Cresta
Cresta builds a generative AI platform for contact centers, combining AI agents, real-time agent assistance, conversation intelligence, and quality/coaching tools. It sells enterprise software to customer-support and sales organizations to automate and improve conversations across voice and digital channels. Founded in 2017 and headquartered in Sunnyvale, California, the privately held company counts brands such as Alaska Airlines, Cox Communications, Intuit, United Airlines, and Marriott among its customers.