Base Salary
$200k - $270k/yr
Responsibilities
- Architect and scale orchestration engines for complex agentic workflows, including low-latency tool execution and robust state management.
- Design high-performance RAG infrastructure with vector database integration, search indexing, query processing, result ranking, semantic caching, and automated metadata extraction.
- Develop automated evaluation infrastructure for large-scale golden set simulations, error analysis pipelines, and hillclimbing experiments.
- Collaborate with modeling teams to productionize LLM capabilities as hardened, multi-tenant microservices with guardrails and observability.
- Direct infrastructure strategy for model routing, prompt caching, and token optimization.
- Own and influence architecture for agent execution environments, context retrieval, and customer agent deployment infrastructure.
Requirements
- Bachelor’s degree in Computer Science or a related technical field.
- 7+ years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
- Deep proficiency in Go or Java for systems development and Python for AI orchestration.
- Strong understanding of database internals, distributed state management, and cloud-native architecture, including Kubernetes and FoundationDB.
- Familiarity with vector indices, agent platforms, and scalable data pipelines.
- Experience in a customer-facing technical role, including explaining complex failures to external audiences.
- Ability to distinguish bespoke customer problems from platform-wide gaps worth addressing.
- Experience debugging across service layers and root-causing issues using logs and telemetry.
- Experience defining quality metrics and using evaluation frameworks to improve LLM and agent systems.
- Comfort working on ambiguous, open-ended, externally driven problems.
- Preferred experience with query optimization and SQL engine internals.
- Preferred experience designing multi-tenant systems for sensitive enterprise data at scale.
- Preferred experience developing search infrastructure for large-scale applications.
- Preferred direct experience with the role’s outlined AI infrastructure subsystems.
About Snowflake
**Snowflake is proud to be the Official Data Collaboration Provider for LA28 and Team USA.** Snowflake delivers the AI Data Cloud — a global network where thousands of organizations mobilize data with near-unlimited scale, concurrency, and performance. Inside the AI Data Cloud, organizations unite their siloed data, easily discover and securely share governed data, and execute diverse analytic workloads. Wherever data or users live, Snowflake delivers a single and seamless experience across multiple public clouds. Snowflake’s platform is the engine that powers and provides access to the AI Data Cloud, creating a solution for data warehousing, data lakes, data engineering, data science, data application development, and data sharing. Join Snowflake customers, partners, and data providers already taking their businesses to new frontiers in the AI Data Cloud.