2 months ago
Base Salary
$200k - $270k/yr
Responsibilities
- Architect and scale orchestration engines for complex agentic workflows, including low-latency tool execution and robust state management.
- Design high-performance RAG infrastructure with vector database integration, search indexing, query processing, result ranking, semantic caching, and automated metadata extraction.
- Develop an evaluation engine for large-scale golden-set simulations, error analysis pipelines, and hillclimbing experiments.
- Collaborate with modeling teams to productionize LLM capabilities as hardened, multi-tenant services with guardrails and observability.
- Direct infrastructure strategy for model routing, prompt caching, and token optimization.
- Use product judgment to distinguish bespoke customer problems from platform gaps worth solving broadly.
Requirements
- Bachelor’s degree in Computer Science or a related technical field.
- 7+ years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
- Deep proficiency in Go or Java for systems development and Python for AI orchestration.
- Strong understanding of database internals, distributed state management, and cloud-native architecture, including Kubernetes and FoundationDB.
- Familiarity with vector indices, agent platforms, and scalable data pipelines.
- Experience in a customer-facing technical role communicating failures and producing internal and customer-safe analyses.
- Ability to debug across service layers using logs and telemetry and root-cause issues in unfamiliar code.
- Experience defining quality metrics and using evaluation frameworks to improve LLM and agent systems.
- Bonus: experience with query optimization, SQL engine internals, multi-tenant systems handling sensitive enterprise data, large-scale search infrastructure, or related subsystems.
- Comfort working with ambiguity and open-ended, externally driven problems.
Tech Stack
Categories
Forward Deployed
About Snowflake
Snowflake builds a cloud-native data platform used by enterprises to store, integrate, share, and analyze data across AWS, Azure, and Google Cloud. Its core products span data warehousing, data lakes, data engineering, and governed data sharing, sold via consumption-based subscriptions. Founded in 2012 and publicly traded on the NYSE (SNOW) following a 2020 IPO, Snowflake supports analytics and data application workloads across industries.